Thursday, March 13, 2008

# Daily Lab / POC Activities

Extramural:

Attempted UberFTP install using VDT:

The UberFTP installation ended up overwriting the /etc/grid-security/certificates directory causing the Globus container to fail. The failure was corrected by reinstalling the Trusted_CA certificates and removing the /etc/grid-security/certificates-34-1 directory.

All entries regarding /opt/vdt/globus, opt/vdt/gpt, and Trusted_CA were removed from the /opt/vdt/setup.sh script in order to avoid future conflicts.

Verified Globus functionality using GridFTP and WS MDS.
The next UberFTP install attempt will be done using the native installation packages.

Wednesday, March 12, 2008

Daily Lab / POC Activities

Extramural:

  • Installed MonALISA on Dallas and Tarrant
  • Used RFT to transfer MonALISA install files from lab1002 to Tarrant and Dallas

bubba@gump:~> rft -h some.domain.net -f /tmp/rft.xfr
Number of transfers in this request: 1
Subscribed for overall status
Termination time to set: 60 minutes

Overall status of transfer:
Finished/Active/Failed/Retrying/Pending
0/1/0/0/0

Overall status of transfer:
Finished/Active/Failed/Retrying/Pending
1/0/0/0/0
All Transfers are completed

bubba@gump:~> rft -h some.domain.net -f /tmp/dallas_rft.xfr
Number of transfers in this request: 1
Subscribed for overall status
Termination time to set: 60 minutes

Overall status of transfer:
Finished/Active/Failed/Retrying/Pending
0/1/0/0/0

Overall status of transfer:
Finished/Active/Failed/Retrying/Pending
1/0/0/0/0
All Transfers are completed


  • Changed the $INSTALL_LOCATION/MonaLisa/Service/CMD/ml_env FARM_NAME and SHOULD_UPDATE parameters on all nodes.
  • Demonstrated grid functionality
  • Researching MonALISA framework
  • Started researching UGP portal grid software

Tuesday, March 11, 2008

Daily Lab / POC Activities

Extramural:
  • Researched Grid monitoring applications
  • Installed and evaluated MonALISA on lab1002
  • Researched GUI's for GRAM service

Monday, March 10, 2008

Daily Lab / POC Activities

Extramural:

  • Configured Index Service on Dallas, Tarrant and Atlanta
  • Successfully created an RFT transfer job from Atlanta to Tarrant.
Note: (WS MDS)8443/TCP port is blocked on Dallas and Tarrant

Grid Monitoring:
  • Configured and tested WS MDS on lab1002
Note: The WS MDS User interface is not very impressive
  • Researched and downloaded Monalisa for evaluation
  • Researched Virtual Organization Resource Selector (VORS) Note: VORS appears to be specific to Open Science Grid nodes.

Friday, March 7, 2008

Daily Lab / POC Activities

Extramural:

  • Researched Medicus Software
  • Created Globus Applications spreadsheet
  • Installed and tested Access Grid 3.1 software

Thursday, March 6, 2008

Daily Lab / POC Activities

Extramural:

  • Does a GUI exist for GridFTP?

A Windows based GridFTP GUI called, “GridFTP.Net” is currently available. This application was created by the University of Virginia and it can be found at: http://www.cs.virginia.edu/~gsw2c/GridTools. There are no currently working GridFTP GUI’s for Linux. A couple incubator projects have been initiated, but no GA versions have been released.

Current GridFTP GUI Incubator Projects include:

SJTU GridFTP GUI Client (SGGC)

Java CoG Kit Grid FTP GUI

Although it is not a GUI, UberFTP is a text based interactive GridFTP Client. Information on UberFTP usage can be found at: http://www.teragrid.org/userinfo/data/gridftp.php.

  • Continued researching Medicus
  • Started loading and configuring Medicus prerequisite software on lab 1002
  • Install Status:
* GT 4.0.5 (GridFTP, RLS, GSI) - GridFTP Configured, RLS Configured, GSI In Progress
* COG JGlobus - Not Started
* MySQL 4.x and MySQL J/Connector - MySQL 5.0 Installed, MySQL J/Connector 5.1 installed
* MCS only: OGSA/DAI WSRF 2.2 or higher - Not Started
* SSP and MCS only: UnixODBC - Not Started
* Gateway only: PixelMed(included with MEDICUS)- Deployed in /tmp will be moved to /usr/local
* Gateway only: MEDICUS project code - Deployed in /tmp will be moved to /usr/local

Wednesday, March 5, 2008

Daily Lab / POC Activities

Extramural:

  • Prepared grid nodes for the Grid Demonstration meeting
  • Demonstrated GRIDFTP file transfers between servers and 3rd party servers
  • Demonstrated the security features of Globus
  • Researched the Medicus application

Tuesday, March 4, 2008

Daily Lab / POC Activities

Extramural:

  • Worked on configuring RFT on Dallas and Tarrant
  • Configured Globus Container on Dallas and Tarrant

Note: Dallas needs Postgresql installed

  • Currently troubleshooting Dallas RFT issue

Note: May need to recreate the rftDatabase in order to resolve the issue.
Completed GRAM configuration on lab 1002


caBig Activities

Reported by:

Ashley Jacobs, Software Consultants, Inc.

I last worked on the CDC grid data service generation on Friday.

I ran into some problems, fixed those, then ran into new ones. The first problem I ran into was the unorthodox installation of MySQL. (Files were located in unexpected locations, and the MySQL server, having gone down, couldn’t be restarted.) I fixed that by re-installing MySQL by using RPM packages from the MySQL website made specifically for the RedHat Enterprise Linux version installed on that machine.

Then I worked with caCORE SDK 3.2.1 to generate the data service. I fixed some of the problems I found when I ran the data service generator, but I ran into others.

Today I sent an email (most of it was copied by me below) to the caCORE Workspace Lead to see if he had any insight into the problems.

I could use a WebEx remote-login session today to retrieve the build log to send it to the Workspace Lead.

Monday, March 3, 2008

Daily Lab / POC Activities

  • Installed Globus Web Services on lab 1001
  • Worked on troubleshooting the following Reliable File Transfer error found in the /usr/local/globus-4.0.5/var/container.log on lab 1002:

2008-03-03 14:40:44,895 ERROR service.ReliableFileTransferImpl [main,:69] Unable to setup database driver with pooling.Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
2008-03-03 14:40:45,127 WARN service.ReliableFileTransferHome [main,initialize:97] All RFT requests will fail and all GRAM jobs that require file staging will fail.Connection refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Starting SOAP server at: https://192.168.0.202:8443/wsrf/services/
With the following services:

[1]: https://192.168.0.202:8443/wsrf/services/AdminService
[2]: https://192.168.0.202:8443/wsrf/services/AuthzCalloutTestService
[3]: https://192.168.0.202:8443/wsrf/services/CASService
[4]: https://192.168.0.202:8443/wsrf/services/ContainerRegistryEntryService
[5]: https://192.168.0.202:8443/wsrf/services/ContainerRegistryService

  • Added the following entry to the /var/lib/pgsql/data/pg_hba.conf file :
host rftDatabase "globus" 192.168.0.202/32 md
NOTE: IP Adress changed for privacy reasons.

This allowed the rft command to be run, but it produced a new error:

bubba@gump:/usr/local/globus-4.0.5/share/globus_wsrf_rft_test> rft -h gump.somedomain.net -f /tmp/rft.xfr
Number of transfers in this request: 1
Subscribed for overall status
Termination time to set: 60 minutes

Overall status of transfer:
Finished/Active/Failed/Retrying/Pending
0/0/1/0/0
Error:Error authenticating user at source/dest hostAuthentication failed [Caused by: Operation unauthorized (Mechanism level: Authorization failed. Expected "/CN=host/localhost" target but received "/O=SomeGrid/OU=Globus Toolkit/OU=Globus Names/OU=us.somegrid.us/CN=host/bubba.somedomain.net")] [Caused by: Authentication failed [Caused by: Operation unauthorized (Mechanism level: Authorization failed. Expected "/CN=host/localhost" target but received "/O=SomeGrid/OU=Globus Toolkit/OU=Globus Names/OU=us.somegrid.us/CN=host/bubba.somedomain.net")]]
All Transfers failed !

  • The issue was resolved by updating the /tmp/rft.xfr and replacing the localhost entry with a fully qualified domain name. An example of the file can be found below:

####################
true
16000
16000
false
1
true
1
null
null
false
10
gsiftp://atlanta.somedomain.net:2811/home/bubba/gridtesting
gsiftp://tarrant.anotherdomain.net:2811/tmp/rftTest_Done.tmp
####################################

  • Below are the results after the change was made:

bubba@gump:/tmp> rft -h gump.somedomain.net -f /tmp/rft.xfr
Number of transfers in this request: 1
Subscribed for overall status
Termination time to set: 60 minutes

Overall status of transfer:
Finished/Active/Failed/Retrying/Pending
0/1/0/0/0

Overall status of transfer:
Finished/Active/Failed/Retrying/Pending
1/0/0/0/0
All Transfers are completed

  • Started testing WS GRAM on lab 1002
  • Current State of WS GRAM test: Additional configuration needed. Test results below

bubba@gump:~> globusrun-ws -submit -c /bin/touch touched_it
Submitting job...Done.
Job ID: uuid:b516d216-e96a-11dc-ac6c-9fcdae28241b
Termination time: 03/04/2008 21:42 GMT
Current job state: Failed
Destroying job...Done.
globusrun-ws: Job failed: Error code: 201
Script stderr:
bubba's password: