150 likes | 241 Vues
Installation and Configuration of a Gilda PnP UI. Richard Miguel San Martín SENAMHI – Perú 12th EELA Tutorial Lima, 24-28 September,2007. System requirements. Distributions Fedora Core 2/3/4 Scientific Linux 3.0.x Suse 9.x – 10.x (with some slight modifications) Mandrake 9.2 Debian
E N D
Installation and Configuration of a Gilda PnP UI Richard Miguel San Martín SENAMHI – Perú 12th EELA Tutorial Lima, 24-28 September,2007
Systemrequirements • Distributions • Fedora Core 2/3/4 • Scientific Linux 3.0.x • Suse 9.x – 10.x (with some slight modifications) • Mandrake 9.2 • Debian • NO root privileges is required • Date and time of the system must be correct! • You should make sure some port are opened. The list of the needed ports can be found here: • http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/*checkout*/lcg2/docs/lcg-port-table.pdf • A X509 personal certificate and a successfully join request to a Virtual Organization 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
InstallationStepbyStep • Create user limaxx on the SL virtual machine • $useradd limaxx • $passwd limaxx • Password: GridLIMxx • XX is the machine number • Login with user limaxx • Verify the right time • $ntpdate -s -sb -p 8 -u cefiro.pucp.edu.pe • Verify permission of certificates in .globus directory • userkey.pem file(400 permissions) in $HOME/.globus • usercert.pem file (600 permission) in $HOME/.globus 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
InstallationStepbyStep • $ wget http://lima01.ring.pucp.edu.pe/gildaUI/gilda-UIPnP30.tar.gz --no-check-certificate • $ tar zxvf gilda-UIPnP30.tar.gz • $ cd ./UIPnP30 • $ source install.sh Your UI Gilda PnP is ready for to be used !!!! 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
What install.sh does? • Downloads CA certificates, Signing Policy, CRLs, if needed • Creates the .globus directory (where you have to upload your personal certificates) • Creates the JobOutput directory (where the output of your jobs will be stored) • Sets all the relevant environment variables in .bashrc • Sets a cron job to update the CRL’s periodically 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Configuration of UI DefaultVo: default VO OutputStorage: default output folder of all jobs In $HOME/UIPnP30/glite/etc/, $HOME/UIPnP30/edg/etc/, you can edit the file: glite_wmsui_cmd_var.conf Change the values in : DefaultVo and OutputStorage [ requirements = other.GlueCEStateStatus == "Production" ; rank = - other.GlueCEStateEstimatedResponseTime ; RetryCount = 3 ; ErrorStorage= "/tmp" ; OutputStorage="~/JobOutput"; ListenerStorage = "/tmp" ; LoggingTimeout = 30 ; LoggingSyncTimeout = 30 ; . . . DefaultLogInfoLevel = 1; DefaultVo = "gilda"; ] 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Configuration of UI In this file you define : • The VO name • Hostname and port of the following servers: Resource Broker Logging&Bookkeeping MyProxy In HOME/UIPnP30/glite/etc/gilda/glite_wmsui.conf /, file: [ VirtualOrganisation = "gilda"; HLRLocation = ""; NSAddresses = { "glite-rb.ct.infn.it:7772" }; LBAddresses = { {"glite-rb.ct.infn.it:9000"} }; MyProxyServer = "grid001.ct.infn.it"; ] 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Gilda PnP UI testing Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=LIMA/CN=LIMA41/Email=valeria.ardizzone@ct.infn.it Enter GRID pass phrase: Creating temporary proxy ........................................ Done Contacting voms.ct.infn.it:15001 [/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it] "gilda" Done Creating proxy .......................................................... Done Your proxy is valid until Wed Sep 26 12:11:56 2007 create a proxy: voms-proxy-init --voms gilda You should get something like this: 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Testing: Check for job matching Selected Virtual Organisation name (from proxy certificate extension): gilda Connecting to host glite-rb.ct.infn.it, port 7772 *************************************************************************** COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-infinite ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-long ce-nano-37.to.infn.it:2119/jobmanager-lcgpbs-short gilda-ce-01.pd.infn.it:2119/jobmanager-lcgpbs-short gilda01.ihep.ac.cn:2119/jobmanager-lcgpbs-infinite iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short gilda01.ihep.ac.cn:2119/jobmanager-lcgpbs-short *************************************************************************** • Create a jdlfile : (example) Type = "Job"; JobType = "Normal"; Executable = "/bin/hostname"; StdOutput = "hostname.out"; StdError = "hostname.err"; OutputSandbox = {"hostname.err","hostname.out"}; Arguments = "-f"; $ edg-job-list-match hostname.jdl 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Testing: Job submission Selected Virtual Organisation name (from --vo option): gilda Connecting to host glite-rb.ct.infn.it, port 7772 Logging to host glite-rb.ct.infn.it, port 9002 ********************************************************************************************* JOB SUBMIT OUTCOME The job has been successfully submitted to the Network Server. Use edg-job-status command to check job current status. Your job identifier (edg_jobId) is: - https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ ********************************************************************************************* • edg-job-submit --vo gilda hostname.jdl 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Testing: Job Status ************************************************************* BOOKKEEPING INFORMATION: Status info for the Job : https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ Current Status: Done (Success) Exit code: 0 Status Reason: Job terminated successfully Destination: grid010.ct.infn.it:2119/jobmanager-lcgpbs-infinite reached on: Wed Sep 26 05:34:07 2007 ************************************************************* edg-job-status https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Testing: Job get Output Retrieving files from host: glite-rb.ct.infn.it ( for https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ ) ********************************************************************************* JOB GET OUTPUT OUTCOME Output sandbox files for the job: - https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ have been successfully retrieved and stored in the directory: /home/lima41/JobOutput/lima41_48JTceTQDIdFeG1ZB_l6nQ ********************************************************************************* edg-job-get-output https://glite-rb.ct.infn.it:9000/48JTceTQDIdFeG1ZB_l6nQ 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Testing: LFC Catalog [lima41@lima41 lima41]$ lfc-ls -l -rw-rw-r-- 1 196 102 13499 Jul 12 07:08 .bash_history -rw-rw-r-- 1 467 102 603 Jul 06 2006 .bash_profile -rw-rw-r-- 1 196 102 3169 Jul 12 07:02 .bashrc drwxrwxr-x 0 714 102 0 Sep 19 2006 007guy -rw-rw-r-- 1 837 102 14690244 Nov 23 2006 0476e601-a838-4b72-9508-94b887967301 -rwxrwxr-x 1 378 102 817 Jun 23 2006 04ad08fb-b26e-4b2f-8492-d9101069e081 -rwxrwxr-x 1 585 102 642 Aug 28 2006 04db3c38-3d61-4858-be5e-8fec7245c83b -rwxrwxr-x 1 378 102 8263998 Jun 26 2006 06085e4b-8944-48da-8a50-e723f0bc584b -rw-rw-r-- 1 399 102 7031793 Jul 02 2006 06d2f3cd-2043-48a7-931c-eae6f2b5c120 -rw-rw-r-- 1 430 102 1893 Jul 05 2006 06e77989-ff51-435c-a30a-152b42ea7b80 -rw-rw-r-- 1 399 102 5435239 Jul 05 2006 08b338b7-80da-497c-a0d1-cffe451d8e1b -rw-rw-r-- 1 837 102 6460491 Nov 22 2006 0b5dc765-2a5a-4523-9def-f75c802726 • Set the followingenvironmentvariables to specify the catalog type and its location: export LCG_CATALOG_TYPE=lfc export LFC_HOST=lfc-gilda.ct.infn.it export LFC_HOME=/grid/gilda/ • $ lfc-ls –l 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
Testing Resource Discovery: BDII To find out which SEs the user is allowed to use, one can use the following command: $ $ lcg-infosites --vo gilda se [lima41@lima41 lima41]$ lcg-infosites --vogilda se Avail Space(Kb) Used Space(Kb) Type SEs ---------------------------------------------------------- 63550000 10520000 n.a egee016.cnaf.infn.it 324080000 48428868 n.a aliserv6.ct.infn.it 7142988 2425464 n.a trigriden01.unime.it 69169736 2576304 n.a se-nano-38.to.infn.it 54450000 3550000 n.a iceage-se-01.ct.infn.it 91090000 5030000 n.a gilda04.ihep.ac.cn 885548728 26858688 n.a grid005.iucc.ac.il 19038976 554880 n.a gn0.hpcc.sztaki.hu export PERL5 LIB=$PERL5LIB:/home/lima41/UIPnP30/lcg/sft/lib/perl/ 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007
References UI PnP GILDA Web site:https://gilda.ct.infn.it/UIPnP/ gLite 3.0 User guide:http://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/index.cgi?var=eis/docs 12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS – Lima, 24-29 September, 2007