1 / 15

Comprehensive Guide to the E2GRIS1 Information System in Grid Computing

This document provides an overview of the Information System used within grid computing, specifically focusing on the E2GRIS1 system introduced in Itacuruça, Brazil, from November 2 to 15, 2008. It discusses the architecture of the Berkeley DB Information System (BDII), hierarchical querying models, and practical commands for querying grid resources. Essential concepts such as the GLUE schema and local resource monitoring are explored, along with exercises for users to practice their understanding of the system. A must-read for grid computing professionals and enthusiasts.

rae
Télécharger la présentation

Comprehensive Guide to the E2GRIS1 Information System in Grid Computing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. gLite Information System E2GRIS1 Rafael Silva Universidade Federal de Campina Grande (Brazil) Itacuruça (Brazil), 2-15 November 2008

  2. Overview Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 • Information System • Adopted Information System • BDII • Querying a BDII • Useful Commands • GLUE Schema • References • Some Exercises

  3. Information System • What is? • System to collect information on the state of resources • Used for? • To discover resources of the grid and their nature • Workload management • Monitoring (health status of resources) • How? • Monitoring state of the resources locally and publishing fresh data on the information system • Adopting a data model that must be well known to all components that want to access monitored information • More than one implementation: • BDII (Berkeley DB Information System) • R-GMA (Relational Grid Monitoring Architecture) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  4. Information System (2) • Hierarchical System • Information is collected on the leaves of a hierarchical tree and travels towards the root • Clients can query the hierarchical tree at every level • The higher the level against which queries are made, the older is the obtained information • Collecting info • Pull model (higher level severs periodically query lower level severs) • LDAP query model Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  5. Adopted Information System • BDII (Berkeley DB Information System) • Based on LDAP (Light Direct Access Protocol) servers • Evolution of the Globus Meta Directory System (MDS) • Several layers: • Lower Level: GRIS (Grid Resource Information Server) • Medium Level: GIIS (Grid Index Information Server) • Higher Level: Top BDII (BDII Server) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  6. BDII Stays on top of GIIS sites One for each VO Centralized system Three level of hierarchy Every two minutes a cron-job runs a script and collects info from a list of GIIS sites Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  7. Querying a BDII # ldapsearch -x -h <your_BDII_FQDN> -p 2170 -b mds-vo-name=local,o=grid • Query a BDII server • where the –x option indicates that simple authentication should be used; the –h and –p option precede the hostname and port respectively; and the –b option is used to specify the initial entry for the search in the LDAP tree Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  8. Useful Commands $LCG_GFAL_INFOSYS=<your_BDII_FQDN>:2170 $lcg-infosites –-vo edteam ce #CPU Free Total Jobs Running Waiting ComputingElement ---------------------------------------------------------- 106 106 0 0 0 ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam 36 34 0 0 0 ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam 7 7 0 0 0 eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam 22 22 0 0 0 tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam 22 22 0 0 0 ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam 12 0 0 0 0 ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid 88 48 0 0 0 ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam 24 24 0 0 0 ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam $lcg-infosites –-vo edteam se $lcg-infosites –-vo edteam rb • lcg-infosites • Obtain VO-specific information on existing Grid resources Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  9. Useful Commands (2) $ lcg-info --vo edteam --list-ce • CE: ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam • CE: ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam • CE: ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam • CE: ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam • CE: ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid • CE: eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam • CE: ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam • CE: tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam • lcg-info • List either CEs or SEs satisfying a given set of conditions on their attributes, and to print, for each of them, the values of a given set of attributes Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  10. Useful Commands (3) $ lcg-info --list-se –vo edteam --attrs CloseCE - SE: eelaSE1.lsd.ufcg.edu.br - CloseCE eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-eela eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-lhcb eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-ops lcg-info Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  11. Useful Commands $ lcg-info --voedteam --list-ce --query 'TotalCPUs = 10' --attrs 'RunningJobs,FreeCPUs‘ $ lcg-info --vogilda --list-se -attrs 'AvailableSpace,CloseCE‘ Querying the BDII of another VO: $ lcg-info --voeumed --bdii bdii.isabella.grnet.gr:2170 --list-se --attrs 'AvailableSpace,CloseCE' lcg-info Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  12. GLUE Schema • Grid Laboratory Uniform Environment (GLUE) Schema • Provides a standardized description of a Grid computing system, to enable resources and services to be presented to users and external services in a uniform way • Collaboration effort between EU-DataTAG and US-iVDGL projects • XML Schema • GLUE Schema is being mapped to an XML representation • http://glueschema.forge.cnaf.infn.it Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  13. References • BDII Documentation • https://twiki.cern.ch/twiki/bin/view/EGEE/BDII • https://twiki.cern.ch/twiki/bin/view/LCG/BdiiNotes • LCG-2 User Guide • https://edms.cern.ch/file/454439//LCG-2-UserGuide.html • GLUE Schema • http://infnforge.cnaf.infn.it/glueinfomodel Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  14. Some Exercises • Topic related Wiki pages: • https://grid.ct.infn.it/twiki/bin/view/GILDA/InformationSystems Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  15. Questions… Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

More Related