1 / 16

An Overview of the EGEE Information System and its Components

This document provides an introduction to the EGEE Information System, focusing on its decentralized structure, uses, and core components such as the Berkeley Database Information Index (BDII). It details the architecture, including hierarchical levels of BDIIs and their caching mechanisms. Additionally, it presents performance statistics, monitoring systems, and related projects like GLUE 2.0 and GSTAT 2.0. With insights into ongoing developments and challenges, this overview serves as a resource for understanding the infrastructure supporting job/resource matchmaking and monitoring within Grid computing.

karleigh-ross
Télécharger la présentation

An Overview of the EGEE Information System and its Components

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Me, Myself and GD Felix Ehm

  2. Location HARIBO Little Introduction • Introduction • Fellow • IT-GD-ITR • Oliver, Laurence as supervisors • Andreas, Joachim, Gergo, Louis, Maria, Di, Juha, Ricardo • (currently) 28 years old • Activities • EGEE information System • GLUE 2.0 • GSTAT 2.0 • VOMRS Felix Ehm, CERN 2008

  3. The EGEE Information System Felix Ehm, CERN 2008

  4. The EGEE Information System • What is it ? • Decentralized information system providing ways to discover services in a Grid Infrastructure • Hierarchical structure of BDIIs (Berkley Database Information Index) • Uses the OpenLDAP server (and Berkley database) internally • Essential part of the instrastructure • What is it used for ? • Publishing Grid resource/service status information • Matchmaking of jobs/resources • Monitoring • Accounting • Who uses it ? • Nearly every gLite component (SE, CE, WMS, UI, ..) Felix Ehm, CERN 2008

  5. Information Flow The EGEE Information System • Architecture • Resource-, Site- and Top-Level BDII • One core component (BDII) • Each level caches information • Information flow follows ‘pull’ principle • Data format is LDIF • DB is recreated every 2min • Facts and Figures • 70 top level BDIIs worldwide • 256 site level BDIIs • Refresh rate 2-5 min for top level • Data size ~32 MByte LDIF data (30sec to add) • Top-level at CERN handles 4 Million requests/day and serves the full database within 2,5sec; 8 head nodes at 20-30% averaged CPU load • BDII scales linearly (~32% speedup/additional core) • Requesting big data sizes >1MByte slows the system down • Many supported platforms Felix Ehm, CERN 2008

  6. o=grid … o=infosys Entries TimeToAdd TimeToSearch ServedRequests The EGEE Information System • How am I involved ? • Performance tests • Developments • Compressed Content Exchange mechanism (32MByte reduced to 3.3MByte) • BDII statistics • Monitoring Information System infrastructure using Nagios Felix Ehm, CERN 2008

  7. GLUE Schema Felix Ehm, CERN 2008

  8. GLUE Schema • What is it ? • Grid Laboratory Unified Environment • Defines a common conceptual data model to be used for Grid resource/service discovery • Working group part of the OpenGridForum (OGF) • Available as Version 1.3 (http://forge.ogf.org/) • Latest News : • GLUE 2.0 in progress : • Elaborated in respect of 1.3 problems • Not backward compatible to 1.3 • Goes to public comments end of April • How am I involved ? • Chairing storage schema discussion • Render relational model of schema Felix Ehm, CERN 2008

  9. GSTAT 2.0 Felix Ehm, CERN 2008

  10. GSTAT • What is GSTAT ? • Displays summarized information about a Grid infrastructure • Content checking on IS • Monitor dynamic values from the information system • Database driven architecture where data is gathered by agents developed by Academica Sinica (Taipei) Felix Ehm, CERN 2008

  11. GSTAT Felix Ehm, CERN 2008

  12. GSTAT Felix Ehm, CERN 2008

  13. GSTAT • What is GSTAT ? • Displays summarized information about a grid infrastructure • Content checking on IS • Monitor dynamic values from the information system • Database driven architecture where data is gathered by agents developed by Academica Sinca (Taipei) • Why another version ? • “evolved over the past few years from a simple cgi script which displayed the summary of the grid infrastructure to a production service„ • Optimizing the visualization: CERN-PROD html page 500KB (only source)+744 pictures each 14KByte = 10,5MByte • New Requirements/Use Cases • What is the plan ? Felix Ehm, CERN 2008

  14. VORMS Felix Ehm, CERN 2008

  15. VOMRS • Just started • Take over work from Lanxin • Nothing to report (yet) Felix Ehm, CERN 2008

  16. End Questions ? Felix Ehm, CERN 2008

More Related