1 / 15

mardi 30 mars 2010

mardi 30 mars 2010. Lavoisier : a way to integrate heteregeneous monitoring systems. Cyril L’Orphelin IN2P3/CNRS Computing Centre, Lyon, France. Outlines. - Motivations - Main benefits of using Lavoisier - Concrete example : the Operations Dashboard - Future developments.

yasir-mcpherson
Télécharger la présentation

mardi 30 mars 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. mardi 30 mars 2010 Lavoisier : a way to integrate heteregeneous monitoring systems. Cyril L’Orphelin IN2P3/CNRS Computing Centre, Lyon, France

  2. HEPiX Spring 2010 Workshop Outlines - Motivations - Main benefits of using Lavoisier - Concrete example : the Operations Dashboard - Future developments

  3. HEPiX Spring 2010 Workshop • - VO Information • VO Contacts • User Contacts CIC-DB VO repository (static) SQL SQL HTTP - Site Information - Site Contacts - Downtimes Site repository (static) GOC-DB SQL SQL GGUS - Create ticket - Update ticket - View ticket Ticketing System SOAP - Test results - Status per nodes Monitoring Framework Job Submission Framework X-SQL Notifications about problem on services AMQ SAM Nagios - GIIS status per site - Storage Information - Jobs Information GIIS browser GSTAT HTTP Dynamic information per nodes , per sites ... LDAP Database for sites BDII LDAP VO User repository (dynamic) - VOMS certificates. - VOMS users VOMS HTTP + Script EGEE / LCG information providers 30/03/10 3

  4. HEPiX Spring 2010 Workshop Motivations - Context • Multiple heterogeneous sources and technologies : • No common language • No direct cross queries • For a web application , it means lot of computations and treatment and a dependency to the technologies proposed • The information might be : • Not usable • Not available • Too long to be queried

  5. HEPiX Spring 2010 Workshop Our solution : Lavoisier • An answer developped at CC-IN2P3: the Lavoisier service • A good mechanism to build unified views from heterogeneous data sources http://grid.in2p3.fr/lavoisier "Nothing is lost, nothing is created, all is transformed" Antoine Laurent Lavoisier (1743 - 1794) 30/03/10 5

  6. HEPiX Spring 2010 Workshop Accesses to data

  7. HEPiX Spring 2010 Workshop Separation of roles

  8. HEPiX Spring 2010 Workshop Other main features

  9. HEPiX Spring 2010 Workshop Lavoisier Console

  10. HEPiX Spring 2010 Workshop The Operations dashboard Heterogeneous data XML HTML

  11. HEPiX Spring 2010 Workshop The Synoptic view https://operations-portal.in2p3.fr/

  12. HEPiX Spring 2010 Workshop Access to details

  13. HEPiX Spring 2010 Workshop Future developments (Lavoisier 1.x) • RDBMS adaptor (on-going development) • user see the entire database as a huge XML document • structure described by Hibernate or Doctrine ORM mapping file • query with XPath / response as XML • but of course this huge XML document is never built • XPath query is translated to SQL query • only the result set is converted to XML data • XQuery and XPath as alternatives to XSLT • available through SOAP and REST operations • available as adapters (=> cacheable processing result)

  14. HEPiX Spring 2010 Workshop Future developments (Lavoisier 2.0) • Refactoring of core engine • based on JMS to increase flexibility for notifications • within a Lavoisier instance (through in-memory messages) • between Lavoisier instances (though OpenWire protocol) • improve extensibility with adapter interfaces for… • Data protocol connectors • Data format transformers • Cache content managers 4 hard-coded managers • Cache refresh triggers 8 hard-coded triggers • Cache refresh scheduler No scheduler (overload risk) Lavoisier 2.0 Lavoisier 1.x Adapters do both (less reusable)

  15. HEPiX Spring 2010 Workshop Links • Lavoisier : • http://grid.in2p3.fr/lavoisier/ • Dashboard : • https://operations-portal.in2p3.fr (you need to be registered in GOC DB ) • https://forge.in2p3.fr/projects/show/opsportaluser

More Related