1 / 20

TeraGrid Information Services

Learn about the TeraGrid's Information Services strategy, architecture, and methods available to access grid information. Discover how users, applications, and gateways can easily access TeraGrid's aggregated and indexed content.

naoma
Télécharger la présentation

TeraGrid Information Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TeraGrid Information Services John-Paul “JP” Navarro TeraGrid Grid Infrastructure Group “GIG” Area Co-Director for Software Integration and Information Services University of Chicago, Argonne National Laboratory GCE07 November 12, 2007

  2. Abstract Grids include interconnected hardware components, coordinated software and(grid) services, and institutions and groups that operate them. To effectively use grids, users need access to information about the hardware, software, grid services,and the institutions and groups operating them. The TeraGrid's Information Services vision is to: • define a coordinated way for TeraGrid participants to publish about the services they offer, • define a way for the TeraGrid to aggregate and index the information from all TeraGrid participants, and • to publish this information to the public in a form that can easily be used by other software, users, and TeraGrid service providers themselves. This talk will introduce the TeraGrid's Information Service strategy, the high-level architecture, current and future content, and the methods available to users, applications, and gateways to access TeraGrid Information Services content. GCE 07

  3. TeraGrid Information Services Elements • Collection of Information Grid Services • Service providers publish local information • TeraGrid wide aggregating/indexing for discovery • Primarily focused on public information • Primarily accessible thru software interfaces • Using standards based interfaces • Reliable, scalable, and fast • Initially focused on TeraGrid information • Able to include partner/community information GCE 07

  4. TG Information Services IS [NOT] A coordinated way to index and publish public [Tera]Grid information thru software interfaces. GCE 07

  5. High-Level Components TeraGrid Wide Information Services Apache 2.0 WS/RESTHTTP GET Clients Cache TomcatWebMDS TeraGridWide Respositories WS/SOAP Clients WS MDS4 Service ProviderInformation Services WS/SOAP Clients WS MDS4 GCE 07

  6. Service Provider vs TG Wide Services Services Provider Information Services Content: Locally owned and maintained information Originates anywhere the service provider wishes Services: 1 general purpose MDS service 2 scheduling MDS services: authenticated and public (merging) TeraGrid Wide Information Services Content: Aggregate/index service provider information Additional central information (TGCDB, GIG operated services, …) Cached (service providers services can be down) Authenticated registrations Services: Several redundant servers (99.5% plus availability) Information caching (persistence) Several MDS4 services (WS/SOAP) WebMDS/Tomcat, Apache 2.0, … services (WS/REST) Content published in: HTML, XHTML/XML, XML, Atom, RSS, … GCE 07

  7. Tools WS/* (Tomcat 5.0, Apache 2.0) Benefits Very common web services platform Supports several web service interfaces (including simple) Supports multiple styles like REST, Web 2.0 Can be highly scalable Content Many formats: HTML, XHTML/XML, XML, RSS/Atom, … WebMDS (Globus 4.0.5/VDT 1.7.1) Benefits Live MDS4 content access XPath support XSLT transforms Content Many formats: HTML, XHTML/XML, XML, RSS/Atom WS/SOAP (Globus 4.0.5/VDT 1.7.1 MDS4) Benefits Indexing, Trigger Registration, Publish, Subscribe Security/Authorization Robust WSRF interface Content XML GCE 07

  8. High-Availability Design Clients info.teragrid.org TG wide information services Service Provider Information Services info.dyn.teragrid.org TeraGrid Dynamic DNS Information Services administrators select servers Changes propagate globally with a 15 minute TTL … Doesn’t Change Dynamically Changes GCE 07

  9. Information Services Users User Documentation http://www.teragrid.org/ User Portal http://portal.teragrid.org/ Inca Testing Harness Gateways Peer Grids User Applications info.teragrid.org GCE 07

  10. What’s in Production? Services • TeraGrid Resource Provider Information Services • TeraGrid Wide Aggregating/Indexing Information Services Content (since when) • Scheduling information for User Portal (Spring) • Scheduler load, Queue contents (restricted) • CTSS 4 capabilities kits (August) • Which capability kits are available on each resource • What software is available in each kit on each resource • What services are available from each kit on each resource • TeraGrid Central Database (tgcdb) keys and descriptions (October) GCE 07

  11. Queue Contents in User Portal

  12. CTSS 4 Capability Kits • For each capability kit on each resource • Current support level, and target support level • Development, Testing, Production • Support organization and contact • Inca status URL • Multiple version of a kit with different support levels GCE 07

  13. CTSS 4 Capability Kit Software • For each kit software component on each resource • Name, version, how to access it • Multiple versions of a single component GCE 07

  14. CTSS 4 Capability Kit Services • For each kit service on each resource • Name, type, version, and Endpoint (contact location) • GSI OpenSSH, GridFTP, SRB servers, PreWS & WS GRAM, MDS4 • Multiple services of the same type GCE 07

  15. CTSS Capability Kit Availability

  16. Where are the GridFTP services?

  17. What’s in Development? Expanded content • Local HPC Software • Extended GridFTP service information • (Meta)Scheduling support information Core Extension • Information Services Metadata (registration w/o aggregation) Information Access • tginfo, universal command line query tool • WS/REST, Web 2.0 style information access • Multiple formats: CSV TEXT, RSS/Atom, XML, … • GLUE 2.0 Community publishing • Community supported capabilities • Community information services registration GCE 07

  18. Accessing TeraGrid IS from software Learn what information is available • http://info.teragrid.org/ Choose your access method and client software • WS/SOAP: GT4 Java core, or client toolkit • WS/REST: Any tool that can issue HTTP GET Code TG Information Services queries • Using GT4 access • https://info.teragrid.org:8446/wsrf/services/DefaultIndexServices (XPATH) • https://mds.teragrid.org:8443/wsrf/services/DefaultIndexServices • Using HTTP GET • http://info.teragrid.org:8080/webmds/webmds?info=tgislocal&xsl=<VIEW> • http://info.teragrid.org/restdemo/html/tg/services • http://info.teragrid.org/restdemo/html/tg/sites (Optional) Resource Selection • List of TG ResourceIDs GCE 07

  19. [Not so] Farfetched Possibilities Gateways Publish or just register to TeraGrid Wide Information Services Data collections Data collections register to TeraGrid Wide Information Services Data collections access method, service Endpoint, paths Community software areas Which resources have each CSA What software is available in each CSA, how to access it Service Provider Planned and unplanned outage information Policies Peer grids/interoperability Resources, services available on peer grids (OSG, EGEE, …) ……. GCE 07

  20. More Information Find out more: http://info.teragrid.org/ (links to content and documentation) Request content: mailto: help@teragrid.org or navarro@mcs.anl.gov Discuss Information Services content, requirements, and design: E-mail list tg-cat@teragrid.org View current Information Services content User Portal (scheduler load & queue contents): https://portal.teragrid.org:443/gridsphere/gridsphere?cid=resources User Documentation (CTSS 4 kits, software, services): http://www.teragrid.org/userinfo/software/ctss.php Information Service Main Page: http://info.teragrid.org/ GCE 07

More Related