1 / 25

Databases and the Grid OGSA-DAI Architecture & Status Malcolm Atkinson OGSA-DAI Chief Architect

Databases and the Grid OGSA-DAI Architecture & Status Malcolm Atkinson OGSA-DAI Chief Architect for all members of the OGSA-DAI team Director of National e-Science Centre www.nesc.ac.uk 3 rd September 2002 UK e-Science All Hands Meeting Sheffield Hallam University. Overview.

storm
Télécharger la présentation

Databases and the Grid OGSA-DAI Architecture & Status Malcolm Atkinson OGSA-DAI Chief Architect

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Databases and the Grid OGSA-DAI Architecture & Status Malcolm Atkinson OGSA-DAI Chief Architect for all members of the OGSA-DAI team Director of National e-Science Centre www.nesc.ac.uk 3rd September 2002 UK e-Science All Hands Meeting Sheffield Hallam University

  2. Overview • Database Task Force & GGF DAIS-WG • OGSA-DAI Project • Scope, Scale, Participants, Plans • Architecture • Status • Relationship with OGSA

  3. Data Access & Integration • Central to e-Science • Collaboration • Shared Databases • Curated Knowledge • Accumulated Observations • Accumulated Simulations • Computation • Data mining • Input to models • Calibration of models • Presentation • Publication of results • Visualisation

  4. GGF DAIS-WG OGSA-DAI Core Programme Project UK DBTF • http://www.cs.man.ac.uk/grid-db Membership Malcolm Atkinson (NESC) Vijay Dialani (Southampton Uni.) Norman Paton (Manchester Uni.) Dave Pearson (Oracle UK) Tony Storey (IBM Hursley) Paul Watson (Newcastle Uni.)

  5. GGF DAIS WG • Chairs • Norman Paton (Manchester Uni.) • Leanne Guy (CERN) • Dave Pearson (Oracle UK) • Activity • BoF GGF4 Toronto • WG Meeting GGF5 Edinburgh • Workshops & Mail lists • Goals • Agree Standards for Database Access & Integration • Freely available reference implementations • OGSA-DAI one source & focus for discussions

  6. OGSA-DAI Partners IBM USA EPCC & NeSC Glasgow Newcastle Belfast Manchester Daresbury Lab Cambridge Oxford EPCC & NeSCIBM UK IBM USA Manchester e-SC Newcastle e-SCOracle Oracle Hinxton RAL Cardiff London IBM Hursley Southampton $5 million, 18 months, started 1st February 2002

  7. OGSA-DAI Scope Definition and development of generic Grid data services which provide access to and integration of data held in databases, and the management of data within a distributed environment. Database • A stored, structured collection of data • Accessed using an API that takes account of the structure of the data stored Includes • Relational and object databases • XML repositories • Adequately described & managed collections of files

  8. OGSA-DAI Plan • Two Phases • Phase 1: Started Feb 02 ends 30th September • Detailed Plan – • Requirements, Designs & Prototypes • 6 Work Packages • Project Management (Oracle, EPCC) • Architecture (NeSC, DBTF) • XML Data Management (NeSC & EPCC) • Distributed Query Systems (Manchester & Newcastle) • Metadata & Registries (NeSC & EPCC) • Relational Databases (IBM UK) • Phase 2: 12 months • Structure and Objectives to be Refined in Major Review • GGF5 DAIS WG meeting a major input

  9. OGSA-DAI Time Line WS + GSI UK support ( > 100 downloads) XML + OGSA Prototypes for Early Adopters Design Documents & Demos for DAIS WG @ GGF5 XML + OGSA Prototype Available RDB + GT2 / OGSA Prototypes Available GGF6 WG Papers & Prototypes Ship Alpha Release for GT3 Integration Presentation & Beta @ GGF7 Productisation, RAMPS &Extension Feb ’02 May ’02 Jul ’02 Sep ’02 Dec ’02 Feb ’03 May ’03 Sep ’03 Phase 2 Starts Phase 1 Starts

  10. DAI Key Components GridDataService GDS Access to data & DB operations GridDataServiceFactory GDSF Makes GDS GridDataServiceRegistry GDSR Discovery of GDS(F) & Data GridDataTransportVehicle GDTV Connects components + Moves Data GridDataTransportDepot GDTD GDTV with persistence

  11. Class GridService Registry NotificationConsumer NotificationProducer GDS Mandatory Optional Normal GDSF Mandatory Optional Normal GDSR Mandatory Mandatory Normal GDTS Mandatory GDTV GDTD Mandatory Optional Normal OGSA Relationship

  12. Class GridDataService GridDataTransport Factory GDS Mandatory Normal GDSF Optional Normal Mandatory GDSR Optional GDTS Optional Mandatory GDTV GDTD Optional Mandatory DAI portType Usage

  13. OGSA-DAI Architecture GDSF DSR 1 request for factory client

  14. OGSA-DAI Architecture GDSF DSR 1 request for factory 2 response with GDSFsGSHs client

  15. OGSA-DAI Architecture GDSF 3 script for 3 GDSs DSR 1 request for factory 2 response with GDSFsGSHs client

  16. OGSA-DAI Architecture 4 creation of 3 GDSs GDSF 3 script for 3 GDSs GDS1 DSR 1 request for factory GDS2 2 response with GDSFsGSHs client GDS3

  17. OGSA-DAI Architecture 4 creation of 3 GDSs GDSF 3 script for 3 GDSs GDS1 DSR 1 request for factory GDS2 5 response with 3 GSHs 2 response with GDSFsGSHs client GDS3

  18. OGSA-DAI Architecture 4 creation of 3 GDSs GDSF 3 script for 3 GDSs GDS1 DSR 1 request for factory GDS2 5 response with 3 GSHs 2 response with GDSFsGSHs client GDS3 6 scripts requesting DB actions

  19. OGSA-DAI Architecture 4 creation of 3 GDSs GDSF 3 script for 3 GDSs GDS1 7 transfer data batch to GDS2 stream to GDS3 DSR 1 request for factory GDS2 5 response with 3 GSHs 2 response with GDSFsGSHs client GDS3 6 scripts requesting DB actions

  20. OGSA-DAI Architecture 4 creation of 3 GDSs GDSF 3 script for 3 GDSs GDS1 7 transfer data batch to GDS2 stream to GDS3 DSR 1 request for factory GDS2 5 response with 3 GSHs 2 response with GDSFsGSHs 8 stream data to GDS2 client GDS3 6 scripts requesting DB actions

  21. OGSA-DAI Architecture 4 creation of 3 GDSs GDSF 3 script for 3 GDSs GDS1 7 transfer data batch to GDS2 stream to GDS3 DSR 1 request for factory GDS2 5 response with 3 GSHs 2 response with GDSFsGSHs 8 stream data to GDS2 client GDS3 6 scripts requesting DB actions 9 transfer data batch to client

  22. 4 creation of 3 GDSs GDSF 3 script for 3 GDSs GDS1 7 transfer data batch to GDS2 stream to GDS3 DSR 10 stream data to specified destination 1 request for factory GDS2 5 response with 3 GSHs 2 response with GDSFsGSHs 8 stream data to GDS2 client GDS3 6 scripts requesting DB actions 9 transfer data batch to client OGSA-DAI Architecture

  23. Status • Teams & project coordination effective • Relationship with Early Adopterswith Grid Support Centre with Globus • High rates of interaction • XML GDS & GDSF prototypes available • RDB demo available • Distributed Query demo available • Papers & designs presented at GGF5 • www.nesc.ac.uk • Functional Scope & Architecture for Phase 2 • Drafts & Intensive discussions

  24. OGSA-DAI & OGSA <((-:} • Description, e.g. portType Works Well • Expect to make extensive use of • Data Service Elements • Special to DBs: Static & Dynamic • Component Management • Notification • Grid-FTP • Accounting • Security: • Authentication, Authorisation & Privacy • Reliable invocation • …

  25. OGSA-DAI Summary • On Schedule & Going Well • Contributions via DAIS-WG @ GGF5, 6, 7, … • Coordinating with GT3 Releases • Ending Phase 1 (Design Exploration) • Testing Architectural Design • Using OGSA • Working with Early Adopter Pilot Projects • AstroGrid & MyGrid and others • Many requests for access to the software • Releasing prototypes • Influence OGSA-DAI direction • Via DAIS-WG & as Prototype users

More Related