1 / 16

Integrating Heterogeneous Mass Storage Resources with GridDaEn

GridDaEn (Grid Data Engine) provides a powerful framework for integrating heterogeneous mass storage resources across diverse domains. It ensures effective and secure data operations, enabling seamless access, dispatch, replication, and movement of data assets. With its federated services, GridDaEn offers name, location, and protocol transparency, allowing uniform access to distributed data centers. Key components include the Data Request Broker, Metadata Information Service, and a robust security infrastructure. This architecture supports high-performance data transport, optimizing Replication policy and management.

cais
Télécharger la présentation

Integrating Heterogeneous Mass Storage Resources with GridDaEn

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Profile on the Grid Data Engine (GridDaEn) Xiao Nong Email: xiao-n@vip.sina.com www.griddaen.org www.datagrid.com.cn

  2. GridDaEn Focus • Integration • Integrate heterogeneous mass storage resources located in multiple domains • Effective and secure data operations • Access, storage, dispatch, replication, and movement • Transparent Federated services • Name transparence • Location transparence • Protocol transparence • Uniform access

  3. Data Center 1 NFS NFS Oracle XML FTP CINF Deployment and Management Data Request Providing Integrated Access and Processing GridDaEn Overview Environment Data Center 2 Data Center n Data Response Publishing NFS Data

  4. GridDaEn Architecture • Access interface layer： • Data service interfaces for grid users • System service layer： • Metadata service • Data service • Monitor service • Security service • … • Data operation layer： • Access interfaces to fabric storage

  5. GridDaEnArchitecture

  6. GridDaEn Components • DRB:Data Request Broker • MDIS:MetaData Information Server • GridDaEnSI:Security Infrastructure • GridEye:Monitor System • GridDaEnSM: System Management

  7. Distributed Data Access and Management DRB DRB DRB Client High-level MDIS MDIS Optimization and Scheduling Data Service Data Service Data Service Local MDIS Local MDIS Local MDIS Data Center A Data Center B Data Center C

  8. Data ServiceDRB: Data Request Broker • Access dispatch • System status and location of data • Data management • Uniform view：global logical view of data resources • Data replicating and moving • Data operation • Posix like APIs: create, open, read, write, close, etc.

  9. Data ServiceFederated DRB Service • Distributed collaboratedservice • Remote data access • Distributed data storage • Collaborate management • Distributed cache and replica • Management of cache and copies • On-demand storage and access • High performance data transport

  10. Metadata Information Service • Global MDIS server • System information • Index information • … • Local MDIS server • Domain information • File information • …

  11. Metadata Information Service • Metadata access and management • Uniform data namespace • Data locating, registration, and publishing • System information management • Data discovery • Replication policy and management • Nearest replica access • Control of replica privileges • Management of replica lifetime

  12. GridDaEn Security • GSI Compliance • Only use Proxy function of GSI • Separate GSI from Globus Toolkit • GridDaenSecurityFunctionality： • Secure authentication • Communication encryption • Single sign on • Role-based authentication management • Multi-leveluser mapping

  13. Local domain 1 ….. Local domain 1 ….. Local domain 1 ….. LM LM LM Sensor1 Sensor1 Sensor1 GridEye: Monitor System up-level system • Based on GMA • Producer/consumer model • Web Service Interface • Multi-layer structure • Local monitor--LM • Global monitor--GM Global domain GM manager

  14. GridDaEn Tools • User administrative client • User data operation client • UIs supported: • Graphic user interface • Command line • APIs and SDKs

  15. GridDaEn v1.0 Features • Virtualized resources • Uniform operation and management • Coordination of autonomic system • High usability and security • Scalability • Multi-level authorization • Performance optimization

  16. Our Future Works • GridDaEn v1.0 • Now available in our website • www.griddaen.org • www.datagrid.com.cn • GridDaEn v1.1 • web service Based • Available on 2005-1 • GridDaEn v2.0 beta • Structured data and semi- structured data supported • Related database ,XML database • More native file system and access protocol supported • Performance optimization • Available on 2005-4

More Related