1 / 15

SRB-n-SRM for HEP Data Management (Possible architectures for brainstorming)

SRB-n-SRM for HEP Data Management (Possible architectures for brainstorming). Arun swaran Jagatheesan arun@sdsc.edu San Diego Supercomputer Center. A picture is worth a 1000 KB. First, options/possibilities in the Over all Architecture. SRM. SRM. SRM. SRM. SRM. SRM. /…/text1.txt.

faith-bentley
Télécharger la présentation

SRB-n-SRM for HEP Data Management (Possible architectures for brainstorming)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SRB-n-SRM for HEP Data Management(Possible architectures for brainstorming) Arun swaran Jagatheesan arun@sdsc.edu San Diego Supercomputer Center

  2. A picture is worth a 1000 KB First, options/possibilities in the Over all Architecture

  3. SRM SRM SRM SRM SRM SRM /…/text1.txt /…//text2.txt /txt3.txt Distributed SRMs University in UK (B) Organizations in Asia (C & D) National Lab in US (A) SRM SRM

  4. /home/arun.sdsc/cms /home/arun.sdsc/cms/text1.txt /home/arun.sdsc/cms/text2.txt /home/arun.sdsc/cms/text3.txt SRM SRM SRM SRM SRM SRM /…/text1.txt /…//text2.txt Global Logical Namespace Needed Logical Namespace: Organization of data, meta-data and storage (This logical view – need not be same as physical view of data sources ) University in UK (B) Organizations in Asia (C & D) National Lab in US (A) SRM SRM /txt3.txt

  5. SRM SRM SRM SRM SRM SRM /…/text1.txt /…//text2.txt Global Logical Namespace Needed If we use SRB for this Global Logical Namespace.. .. (next slides) University in UK (B) Organizations in Asia (C & D) National Lab in US (A) SRM SRM /txt3.txt

  6. SRM SRM SRM SRM SRM SRM /…/text1.txt /…//text2.txt Using Zone SRBs Global Logical Name space One or more SRB Zones in Asia SRB Zone for National Lab in US One SRB Zone for all UK universities SRM SRM /txt3.txt

  7. Possible Options for Zones • Each Organization is a Zone with multiple SRMs • One of more organizations make a Zone based on geography and administrative factors • Each country is a Zone

  8. A picture is worth a 1000 KB Second, Access

  9. Do we want XML/SOAP for control? Services (SOAP-based) to manage and operate on the logical namespace of data and storage resources. Of course, this is only for control channel and not data movement channel

  10. SRM SRM SRM SRM SRM SRM /…/text1.txt /…//text2.txt Access Option1: SRM still the interface SRM Global Logical Name space SRM SRM SRM One or more SRB Zones in Asia SRB Zone for National Lab in US One SRB Zone for all UK universities SRM SRM /txt3.txt

  11. Existing applications in SRM can be preserved HEP community already aware of SRM SRM will emerge as the Grid Storage Management standard in GGF (so useful for us to follow the standard thingy) SRM interface does not deal with a global logical namespace Additional functionalities to manage or take advantage of this global logical namespace would be lost Bulk operations are essential for data grid management Zone to Zone (Peer to peer) Meta data SRM is NOT the Grid File System standard at GGF Access Option1: SRM still the interface

  12. SRM SRM SRM SRM SRM SRM /…/text1.txt /…//text2.txt Access Option2: SRB as the interface SRB Global Logical Name space SRB SRB SRB One or more SRB Zones in Asia SRB Zone for National Lab in US One SRB Zone for all UK universities SRM SRM /txt3.txt

  13. Existing applications might have to be modified HEP community has to be educated about the use and advantages of SRB (community resistance also) Does it directly support storage space management NOW? SRB interface deals with a global logical namespace of logical resources and logical data Additional functionalities to manage or take advantage of this global logical namespace is available Bulk Operations are essential for data grid management Zone to Zone (Peer to peer) Metadata SRB could influence the Grid File System standards at GGF Access Option2: SRB as the interface

  14. SRM SRM SRM SRM SRM SRM /…/text1.txt /…//text2.txt Access Option3: GGF Grid File System Interface GFS Global Logical Name space GFS GFS GFS One or more SRB Zones in Asia SRB Zone for National Lab in US One SRB Zone for all UK universities SRM SRM /txt3.txt

  15. DOES NOT EXIST. We can NOT wait. Our limited cycles might be used in just working for the GGF standard – rather than making this interface for us to work What if we can not influence the standard creation (?) or its irrelevant for us It is going to be the standard. So would possibly end up having multiple implementations (commercial and academic) This community of different organizations and countries could influence the standard creation based on real needs Experts from other communities would also suggest / help in the design of this interface Access Option3: GGF GFS as the interface

More Related