1 / 7

WLCG Storage and Data Management Jamboree Summary

The WLCG Storage and Data Management Jamboree summary outlines critical needs for improving data management in high-energy physics analysis. Emphasizing the importance of integration with existing experiments, the event captured discussions on utilizing networks over tape storage and the scalability of data solutions in line with Moore’s law. It advocates for pre-distributing data and fetching it as required, while addressing the need for standardized transfer protocols. The session also explored metrics for measuring outcomes and demonstrated practical implementations at WLCG.

makan
Télécharger la présentation

WLCG Storage and Data Management Jamboree Summary

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WLCG Storage and Data Management Jamboree Summary • Jens Jensen • OGF29, Chicago • June 2010

  2. Executive Summary • WLCG: Need for improving data management for analysis • Inviting demonstrators • MUST work with existing experiment • Demonstrate by WLCG @ IC

  3. Input • Strawman • Use networks rather than tape • Networking better than MONARC • Also scales with Moore’s law • “More money for networking” • Tape as dark archive • Streaming video “solved” • But HEP is != streaming video

  4. Data management • Make data available for analysis • Pre-distribute • Fetch when required • Transfers • Restart failed transfers

  5. xroot • Not standardised • “Changes backward compatible” • 1.5 implementations

  6. Metrics • Normally measure CPU • … what are the appropriate metrics?

  7. “Outcome” • Demonstrate at WLCG at IC • … detailed look at notes

More Related