1 / 6

USQCD regional grid

The report discusses the growing demand for grid file transfers among US facilities, focusing on the increasing usage of gauge configurations stored in the ILDG (International Lattice Data Grid) format at Fermilab. It highlights that the Fermilab repository contains over 26,200 configurations available to members of the ILDG and LQCD. Collaborations with Argonne LCF and Open Science Grid aim to improve file transfer capabilities. The report outlines the metadata catalog and file catalog at JLab, emphasizing the need for an improved gauge archive format and user interface for enhanced accessibility and functionality.

jaunie
Télécharger la présentation

USQCD regional grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Report to ILDG 14 USQCD regional grid

  2. ILDG14, June 5, 2009 US Grid Usage Growing usage of gauge configurations in ILDG file format. Fermilab repository contains 26,200 configurations in ILDG format (total MILC and anisotropic clover). Ensembles accessible to members of the “ILDG” VO (read only) and the “LQCD” VO (read/write). Many consumers of the US lattices have accounts at Fermilab and access configurations by means other than SRM/grid-ftp. Demand is growing for grid file transfers among US facilities. Working with developers at Argonne LCF (Blue Genes) and Open Science Grid to enable grid file transfers.

  3. US infrastructure • ILDG Metadata catalog located at JLab • File catalog also at JLab • Simple mapping of LFNs to transfer URLs • DB will be needed to manage replicas • Single storage element is one of the Fermilab tape robots. • ILDG portal http://usqcd.jlab.org/mdc-web-client/index.jsp • Info page http://www.usqcd.org/ildg/

  4. US ILDG Status http://www.sapac.edu.au/inca/index.jsp

  5. Gauge Connection • Web portal to share gauge configurations (MILC initially) • Gauge archive format predating ILDG. • Managed by Jim Hetrick (MILC). • Hosted by NERSC. • NERSC has proposed modernizing the GC in order to create a “Science Gateway” useful to scientists doing HPC computing. • http://www.nersc.gov/nusers/services/Grid/SG/sg.php

  6. Gauge Connection Upgrade • NERSC developers working with Jim Hetrick to gather requirements. • New user interface • Dynamic html content + RDBMS. • Add upload and downloads via grid tools. • ILDG presence • Storage element • File catalog replication / ILDG search • Replication of files stored elsewhere

More Related