1 / 5

Group 2 report

Group 2 report. Access Optimizations to Distributed Data. SDM kickoff meeting July 10-11, 2001. Task : Grid I/O. Goal: Provide a NEW capability Provide PVFS under Grid FTP Coordinated with Globus group (ANL) Requires Globus source will be modified to work with PVFS

ghannah
Télécharger la présentation

Group 2 report

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Group 2 report Access Optimizations to Distributed Data SDM kickoff meeting July 10-11, 2001 choudhar@ece.nwu.edu 1

  2. Task : Grid I/O • Goal: Provide a NEW capability • Provide PVFS under Grid FTP • Coordinated with Globus group (ANL) • Requires • Globus source will be modified to work with PVFS • PVFS extensions to be incorporated to optimize same node access (fast path access to PVFS stripes) • Schedule • Depends on two groups (Globus priorities) • One year • Evaluation: • Local fast path (PVFS) • Across network and interface • Action Item: Bill will coordinate with Globus to determine use in Globus application (e.g., GRYPHIN) choudhar@ece.nwu.edu 2

  3. Grid I/O : Plans • MPI-IO front-end for the grid • Selecting the right grid toolkit component • Evaluate the capabilities of current MPI-IO hints mechanism under different scenarios (e.g., QoS) • Extend and develop new hints (and mechanisms, if necessary) to enable Grid optimizations • Schedule • Year 2 and 3. choudhar@ece.nwu.edu 3

  4. High-Dimensional Indexing Techniques • Goal: Reduce the amount of data needed to be transferred • First Year: • Add string valued attribute oriented access capability • On-line update: Add new data without interrupting request processing • Desired by STAR application • People Involved • John Wu (LBNL) • Integrate with Area 1 • Contacts: Pursue Astrophysics and Climate Applications choudhar@ece.nwu.edu 4

  5. High-Dimensional Indexing • Year 2 and 3 plans • Investigate further reduction in data movement across Grid • Investigate the use of MPI-IO capability to extract event level data • Q. How do we translate event requests into MPI datatype requests? …. choudhar@ece.nwu.edu 5

More Related