1 / 15

Grid Workflow within Triana

Grid Workflow within Triana. Ian Wang Cardiff University. E.U. Funded 9 Institutions German (x2), Poland, Hungry, Czech, Holland, Greece, Italy, U.K. 13 Work-Packages GAT Resource Broker (GRMS) Data Management Portal (GridSphere) Monitoring (Mercury) Adaptive Components

onaona
Télécharger la présentation

Grid Workflow within Triana

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid Workflow within Triana Ian Wang Cardiff University

  2. E.U. Funded 9 Institutions German (x2), Poland, Hungry, Czech, Holland, Greece, Italy, U.K. 13 Work-Packages GAT Resource Broker (GRMS) Data Management Portal (GridSphere) Monitoring (Mercury) Adaptive Components Information Services (iGrid) … GridLab

  3. GridLab GAT • Application-level API • Abstract ‘Common’ Capabilities required by Grid Applications • Resource Discovery • Job Submission • File Transfer • Capabilities extracted through a number of Grid Application Scenarios. • Makes life as a Grid programmer easier … • Motivation for the GGF SAGA research group (Simple API for Grid Applications)

  4. GAT Architecture Application (e.g. Triana) GridLab GAT API Resource Broker File GRMS GRAM Local File Service GridFTP HTTP Local Adaptors Services GRMS GRAM Grid FTP HTTP File Transfer iGrid Mercury

  5. Using the GAT GATContext context = new GATContext(); Preferences prefs = new Preferences(); prefs.put("ResourceBroker.adaptor.name", "grms"); URI exe = new URI("file:////bin/hostname"); File outFile = GAT.createFile(context, prefs, new URI("file:///out") SoftwareDescription sd = new SoftwareDescription(); sd.setLocation(exe); sd.setStdout(outFile); ResourceDescription rd = new HardwareResourceDescription(); rd.put("hostname", "bouscat.cs.cf.ac.uk"); JobDescription jd = new JobDescription(sd, rd); ResourceBroker broker = GAT.createResourceBroker(context, prefs); Job job = broker.submitJob(jd);

  6. Visual GAT • GAT Primitives represented as Workflow Objects • Job Tasks • File Tasks • Grid Data Flow implicit in Workflow Connections • File Task -> File Task = Data Transfer • File Task -> Job Task = Pre-Stage File • File Task -> Local Task = File Read • Grid Operations handled by GAT Adaptors • Grid File -> Grid File = GridFTP • HTTP File -> Local Task = HTTP • Grid File -> GRMS Job = GRMS Pre-Stage

  7. Grid Workflow in Triana File Write File (Local/Remote) Pre-Stage Job (Local/Remote) Post-Stage Temporary File File Read Local Java Unit

  8. Visual GAT Alternative • Grid Operations Expressed Explicitly • GridFTP Tasks • File Write Tasks • File Read Tasks • Not Intuitive • Not Future Proof

  9. GridLab GAT File CPI Resource Broker CPI HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor File Input (HTTP) Triana WaveToy.par www. gridlab. org

  10. File Staging (GridFTP) Triana GridLab GAT File CPI Resource Broker CPI HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor WaveToy.par www. gridlab. org Testbed

  11. Job Submission 1 Triana GridLab GAT File CPI Resource Broker CPI HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor GAS GRMS Cactus www. gridlab. org Testbed Data Mvment Testbed WaveToy.par Delphoi Mercury iGrid

  12. Job Submission 2 Triana GridLab GAT File CPI Resource Broker CPI Instant Mess HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor Portal GAS GRMS Cactus www. gridlab. org Testbed Data Mvment Testbed Delphoi Mercury iGrid

  13. Job Submission (GRAM) Triana GridLab GAT File CPI Resource Broker CPI Instant Mess HTTP Adaptor GridFTP Adaptor Data Movement Local Adaptor GRMS Adaptor GRAM Adaptor Local Adaptor Portal GRAM Cactus www. gridlab. org Testbed Testbed

  14. WSPeer User Interface Web Service GridMonSteer Resource Broker (e.g. GRMS) Grid Side submit run User Side Application (e.g. Triana) GridMonSteer (gms) gms http://www.xyx.org:4802/axis/gms cactus monitor cactus phi_xy.jpg phi_yz.jpg phi_xy.jpg phi_yz.jpg rundir http://www.xyz.org/axis/gms invoke using SOAP

  15. Triana Grid Workflow Summary • GridLab GAT • Application-level API • Abstracts Common Capabilities required by Grid Applications such as Triana • Visual GAT • GAT Primitives represented in Triana as Workflow Objects • Grid Data Flow implicit in Workflow Connections • GridMonSteer • Generic Architecture for Monitoring and Steering Legacy Applications

More Related