140 likes | 146 Vues
Coarse Grained Interoperability scenarios. SHIWA SA2 presented by Vladimir Korkhov, AMC. SHIWA Use Cases. Use case A: Running non-native workflows Use case B: Creating and running meta-workflows Use case C: Running workflows on multiple DCIs.
E N D
Coarse Grained Interoperability scenarios SHIWA SA2 presented by Vladimir Korkhov, AMC
SHIWA Use Cases • Use case A: Running non-native workflows • Use case B: Creating and running meta-workflows • Use case C: Running workflows on multiple DCIs Coarse grained interoperability (CGI): Use cases A and B SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
Coarse-grained interoperability • Nesting of different workflow systems to achieve interoperability of execution frameworks SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
CGI goals • Meta-workflow – combination of heterogeneous native and non-native workflows • Creating a meta-workflow by encapsulating nested workflows to: • Utilize resources from different DCIs together (thus get more resources) • Combine workflows described in different languages and running on different engines • Be able to reuse workflows as a component in meta-workflows SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
CGI challenges • Construction of a meta-workflow • combining heterogeneous workflows • description of meta-workflows • Executing heterogeneous workflows • Accessing multiple DCI resources • Data transfers between DCIs • Security and credentials handling between DCIs SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
Pilot applications • Neuroscience • Surface chemistry • Medical simulation • Bioinformatics SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
Scenario 1: DTI Atlas • Neuroscience, brain imaging • Magnetic Resonance Imaging (MRI) • Diffusion Tensor MRI (DTI) • MR-modality enabling the identification of the orientation of human tissue. • Indirect measure of water diffusion in brain tissue • used in comparative studies of brain diseases that are thought to cause local damage to brain tissue • DTI Atlas:single average tensor field is computed for a group of subjects, which can then be used for further analysis. • CGI scenario: • Combine a pipeline workflow of sub-workflows performing separate analysis steps • re-use existing workflows SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
DTI Atlas implementation Co-registration MOTEUR/Dutch Grid Warping MOTEUR/Dutch Grid Fitting MOTEUR/Dutch Grid SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
Scenario 2: FSL BedpostX • Neuroscience, brain imaging • FMRIB Software Library (FSL) • BedpostX • Diffusion Tensor Imaging (DTI) • Magnetic Resonance Imaging (MRI). • reconstructs the fibers in each voxel using an advanced method that supports crossing fibers • CGI scenario: • Run on different DCIs in parallel to get more resources • Use implementations of the same workflow supported by different WF engines on different DCIs SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
FSL-BedpostX MOTEUR/Dutch Grid GWES/D-Grid FSL-BedpostX FSL BedpostX implementation SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
Scenario 3: GATE • Medical simulation • GATE • simulation software developed by the OpenGate Collaboration • http://opengatecollaboration.healthgrid.org • used here for radio- and hadrontherapy simulations, but it can also simulate image acquisition, e.g., Positron Emission Tomography. • CGI scenario: • Integrating heterogeneous workflows into the native workflow to achieve better performance by accessing different DCIs via workflow engines. SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
GATE implementation MOTEUR/EGI MOTEUR/EGI GWES/D-Grid SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
Execution on SSP • SSP – SHIWA Simulation Platform • SSP provides the means to: • Compose meta-workflows • Enact meta-workflows • Monitor meta-workflows execution • Retrieve results of the execution SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011
Discussion • Construction of meta-workflows • Execution of meta-workflows • Multiple DCIs: access and execution • data transfers between DCIs, • multi-grid credential management • software dependencies • merge sub-workflows output results SHIWA CGI scenarios, Vladimir Korkhov, 11.04.2011