1 / 9

PRAGMA 25 Working Group Updates Resources Working Group

PRAGMA 25 Working Group Updates Resources Working Group. Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD ). Most slides by courtesy of Peter, Nadya , Luca, and Pongsakorn. Past, Current, and Future of Resources WG. Phase 1 Succeeded in manual port (sharing) of VM images. 2008. 2009. 2010.

aitana
Télécharger la présentation

PRAGMA 25 Working Group Updates Resources Working Group

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PRAGMA 25Working Group UpdatesResources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and Pongsakorn

  2. Past, Current, and Future of Resources WG Phase 1 Succeeded in manual port (sharing) of VM images 2008 2009 2010 2011 PRAGMA16 GT & VOMS PRAGMA 18 Experiments on Rocks + Xen roll Phase 2 Automation of the deployment Use Gfarm for sharing VM images PRAGMA17 Panel on Grid to Cloud PRAGMA 19 ExtendingVM sites 2012 2013 2014 2015 Routine Use of Network Overlay CI for Scientists Sustained infrastructure SDN (OpenFlow, ViNE) Start using github Network Overlay ViNE, IPOP Phase 3 Expanding sites Prototyped VC deployments Phase 4 VC Sharing automation w/ apps Lifemapper, Docking Simulation

  3. Resources in PRAGMA 25 at a glance

  4. Summary of the 2nd day Discussion@ PRAGMA24 Scenario: Three different labs want to share computing and data What are the resources (data, computing) How do they author their software structure (VM/VC) to do what they need (e.g. LifeMapper Compute Nodes) How do they provide network privacy How do they control their distributed infrastructure Main contributors: Nadya (UCSD), Aimee(KU), Quan (IU) See the demo today!!

  5. PRAGMA experiment with Virtual Clusters and metadata capture Overflowjobs are sent to Virtual Cluster Lifemapper user portal Provenance Data captured on VC, sent to Karma Lifemapper job Results sent to KU Submit species modeling and distribution experiment 1 2 View experiment provenance 4 Karma provenance repository and analysis 3a Lifemapper virtual cluster on PRAGMA cloud 3b

  6. Summary of VC Sharing Discussion@ PRAGMA 24 • Demonstrated booting VC images on two cloud hosting environments. • Rocks/KVM by SDSC • OpenNebula/KVM by AIST • Next steps • Review the design of the scripts and re-implement by python. • Do this in San Diego in July (SDSC, AIST, NCHC). • Detailed schedule TBD. • Anybody interested in is welcome to join. • SDN integration with VC (NAIST/Osaka) Done in Sep. and Oct. Main contributors: Luca (UCSD) & Built (KU->NAIST) See demo tomorrow!!

  7. Rocks Implementation Compute Image Virtual Cluster Image 1 Format conversion (e.gXen->KVM or raw qCOW) Frontend Image.gz Compute Image.gz injection Frontend Image vc-in.xml 2 Assign local resources for guest cluster (network, hosts, disks, etc) boot allocate vc-out.xml Frontend Image Compute Image Compute Image Compute Image 3 Turn on Virtual Cluster

  8. OpenNebula Implementation Virtual Cluster Image allocate Frontend Image.gz Compute Image.gz 1 Inject vc-out.xml generation script vc-in.xml 2 Translate configurations to OpenNebula format Configurations Frontend Image Compute Image 3 Instantiate Virtual Cluster OpenNebula Frontend Image Compute Image Compute Image Compute Image

  9. Agenda of breakouts • Thursday 14:00-16:15 • Discussion: VC sharing • Detailed demo by Luca and Built • Discussion for improvements and next steps based on insights gained through the demonstration • Friday 11:10-12:30 • Discussion: CI for Scientists • Detailed demo by Nadya, Aimee, and Quan • Overlay network demo by Renato • Discussion for improvements and next steps based on insights gained through the demonstration • Friday 14:00-15:30 • Discussion: What services should PRAGMA provide? • How users use PRAGMA Cloud? • What persistent infrastructure should PRAGMA provide / use? • Github, Gfarm, Marketplace • What kind of services (data, computing, etc.) are available?

More Related