1 / 8

Enhancing Collaborative Computing with VM Deployment and Gfarm Infrastructure across PRAGMA Sites

This document outlines key collaborative activities and resources for PRAGMA21, focusing on virtual machine (VM) deployment, Gfarm infrastructure, and supporting cluster environments. The initiative aims to enhance collaborative computing capabilities among institutions in 17 countries, featuring sites like IU, ASTI, Monash, Osaka, and Tsukuba. Major topics include the development of VM images, deployment automation using scripts, and real-world applications from institutions like AIST. Collaboration opportunities, testing, and next steps for VM deployments are also addressed to foster a more connected research environment.

rehan
Télécharger la présentation

Enhancing Collaborative Computing with VM Deployment and Gfarm Infrastructure across PRAGMA Sites

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PRAGMA20 – PRAGMA 21Collaborative Activities Resources Working Group

  2. Works by PRAGMA21 • VM issues • Supporting cluster environments • E.g. Condor (as a batch scheduler) + MPI • Expand three sites to more • IU, ASTI, Monash, Osaka, Tsukuba • TBC: LZU, MIMOS, USM, • Create their own VM images • Start with F-Motif and Bloss • VM repository to share VM images • Use Gfarm as back end • Deploy Gfarm at San Diego by the end of March • San Diego, AIST, Tsukuba • From prototyping to production • What is the real scenario? • Contribution by HKU • Live migration on PRAGMA? • Possible collaboration between HKU and AIST • Start Beginning of May • Start with HK, JP, US

  3. PRAGMA Grid/Clouds UZH Switzerland UZH Switzerland JLU China AIST OsakaU UTsukuba Japan CNIC China KISTI KMU Korea IndianaU USA SDSC USA LZU China LZU China ASGC NCHC Taiwan HKU HongKong UoHyd India ASTI Philippines NECTEC KU Thailand CeNAT-ITCR Costa Rica HCMUT HUT IOIT-Hanoi IOIT-HCM Vietnam UValle Colombia MIMOS USM Malaysia UChile Chile MU Australia BESTGrid New Zealand 26 institutions in 17 countries/regions,23 compute sites, 10VM sites

  4. Gfarm Development and deploymenthttp://goc.pragma-grid.net/mediawiki-1.16.2/index.php/Gfarm • Gfarm 2.4.2 to 2.5.1 (U. Tsukuba) • Major enhancement: GSI authentication http://datafarm.apgrid.org • Gfarm roll for Rocks 5.4 (SDSC) http://goc.pragma-grid.net/mediawiki-1.16.2/index.php/Gfarm_roll_user_guide • Gfarm deployed to 7 sites • SDSC (meta server, file system, client) • AIST (client) • NCHC, IU, LZU, OsakaU, CNIC (file system nodes, clients)

  5. VM Deployment Automationhttp://goc.pragma-grid.net/mediawiki-1.16.2/index.php/VM_deployment_script • VM-deploy scripts (SDSC, AIST) – see demo • Get VM image from gfarm • Modify VM image to fit local system • Do this by scripts • Start VM • Web-OS (NCHC) • Deploy VM via internet to physical non-VM systems • User account • Access to /srv/cloud

  6. Application VMs • AIST developed 3 timely and important applications • WMS Server: provide a simple HTTP interface for requesting geo-registered map images from one or more distributed geospatial databases • Hot Spot: find high-temperature, e.g. a forest fire, spot from satellite data • QuickQuake: generate ground motion map of earth quake

  7. Put all together VM images stored in Gfarm systems Deployment scripts Run at PRAGMA Sites Copy VM images on Demand from gFarm Modify/start VM instances at PRAGMA sites Jobs managed by Condor S S gFC gFC VM Image copied from gFarm VM Image copied from gFarm Condor Master gFS slave slave SDSC (USA) Rocks Xen AIST (Japan) OpenNebulaXen gFS GFARM Grid File System (Japan) S S gFC gFC AIST QuickQuake + Condor VM Image copied from gFarm VM Image copied from gFarm gFS NCHC Fmotif gFS gFS slave slave gFS UCSD Autodock + Condor NCHC (Taiwan) OpenNebula KVM IU (USA) Rocks Xen AIST Web Map Service + Condor AIST Geogrid + Bloss AIST HotSpot + Condor S S gFS gFC gFS gFC VM Image copied from gFarm VM Image copied from gFarm gFS gFS slave slave LZU (China) Rocks KVM S = VM deploy Script Osaka (Japan) Rocks Xen gFC = Grid Farm Client = Grid Farm Server gFS

  8. Breakouts • Breakout 1 • Test and confirm the demo • Breakout 2 • Discuss next steps

More Related