1 / 7

Personal Cloud Controller: Efficient Cluster Management Tool

The Personal Cloud Controller (PCC) enables easy management of virtual clusters, leveraging PRAGMA Cloud tools and HTCondor. It offers lightweight interfaces and aims to enhance control and robustness. Future plans include data-aware scheduling and fault tolerance.

mai
Télécharger la présentation

Personal Cloud Controller: Efficient Cluster Management Tool

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Personal Cloud Controller (PCC) Yuan Luo1, ShavaSmallen2, Beth Plale1, Philip Papadopoulos2 1School of Informatics and Computing, Indiana University Bloomington 2San Diego Supercomputer Center, University of California San Diego

  2. Overview • Goals: • Enable lab/group to easily manage application virtual clusters on available resources • Leverage PRAGMA Cloud tools: pragma_bootstrap, IPOP, ViNE. • Lightweight, extends HTCondorfrom U Wisc. • Provide command-line and Web interfaces • Working Group: Resources

  3. PCC Enabled PRAGMA Cloud PCC-HTCondor Master Cluster D Cluster A Cluster Master Node Unclaimed Resource Cluster C Cluster B Allocated Resource Physical Network Virtual Network The PRAGMA Cloud Provenance Collecting Path

  4. Central Manager PCC-HTCondor Architecture Startd Negotiator Collector Schedd … Machine 1 (submit) Machine N (execute) Startd Startd Schedd Schedd Shadow Starter VM GAHP Communication Path Process Invoke PRAGMA Cloud tools (pragma_boot)

  5. PCC-HTCondor Job Submission Sample PCC-HTCondorsubmission script .vmconffile in the rocks job directory

  6. Status and Future Plans • Initial prototype implemented • Start and monitor virtual cluster using pragma_bootstrap via HTCondor (VM GAHP) • Web interface prototype (PHP) • Near-term goals • Add increased controllability and robustness (April – June) • Multi-site clusters (July – Sept) • Longer-term goals • Data-aware scheduling • Fault tolerance • Provenance Personal Cloud Controller Web Interface PCC-HTCondor PRAGMA tools (pragma_boot, ViNE, iPOP) Rocks OpenNebula …

  7. PCC Demo Overview and Setup • View PCC Web interface • Fully launched “lifemapper” 8-core virtual cluster • Just launched “dock6” 4-core virtual cluster • View Condor pieces • Submit scripts • condor_status • condor_q nbcr-224.ucsd.edu vm-container-0-0 vm-container-0-1 vm-container-0-2 • nbcr-224.ucsd.edu • 4 x Dell PowerEdge SC1435 • 2 x Dual-Core 2.4 GHz AMD Opteron • 8 GB Memory • 250 GB Disk • Rocks 6.1 with KVM roll • Condor 8.0.6 • Pragma_bootstrap + 3 public IPs • PCC + web frontend

More Related