1 / 6

Enhancing Scientific Exploration through Cloud and Cyberinfrastructure Integration

This session discusses the integration of cloud computing with traditional cyberinfrastructure (CI) for scientific discovery. It explores meaningful application formulations and usage modes within a hybrid infrastructure and examines how application workflows can effectively utilize cloud resources. Key topics include managing complexity, democratization of resources, and the potential of cloud-based abstractions for scientific applications. Challenges such as cost-effectiveness and the limitations of cloud performance in high-performance computing (HPC) contexts are also addressed, alongside future opportunities and technical challenges from user perspectives.

zanta
Télécharger la présentation

Enhancing Scientific Exploration through Cloud and Cyberinfrastructure Integration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Integrating Cloud & Cyberinfrastructure Manish Parashar NSF Cloud and Autonomic Computing Center Rutgers, The State University of New Jersey

  2. Clouds and Science • Clouds are rapidly joining traditional CI as viable platforms for scientific exploration and discovery • What application formulations and usage modes that are meaningful in such a hybrid infrastructure? • How can application workflows effectively utilize it? • Possible usage modes: • Managing complexity by outsourcing the mundane • Democratization • Application driven by the science, not available resources! • Cloud abstractions for science (beyond IaaS/PaaS/SaaS)? • Many challenges • Application types and capabilities that can be supported by clouds? • Can the addition of clouds enable scientific applications and usage modes that are not possible otherwise? • What abstractions and systems are essential to support these advanced applications on different hybrid platforms?

  3. HPC in the Cloud • Run applications on commodity clouds (e.g.,EC2) • Quick start-up, easy to use • Good performance for specific application classes • However not suited for many applications • And costs can add up quickly…… • For example, at NERSC* • Baseline Cloud is 8x more expensive • Effective performance of the cloud is a minimum of 16x less cost effective (and worst case 320x less effective) for DOE midrange HPC workloads * HPC in the Clouds, John Shalf Feb 3, 2011

  4. CS&E on the Cloud – Moving beyond the obvious candidates • New application formulations • Asynchronous, resilient, elastic • E.g., Asynchronous Replica Exchange Molecular Dynamics, Asynchronous Iterations • New delivery models • Client + Cloud accelerators, HPC-as-a-Cloud • E.g., Matlab/Excel + EC2 • New hybrid usage modes • Cloud + HPC + Grid + …

  5. Integrating Cloud & CI • HPC in the Cloud, where researchers outsource entire applications to current public and/or private Cloud platforms. • HPC plus Cloud, focused on exploring scenarios where Clouds can complement HPC/Grid resources with Cloud services to support science and engineering application workflows, for example, to support heterogeneous requirements, unexpected spikes in demand, etc. • HPC as a Cloud, focused on exposing HPC/Grid resources using elastic on-demand Cloud abstractions, aiming to combine the flexibility of Cloud models with the performance of HPC systems.

  6. Integrating Cloud & CI • Overview of the session • Opening/context – Manish Parashar, Rutgers • XSEDE perspective - John Towns, NCSA  • FutureGrid perceptive - Geoffrey Fox, Indiana Univ. • OCC perceptive - Robert Grossman, Univ. of Chicago • Magellan experiences - Shane Canon, LBNL • GENI perspective - Chip Elliott, BBN   • Key questions • What are the new opportunities that will be provided by integrating Cloud and Cyberinfrastructure? • What would be the key challenges, technical as well as from a users perspective? • What are immediate next steps, for agencies and for the community? 

More Related