1 / 18

“The Pacific Research Platform Two Years In”

“The Pacific Research Platform Two Years In”. Welcome and Overview Talk to the Pacific Research Platform “ PRPv2” Workshop 2017 University of California, San Diego February 21, 2017. Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology

ruhl
Télécharger la présentation

“The Pacific Research Platform Two Years In”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “The Pacific Research PlatformTwo Years In” Welcome and Overview Talk to the Pacific Research Platform “PRPv2” Workshop 2017 University of California, San Diego February 21, 2017 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD http://lsmarr.calit2.net

  2. Initially Proposed PRP Multi-Campus Science Driver Teams • Biomedical • Cancer Genomics Hub/Browser( UCSC/SDSC project over, connecting PRP to U. Chicago) • Microbiome and Integrative ‘Omics (UCSD, Caltech, UCSF, UCD) • Integrative Structural Biology (UCSF, NERSC, SDSC) • Earth Sciences • Data Analysis and Simulation for Earthquakes and Natural Disasters (Phase II) • Climate Modeling: NCAR/UCAR (UCSD, NCAR) • California/Nevada Regional Climate Data Analysis (UCI, UCSD, NCAR) • CO2 Subsurface Modeling (SDSC) • Particle Physics (UCD, UCI, UCSC, UCSD, others soon) • Astronomy and Astrophysics • Telescope Surveys (NERSC connected to PRP) (Phase II) • Galaxy Evolution (UCI, UCSC) (Phase II) • Gravitational Wave Astronomy (Caltech, UCSD) • Scalable Visualization, Virtual Reality, and Ultra-Res Video (UCB, UCLA, UCM, UCSD)

  3. 100 Gbps FIONA at UCSC Connects the UCSC Hyades Cluster to the NERSC Supercomputer at LBNL Shawfeng Dong, UCSC Cyberengineer 250 images per night 800GB per night Supporting UCSC Remote Access to Large Data Subsets of the Dark Energy Spectroscopic Instrument (DESI) and AGORA Galaxy Simulation Data Produced at NERSC. UCSC Feb 7, 2017

  4. Global Scientific Instruments Will Produce Ultralarge Datasets Continuously Requiring Dedicated Optic Fiber and Supercomputers Square Kilometer Array Large Synoptic Survey Telescope Tracks ~40B Objects, Creates 10M Alerts/Night Within 1 Minute of Observing 2x40Gb/s https://tnc15.terena.org/getfile/1939 www.lsst.org/sites/default/files/documents/DM%20Introduction%20-%20Kantor.pdf https://tnc15.terena.org/getfile/1939

  5. PRP Will Enable Distributed Virtual Reality PRP 20x40G PRP-connected 40G FIONAs WAVE@UC San Diego MerWAVE @UC Merced

  6. UC Merced’s VR CAVE: Merced WAVE • Transferring 5 CAVECam Images Over 10 Gbit/sec Fiber Path From UCSD to UC Merced: • Total Data Size: 1.96 GBytes • Transfer Took 2.17 seconds • Transfer Rate: 924.49 MBytes/sec (~8Gbit/sec) • This Transfer Would Have Taken: • 21 Seconds Over 1Gbit/sec Connection (Regular Ethernet) • 5.35 Minutes Over 50Mbit/sec Connection (Residential Internet)

  7. PRP Will Link the Laboratories of the Pacific Earthquake Engineering Research Center http://peer.berkeley.edu/

  8. The Second FIONette was Deployed at the PEER Facility at UC Berkeley, and its Performance is Being Monitored John Graham Installing FIONette at PEER Feb 10, 2017

  9. Cancer Genomics Hub (UCSC) is Housed in SDSC:Large Data Flows to End Users at UCSC, UCB, UCSF, … 1G 8G 30,000 TB Per Year Data Source: David Haussler, Brad Smith, UCSC Jan 2016 15G

  10. Slide on Cancer Genomics

  11. Newly Added PRP Multi-Campus Science Driver Teams • Biomedical • Cryo Electronic Microscopy (UCB/LLNL, UCD,UCLA, UCSD, UCSF) • Bioinformatics (UCD) • High-Resolution Microscopy (UCR, UCSD, NSCC) • Computer Science and Engineering /Electrical and Computer Engineering, etc. • JupyterHub (UCB, UCSD) • Deep Learning (UCB, UCSD, UIC) • Drones, Terrestrial Modeling/GIS (UCSD, UCM) • Contextual Robotics (new) • High Performance Wireless Research and Education Networks • UCSD/SIO, UCI, UCR, UCM, CENIC, others tbd. • Humanities and Social Sciences • Preserving Cultural Heritage

  12. PRP First Application: Distributed IPython/Jupyter Notebooks:Cross-Platform, Browser-Based Application Interleaves Code, Text, & Images IScilab IMatlab ICSharp Bash Clojure Kernel Hy Kernel Redis Kernel jove, a kernel for io.js IJavascript Calysto Scheme Calysto Processing idl_kernel Mochi Kernel Lua (used in Splash) Spark Kernel Skulpt Python Kernel MetaKernel Bash MetaKernel Python Brython Kernel IVisual VPython Kernel • IJulia • IHaskell • IFSharp • IRuby • IGo • IScala • IMathics • Ialdor • LuaJIT/Torch • Lua Kernel • IRKernel (for the R language) • IErlang • IOCaml • IForth • IPerl • IPerl6 • Ioctave • Calico Project • kernels implemented in Mono, including Java, IronPython, Boo, Logo, BASIC, and many others Source: John Graham, QI

  13. PRP UC-JupyterHub Backbone UCB Next Step: Deploy Across PRP UCSD Source: John Graham, Calit2 GPU JupyterHub: 2 x 14-core CPUs 256GB RAM 1.2TB FLASH 3.8TB SSD Nvidia K80 GPU Dual 40GbE NICs And a Trusted Platform Module GPU JupyterHub: 1 x 18-core CPUs 128GB RAM 3.8TB SSD Nvidia K80 GPU Dual 40GbE NICs And a Trusted Platform Module 40Gbps

  14. Cryo-electron Microscopy (cryo-EM) Has Driven a “Resolution Revolution” in the Last Five Years Exposure (every 60 seconds): Every 24 hours: Typical datasets: Each Cryo-EM ‘Image’ is Actually a Movie Number of movies: ~1400 Length of time: 2 - 6 days X & Y dimensions: 7420 x 7676 pixels Total size: 10 - 30 TB Data size: ~5 TB Frames per movie: 10 - 50 Size: 3 - 10 GB per movie Source: Michael A. Cianfrocco, Elizabeth Villa, & Andres Leschziner, UCSD

  15. NERSC Using PRP to Connect Cryo-EM across CaliforniaWith End Users and Computational Facilities * * Xstream • Short term: • Provide 2D and 3D analysis on particle stacks on Comet at SDSC • Long term: • Partner with cryo-EM facilities to stream data straight from microscopes (overPRP) to SDSC • Perform all cryo-EM analysis (from micrographs to 3D models) via web browser on SDSC • Expand computing to other XSEDE resources (e.g. Xstream) SF Bay UC Davis UC Santa Cruz San Diego UCLA cosmic-cryoem.org * UC Berkeley, LBNL, UCSF, Stanford SDSC ~20 microscopes in CA UCSD, TSRI, Salk 3 supercomputer centers Source: Michael A. Cianfrocco, UCSD

  16. PRP is NOT Just for Big Data Science and Engineering:Linking Cultural Heritage and Archaeology Datasets UW/ PNWGP Seattle UCD Building on CENIC’s Expansion To Libraries, Museums, and Cultural Sites Internet2 Seattle Berkeley Esnet DoE Labs UCSF “In an ideal world –Extremely high bandwidth to move large cultural heritage datasets around the PRP cloud for processing & viewing in CAVEs around PRP with Unlimited Storage for permanent archiving.” -Tom Levy, UCSD Stanford UCM NASA AMES/ NREN Internet2 UCSC * Institutions with Active Archaeology Programs UCR UCSB Note: This diagram represents a subset of sites and connections. Los Nettos Caltech USC UCLA SDSU UCSD UCI

  17. Linking Libraries at UCB, UCLA, UCM and UCSD with CAVE Kiosks 24 Megapixel UCM Library Installation, July 48 Megapixel CAVE Kiosk for UCSD Library UCSD Library Review, June

  18. PRP Backbone Sets Stage for 2017 Expansion of HPWREN, Connected to CENIC, into Orange and Riverside Counties • PRP CENIC 100G Link UCSD to SDSU • DTN FIONAs Endpoints • Data Redundancy • Disaster Recovery • High Availability • Network Redundancy • Anchor to CENIC at UCI • PRP FIONA Connects toCalREN-HPR Network • Data Replication Site • Potential Future UCR CENIC Anchor UCR UCI UCSD SDSU Source: Frank Vernon, Greg Hidley, UCSD

More Related