1 / 23

QCloud

QCloud. Queensland Cloud Data Storage and Services 27Mar2012. NATIONAL RDSI. 6 primary, 4 additional nodes 150-200 PB by 2014 100Gb/sec node interconnect Storage for large national collections Shared access by research communities Research data management On-shore data cloud

kalkin
Télécharger la présentation

QCloud

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. QCloud Queensland Cloud Data Storage and Services 27Mar2012 QCloud

  2. NATIONAL RDSI • 6 primary, 4 additional nodes • 150-200 PB by 2014 • 100Gb/sec node interconnect • Storage for large national collections • Shared access by research communities • Research data management • On-shore data cloud • Low-cost research production quality of service QCloud

  3. NATIONAL NeCTAR RESEARCH CLOUD • 6 primary nodes (maybe 7) • 24,000 cores by 2013 • On-demand compute capacity for research • Hosted shared services for research communities • Virtual laboratories • Research tools, workflows Uni of Melbourne QCIF/UQ ANU MonashUni QCloud

  4. QCLOUD COMPONENTS NeCTAR RESEARCH CLOUD RDSI DATASTORE >15x QERN CLOUD 5x GENOMICS CLOUD QCloud

  5. QUEENSLAND RDSI NODES • ~ 30 Petabytes by 2014 • Primary node hosted at UQ (embargoed) • Additional Node at JCU (awaiting decision) • National focus: ecosystems, genomics 75% Merit Allocated Collections 25% “CollectionDevelopment” Can add RDSI+ commercial research storage QCloud

  6. COLLECTIONS Market Data Collections Active research projects Collaborations across multiple locations Fast disk, flash memory – immediate access Vault Data Collections Rarely accessed data archival storage Broad availability Tape, slow disk QCloud

  7. RDSI NODE SERVICES OWNER Qualification Capture Ingest Bulk Update Curation Metadata (with ANDS) Resilience (multiple copies) Management Entitlements to Access Monitoring Support, Help Desk, Training USER Entitlements to Access Discovery Read Update Duplicate Monitoring Support, Help Desk, Training RESEARCH COMMUNITY QCloud

  8. TARGET RESEARCH USERS/SERVICES POWER USERS PB-scale data collections Low-level access services Specialised treatment DATA COLLECTION SIZE LARGE DATA USERS TB-scale data collections Direct data access, FTP Automated allocations LONG-TAIL USERS GB-scale data collections Cloud access Dropbox style on PC Little allocation surveillance NUMBER OF USERS QCloud

  9. QCIF/UQ NeCTAR NODE • 4,000 cores, up to 4,000 virtual machines • Research service quaility • 70% for NeCTAR Allocated Services • 30% for Queensland Allocation QCloud

  10. SERVICES COMPUTATION On-demand virtual machines Off-load “small” jobs from HPC/clusters HOSTED SERVICES Permanent web sites Research communities Virtual laboratories Research tools Collaboration QCloud

  11. COMPUTE USERS/SERVICES Tier 1,2,3 HPC More than 16 cores Specialised treatment NUMBER OF CORES REQUIRED MEDIUM COMPUTE USERS 4-16 cores Large memory VMs (1TB+) Automated allocations Smaller HPC jobs LONG-TAIL USERS HOSTED SERVICES 1-4 cores Small HPC jobs NUMBER OF USERS QCloud

  12. EARLY NODE (QERN) • pQERN • Operational October 2011 • Pre-RDSI/NeCTAR • Genomics++ • QERN • Delivered February • Operational ~April • 330 cores • 0.5 PB disk • RDSI/NeCTAR services • Early adopter researchers • Operational experience QCloud

  13. PROJECTED NODE SCALE-UP PB 30 20 10 0 Cores 4000 3000 2000 1000 0 NeCTAR Research Cloud RDSI Data Storage Today, QERN 2011 2012 2013 2014 QCloud

  14. PARTICIPANT ROLES NeCTARLead Agent RDSI Lead Agent Collection & Service Owners & Users QCIF Governance, Management, Research Support JCUManagement, Operations UQ RCCManagement, SysAdmin PartnersResearch Support UQ ITSAcquisition, Operations QCloud

  15. QCloud

  16. QERN Progress Mid Feb QCloud

  17. QCLOUD PARTNERS • QCIF • UQ • JCU • CQU • Griffith • QUT • USQ • USC • Bond • CSIRO • NICTA • TERN • DERM • DTMR • DEEDI • Ergon Energy QCloud

  18. FUNDING FOR QCLOUD QCloud

  19. Agreements Progress QCloud

  20. RISK MANAGEMENT – QCIF • Power upgrade at UQ DC2 (JCU also?) • Decision deferred to May • Transfer to new UQ data centre • PACE building offer replacing DC2 – network • Staff and skills availability • Software and skills maturity • Authentication, entitlements QCloud

  21. RISK MANAGEMENT – NATIONAL • Levels of interaction: Lead Agents, other nodes • National support and help desk structure • RDSI ReDS and DaSh Programs QCloud

  22. RISK MANAGEMENT – LONG TERM • RDSI value proposition to researchers • Growth past 2014 • Business model for sustainability • Commercial service quality QCloud

  23. QUESTIONS? QCloud

More Related