1 / 28

A Technical Overview

A Technical Overview. Bill Branan DuraCloud Technical Lead. Agenda. Introduction Storage Services Reporting UI Security Tools Roadmap. Introduction. DuraCloud is: Hosted service Runs on cloud-based compute systems Connects to cloud-based storage systems

zeheb
Télécharger la présentation

A Technical Overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Technical Overview Bill Branan DuraCloud Technical Lead

  2. Agenda • Introduction • Storage • Services • Reporting • UI • Security • Tools • Roadmap

  3. Introduction • DuraCloud is: • Hosted service • Runs on cloud-based compute systems • Connects to cloud-based storage systems • Provides a service platform • Open source software suite • Webinar Focus: • Components of software platform • Interacting with hosted DuraCloud

  4. DuraCloud in Context User Data Center Data Repository File System • DuraCloud • Management Console • Account Management • Instance Management

  5. DuraCloud Storage Administrative User Interface (DurAdmin) Service Management (DuraService) Storage Management (DuraStore) Report Management (DuraReport) REST API REST API REST API Service Container DuraCloud Instance

  6. DuraCloud Storage User Data Center Amazon S3 Amazon Storage Adapter Storage Provider Interface REST API Rackspace Cloud Files Rackspace Storage Adapter Storage Mediation Microsoft Azure Storage Azure Storage Adapter SDSC Cloud Storage SDSC Storage Adapter Storage Management (DuraStore)

  7. Storage REST Interface Content Actions • Add Content • Get/Set Content Properties • Get Content • Copy Content • Delete Content Space Actions • Add Space • Get/Set Space Properties • Get Spaces List • Get Space Content List • Get/Set Space Access • Delete Space Storage Provider Interface • Other Actions • Get Stores • Get Tasks List • Perform Task

  8. Storage Adapters Transform calls from DuraCloud interface into calls understood by a specific storage provider • Determine how DuraCloud “spaces” translate into top level provider containers (buckets) • Define how space and content properties are stored and retrieved • Manage eventual consistency concerns

  9. DuraCloud Services Administrative User Interface (DurAdmin) Service Management (DuraService) Storage Management (DuraStore) Report Management (DuraReport) REST API REST API REST API Service Container DuraCloud Instance

  10. DuraCloud Services Media Streamer Duplicate on Demand Duplicate on Change Bit Integrity Checker Bit Integrity Checker Tools Bit Integrity Checker Bulk Image Transformer Bulk Image Transformer Image Server … so how are they deployed?

  11. DuraCloud Service Deployment Service Management (DuraService) Services Available? 1 REST API 2 Service Manager Service List Services In Plan? 4 Service Registry Service List Service Bundle 3 Service Config Part 1: Ask which services are available Service Plan

  12. DuraCloud Service Deployment Service Management (DuraService) Deploy Service Service Config 1 REST API 2 Service Manager Part 2: Deploy Service Retrieve Service Bundle Deploy Service 4 Service Config Service Bundle Service Bundle Service Registry Service Container Service Bundle Service Bundle 3 Service Configurator Deployed Service Deployed Service Config Service Config Service Plan

  13. Service REST Interface • Get Services • Deploy Service • Get (Deployed) Service • Get Deployed Service Properties • Update Service Configuration • UnDeploy Service

  14. DuraCloud Distributed Services DuraCloud Instance Services Media Streamer Duplicate on Demand Duplicate on Change Bit Integrity Checker Bit Integrity Checker Tools Bit Integrity Checker Bulk Image Transformer Bulk Image Transformer Image Server Runs on DuraCloud Instance Connects to DuraStore Can be direct Java service Can be deployed web app Runs primarily outside of DuraCloud Instance Connects to DuraStore Makes use of cloud network or computation features

  15. DuraCloud Bulk Service Deployment Service Management (DuraService) 1 2 REST API Task Management (DuraStore) Service Manager REST API Run Service Task Service Registry 4 3 Run Hadoop Job 5 6 Service Container Bundle Deployed Service Config Config Service Plan

  16. DuraCloud Reporting Administrative User Interface (DurAdmin) Service Management (DuraService) Storage Management (DuraStore) Report Management (DuraReport) REST API REST API REST API Service Container DuraCloud Instance

  17. DuraCloud Report Generation Report Management (DuraReport) Storage Report Builder Service Report Builder Deposit Reports Message Broker Storage Data REST API REST API Storage Management (DuraStore) Service Management (DuraService) Service Event Messages

  18. Report REST Interface Storage Report • Start Storage Report • Get Latest Storage Report • Get Storage Report List • Get Storage Report • Get Storage Report Info • Cancel Storage Report • Schedule Storage Report • Cancel Storage Report Schedule Service Report • Get Deployed Services Report • Get Latest Completed Services Report • Get Completed Services Report List • Get Services Report

  19. DuraCloud UI Administrative User Interface (DurAdmin) Service Management (DuraService) Storage Management (DuraStore) Report Management (DuraReport) REST API REST API REST API Service Container DuraCloud Instance

  20. DuraCloud UI Interaction Administrative User Interface (DurAdmin) Store Client Service Client Report Client REST API REST API REST API Storage Management (DuraStore) Service Management (DuraService) Report Management (DuraReport)

  21. DuraCloud Security DurAdmin Storage Provider DuraReport DuraStore DuraService Application Security Storage Provider Access Control Instance Firewall Transport Security User Data Center

  22. DuraCloud Tools Transfer to DuraCloud • Upload Tool • GUI to select files and folders • Visual transfer progress • Sync Tool • Monitors for changes • Run one time or continually • Chunk Tool • Transfer large files • Acts on a single file Transfer from DuraCloud • Retrieval Tool • Retrieve files from one, selected, or all spaces • Stitch Tool • Retrieve large files • Acts on a single file

  23. DuraCloud Tools User Data Center Store Client Store Client Chunk Tool Stitch Tool Sync Tool Retrieval Tool Upload Tool REST API Storage Management (DuraStore)

  24. Near Term Road Map New features • Access control at the space level • Improved format identification • Automated bit integrity checking • Email notification on service completion • Multi-Account DuraCloud instances • Content indexing and Search • Improved discovery • Improved content browsing • Folder-based navigation • Improved handling of very large files • Multi-Item updates/deletes Integrations • SDSC storage provider (production version) • Fedora-in-the-cloud prototype • DSpace-in-the-cloud prototype

  25. Long Term Road Map New Features • Video transcoding • Document format transformation • Improved image support services • Media streaming access controls • Metadata extraction services Integrations • Azure storage provider (production version) • Eucalyptus Walrus storage provider • Rackspace compute instances • Managed Fedora-in-the-cloud • Managed DSpace-in-the-cloud

  26. Questions?

  27. Upcoming DuraCloud Webinars DSpace and DuraCloud November 30, 2011 at 1pm ET Fedora and DuraCloud January 11, 2012 at 1pm ET

  28. Thank You! Further Questions? info@duracloud.org

More Related