1 / 14

OOI CyberInfrastructure: Data Distribution Network architectural overview

This document outlines the goals and architecture of the OOI Cyber Infrastructure Data Distribution Network (DDN). It describes the deployment strategy for a data distribution application in the cloud, highlighting features such as high availability and scalability to meet demand. The report investigates cloud provisioning mechanisms, load balancing strategies, and cloud instance contextualization, particularly focusing on Amazon EC2. It includes documentation for users, providers, and developers, ensuring comprehensive support for all stakeholders involved in ocean science and cyber-infrastructure.

urbana
Télécharger la présentation

OOI CyberInfrastructure: Data Distribution Network architectural overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OOI CyberInfrastructure:Data Distribution Networkarchitectural overview January 2009 Claudiu Farcas OOI CI Architecture & Design Team UCSD/Calit2

  2. Outline Prototype Goals Logical Architecture Deployment Architecture Cloud Deployment Strategy Documentation

  3. Functional Goals Demonstrate deployment of an existing data distribution application in the cloud high availability and elastic scalability to demand technical feasibility to the different OOI stakeholder communities, from ocean scientists to cyber-infrastructure experts Investigate distributed cloud application provisioning mechanisms cloud instance contextualization mechanisms load balancing mechanisms mechanisms for load reduction on data providers cloud deployment environments, in particular Amazon EC2

  4. Domain Models

  5. Domain Models

  6. Prototype Architecture

  7. System Provisioning in the Cloud

  8. DDN Cloud Deployment

  9. Cloud Instance Provisioning

  10. DDN Messaging • Messages by component (application level)

  11. DDN Messaging • Provisioner (contextulization) Message Routing Keys rabbitmq.dnsrabbitmq.runningrabbitmq.runscriptrabbitmq.statusregapp.config_templregapp.dnsregapp.runningregapp.runscriptregapp.statusregapp_db_agent.config_templregapp_db_agent.dnsregapp_db_agent.runningregapp_db_agent.runscriptregapp_db_agent.status dispatch.runningdispatch.runscriptdispatch.statuserddap_crawl.dnserddap_crawl.runningerddap_crawl.runscripterddap_crawl.statuserddap_util.dnserddap_util.runningerddap_util.runscripterddap_util.statusloadbalancer.dnsloadbalancer.runningloadbalancer.runscriptloadbalancer.statusmemcached.dnsmemcached.runningmemcached.runscriptmemcached.status mysqlcluster_api.dnsmysqlcluster_api.runningmysqlcluster_api.runscriptmysqlcluster_api.statusmysqlcluster_data.dnsmysqlcluster_data.runningmysqlcluster_data.runscriptmysqlcluster_data.statusmysqlcluster_mgmd.dnsmysqlcluster_mgmd.runningmysqlcluster_mgmd.runscriptmysqlcluster_mgmd.status

  12. Summary of Technologies ERDDAP data transformation and distribution middleware THREDDS Dataset catalog server Memcache share memory state across distributed application instances HAproxy load-balancer Django (using python) As web user interface framework providing integrated access to MySQL database (cluster) MySQL Cluster highly reliable, scalable application database Amazon Elastic Cloud (EC2), Simple Storage Service (S3) Cloud execution environment

  13. Documentation • DDN (wiki structure) • Introduction (what, why/benefits) • User Guide • Data Provider’s Guide (add/manage datasets, catalogs, servers) • Data Consumer’s Guide (subscribe/manage subscriptions, ERDDAP) • Developer Guide • Installation how-to • Logical Architecture • Deployment Architecture • Administration/maintenance how-to • Context sensitive help • “?” after each option/button provides explanatory text bubble

  14. Thank you

More Related