1 / 13

SAHARA

SAHARA. May 2018. Project overview and update. TELLES NOBREGA IRC: TELLESNOBREGA EMAIL: TENOBREG@REDHAT.COM. What does Sahara do?. Data processing service P rovides a way to deploy data processing clusters with minimum effort from the user.

erice
Télécharger la présentation

SAHARA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SAHARA May 2018 Project overview and update TELLES NOBREGA IRC: TELLESNOBREGA EMAIL: TENOBREG@REDHAT.COM

  2. What does Sahara do? Data processing service Provides a way to deploy data processing clusters with minimum effort from the user. Provides the capability to manage the clusters and submit jobs to them.

  3. Project background First official release was Juno 17 contributors for latest release Latest user survey adoption numbers: Deployed: 11% clouds in production or test phase indicate they are using Sahara; 3% using Sahara in production and 8% in test phase Considering: 25% of users indicated they are interested in this project

  4. Quick Overview • Cluster • Node Group Templates • Cluster Templates • Jobs - EDP (Elastic Data Processing) • Data Sources • Job Binary • Job Templates

  5. Architecture

  6. New features & enhancements in Queens • EXPOSING APIv2 AS EXPERIMENTAL • We released APIv2 as experimental • This will open a wide range of possibilities for new features in Sahara • POLICY IN CODE • Allows policy enforcement to be done in code • S3 OBJECT STORE • EDP job binary may reference a file stored in S3-like object store

  7. New features & enhancements in Queens • DECOMMISSION OF A SPECIFIC NODE • Allows the removal of a specific node from cluster • IMPORT AND EXPORT TEMPLATES • We added the option to import and export templates • https://specs.openstack.org/openstack/sahara-specs/specs/pike/node-group-template-and-cluster-template-portability.html

  8. New features & enhancements in Rocky • INCREASE SUPPORT OF APIv2 • We plan to improve APIv2 and have • BOOT FROM VOLUME • Allows the creation of clusters from volumes instead of images • https://specs.openstack.org/openstack/sahara-specs/specs/newton/boot-from-volume.html#data-model-impact • PLUGINS SPLIT FROM MAIN SAHARA CODE • We are moving the plugins to its own repo • Allows the creation of clusters from volumes instead of images • MIGRATION TO STORYBOARD • Sahara now tracks its bugs and features on Storyboard

  9. Rocky release themes for Sahara NOT A FOCUS NO INFO MINOR FOCUS FOCUS MAJOR FOCUS MAJOR FOCUS MAJOR FOCUS NOT A FOCUS NO INFO NO INFO NO INFO MINOR FOCUS MINOR FOCUS MAJOR FOCUS

  10. Possible features & enhancements for Stein • FULL SUPPORT OF APIv2 • We plan to have APIv2 as the main supported version • HEALTH REPAIR • Cluster health repair: working towards elimination of manual steps from managing lifecycle of a Sahara cluster • PYTHON 3 AS DEFAULT • Python 2 time is running out, we need to move to python 3 full support asap

  11. Stein release themes for Sahara MINOR FOCUS NOT A FOCUS NO INFO MINOR FOCUS FOCUS MAJOR FOCUS MAJOR FOCUS NOT A FOCUS NO INFO NO INFO NO INFO MINOR FOCUS MINOR FOCUS MAJOR FOCUS

  12. We need your help! QUESTION: What services would you like to see supported in Sahara?

  13. THANKS! Questions? openstack openstack OpenStackFoundation

More Related