1 / 142

Datacenter Management with Apache Mesos

Datacenter Management with Apache Mesos. mesos.apache.org @ ApacheMesos. Benjamin Hindman – @ benh. I’ve got tons of data . … more everyday!. That must be why they call it a data center. I’d love to answer some questions with the help of my data!. I think I’ll try Hadoop .

lela
Télécharger la présentation

Datacenter Management with Apache Mesos

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Datacenter Management with Apache Mesos mesos.apache.org @ApacheMesos Benjamin Hindman – @benh

  2. I’ve got tons of data ...

  3. … more everyday!

  4. That must be why they call it a datacenter.

  5. I’d love to answer some questions with the help of my data!

  6. I think I’ll try Hadoop.

  7. your datacenter

  8. + Hadoop

  9. happy?

  10. Not exactly …

  11. … Hadoop is a big hammer, but not everything is a nail!

  12. I’ve got some iterative algorithms, I want to try Spark!

  13. datacenter management

  14. datacenter management

  15. datacenter management

  16. static partitioning

  17. Oh noes! Spark wants to read and write data to HDFS!

  18. Hadoop … (map/reduce) (distributed file system)

  19. HDFS

  20. HDFS

  21. Could we just give Spark it’s own HDFS cluster too?

  22. HDFS

  23. HDFS

  24. HDFS

  25. HDFS tee incoming data (2 copies)

  26. HDFS tee incoming data (2 copies) periodic copy/sync

  27. That sounds annoying … let’s not do that. Can we do any better though?

  28. HDFS

  29. HDFS

  30. HDFS

  31. happy now?

  32. No! We’ve decided to start doing real time computation with Storm …

  33. datacenter management

  34. datacenter management

  35. happy now!?

  36. Not really … during the day I’d rather give more machines to Spark but at night I’d rather give more machines to Hadoop!

  37. datacenter management

  38. datacenter management

  39. datacenter management

  40. datacenter management

  41. And failures require more datacenter management!

  42. datacenter management

  43. datacenter management

  44. datacenter management

  45. I don’t want to deal with this!

More Related