1 / 9

Navigating the Data Revolution: A Journey Through eScience and Big Data Transformations

Explore the evolution of eScience and Big Data from visionary ideas to mainstream realities. Witness the impact of projects like SDSS and NVO, and the exponential growth in data volume. This journey reflects the convergence of Astro, Statistics, and Computer Science, shaping the future of research and innovation.

saddam
Télécharger la présentation

Navigating the Data Revolution: A Journey Through eScience and Big Data Transformations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Journey

  2. Things we dreamed about have happened • Ideas we came up with are now mainstream • The Industrial Revolution in science • eScience brought amazing sociological changes • SDSS -- one of the first eScience projects • NVO --one of the first VOs of any kind • Data publishing – Data Conservancy • Astro + Statistics + CS -- new area

  3. Big Data in SQL Server • SDSS – 80GB in 2001, now 30TB, • Pan-STARRS next… • 6 sensors – now almost 1000 sensor days • Turbulence – idea – 30TB – next 100TB • Simulations coming • Millennium,(2TB) soon LANL (60TB) • Silver River (500TB) • Intel TB archive now GrayWulf 1 PB

  4. Issues • Computing is now about data • Databases work amazingly well • Now becoming mainstream in science • Life with a PB is different from a TB • Need to do things differently in 2 years • Power, petabytes, clouds, … • A very interesting time to live in

  5. Support • Keck and Moore • Microsoft • NSF • JHU

  6. Wish Jim was here…

  7. Many wonderful people stepped in to fill the huge gap Jim left behind: Tony, Gordon, Jose, Catherine

  8. This journey was a mad rush… and it is good to look back every once in a while Thank you for running along… And buckle up, since I am not slowing down

More Related