80 likes | 208 Vues
This presentation by Dave Webster delves into the evolution of TSDB (Time Series Database) and its capabilities as of September 2014. With tens of thousands of time series metrics sourced from over 800 machines, TSDB offers high-frequency samples ranging from 1 to 60 seconds without downsampling. Operating within a simple architecture, it integrates with various interfaces for efficient data visualization. Despite its advantages, there are some limitations in areas such as alerting, polling, and efficiency. The session highlights the importance of TSDB in managing real-time metrics within high-performance environments.
E N D
TSDB EVOLUTION Dave Webster DOCCON1 September 2014
TSDB IS GREAT • Tens of thousands of time series metrics • Sourced from almost every machine across the PRODUCTION estate (800 plus) • Samples between 1 and 60 seconds (mode 10) • Retained for years • No downsampling • Numerous interfaces (Visualiser, native, radiator, confluence, metrilyx)
Simple architecture tcollector TSDB JMX OS statsE poller
There are limitations though… • Alerting and monitoring • Recency • Efficiency of polling • Tcollector efficiency • Jacek’s extras PERSIST vs STREAM
rewrite tcollector forwarder TSDB JMX OS statsE poller
rewrite tcollector forwarder TSDB JMX OS statsE poller Riemann Kale aggregator Nagios Plotting Health
TIME SERIES PIPELINE : A Summary • REAL TIME STREAM OF INVALUABLE METRICS • HIGH PERFORMANCE • Open source • ARGUABLY MORE IMPORTANT THAN TSDB