Streams and Stuff
30 likes | 127 Vues
Explore streaming considerations including delivery methods, update strategies, time windows, sensor management, and value combination. Understand sensor knobs, time epochs, and interactivity for accurate data processing.
Streams and Stuff
E N D
Presentation Transcript
Streams and Stuff Sirish and Sam and Mike
Streaming Considerations • Lifetime: Instantaneous vs. Standing • Delivery: All-the-time, periodic, on-demand (deltas?) • Append Only • With windows • Units: tuples, time, or punctuations • Endpoints: fixed, moving, or both? • “NOW” keyword: relative to when? • Update-in-place • Do time windows make sense? • Sensor “knobs” • OK to combine values from different epochs? • CONTROL: prioritize groups, sensors. • Interactivity • Accuracy (e.g. confidence intervals, counts, percentages)
The Telegraph Engine • CACQ • All-the-time delivery • Output window • Left edge fixed at time of query • Therefore, results never invalidated • Right edge sliding, = NOW • Band Joins • PSoup • On demand delivery • Output window • Endpoints sliding or fixed • Band Joins in Main Memory Implementation • Sensors • On-demand (instantaneous) or periodic delivery • Sample rate = GCD of delivery rates • Combine Values from Different Epochs