1 / 1

Real-Time Processing of NEXRAD Doppler Radar Data with Continuous SQL Queries

This document discusses the system for streaming, transforming, filtering, and aggregating NEXRAD Doppler radar data for real-time applications. Utilizing a Directed Acyclic Graph (DAG) of operators for performing continuous SQL queries upon the arrival of every event, it addresses challenges related to asynchronous data streams and proposes optimized join windows. The work focuses on enhancing the performance of slow and erratic streams, making it ideal for atmospheric discovery and meteorological purposes.

xantha-jefferson
Télécharger la présentation

Real-Time Processing of NEXRAD Doppler Radar Data with Continuous SQL Queries

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. QM Peachtree City, GA QN Streamed sweep data archive dispatcher archive Query scripts Grier, SC Archived sweep data repository dQUOB notification service Hytop, AL Transform, Filter, Aggregate time R: … l k j i h g f e d c b a event channel S: … 5 4 3 2 1 consumer provider quoblet discards raw Level 2 data Beth PlaleIndiana University dQUOB:SQL queries over data streams Motivating Application: Linked Environments for Atmospheric Discovery (LEAD) NEXRAD Doppler radar data streamed and transformed, filtered, or aggregated for real-time use. dQUOB Queries execute continuously – upon arrival of every event. Queries implemented as DAG of operators (selects, projects, and joins) Problem: asynchronous streams; stream S is slow and erratic Unoptimized version: time R: … l k j i h g f e d c b a … S: 5 4 3 2 1 Approach: express join window as interval of time join window: count Optimized version: join window: 10 sec.

More Related