1 / 13

Querying Integrated Observation and Measurement data

This document outlines the methodologies for querying integrated observation and measurement data across various formats and contexts, with a focus on the SONet framework. It discusses both online and offline data processing strategies, including the OBOE-aware database and different query strategies for handling raw and materialized data. Various annotation files, measurement and observation type tables, and context types are detailed to enhance understanding of data organization. The framework supports complex queries, including those combining tree height and soil acidity measurements.

rey
Télécharger la présentation

Querying Integrated Observation and Measurement data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Querying Integrated Observation and Measurement data SONet June 8,2010

  2. Framework Query 1 Query 2 Result Q1 Result Q2 … …. … …. Online query engine File 1 OBOE-aware DB File 2 Offline data processing Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 3 Annotation interface File 4 OBOE domain model …

  3. Annotation as a bridge Map Measurement type table Observation Type table File 1 Entity type table Context type table File 2 OBOE-aware DB File 3 Offline data processing Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …

  4. Annotation as a bridge Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Observation type table (for ann1, 2, …) File 1 Entity type table (for ann1, 2, …) File 2 Context type table (for ann1, 2, …) OBOE-aware DB File 3 Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …

  5. Raw data loading Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Table 3 Observation type table (for ann1, 2, …) Table 2 File 1 Table 1 Entity type table (for ann1, 2, …) … File 2 Context type table (for ann1, 2, …) OBOE-aware DB File 3 Offline data processing (raw data loading) Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …

  6. Data materialization Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Measurement table Table 3 Observation type table (for ann1, 2, …) Table 2 Observation table File 1 Table 1 Entity type table (for ann1, 2, …) Entity table … File 2 OBOE-aware DB Context type table (for ann1, 2, …) Context table File 3 Offline data processing (data materialization) Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …

  7. Data materialization Measurement Table (for file 1, 2, …) Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Entity table (for file 1, 2, …) File 1 Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) File 2 Context type table (for ann1, 2, …) OBOE-aware DB File 3 Annotation 1 Annotation 2 Annotation 4 Annotation 3 File 4 …

  8. Query strategy 1 Measurement Table (for file 1, 2, …) Online query engine (query re-writing over raw data) Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Entity table (for file 1, 2, …) Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) Context type table (for ann1, 2, …) OBOE-aware DB

  9. Query strategy 2 Measurement Table (for file 1, 2, …) Online query engine (query re-writing over materialized data) Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Entity table (for file 1, 2, …) Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) Context type table (for ann1, 2, …) OBOE-aware DB

  10. Query strategy n?? Measurement Table (for file 1, 2, …) Online query engine Map (for ann1, 2, …) Measurement type table (for ann1, 2, …) Table 4 Observation table (for file 1, 2, …) Table 3 Observation type table (for ann1, 2, …) Table 2 Other materialization?? RDF triple store? Entity table (for file 1, 2, …) Table 1 Entity type table (for ann1, 2, …) … Context table (for file 1, 2, …) Context type table (for ann1, 2, …) OBOE-aware DB

  11. Query • Tree[Height > 5 Meter]: return datasets that have at least one Tree observation containing a Height measurement with a value greater than 5 Meters • Tree[Height > 5 Meter], Soil[Acidity >= 7 pH]: return datasets that contain at least one Tree observation (having a measurement where the Height was greater than 5) and at least one Soil observation (having an Acidity measurement of 7 or greater).

  12. Query • Tree[Height > 5 Meter] -> Soil[Acidity >= 7pH]: • Incorporates context via the "->” (arrow) symbol, which can be read as "contextualized by" or "has context". • The query returns datasets that contain at least one Tree observation (with the corresponding height value) where the observation was taken within the context of a Soil observation (with the corresponding acidity value). • …

  13. Queries • ????

More Related