1 / 7

Development of TSDS API for Time Series Data Management

The Time Series Data Server (TSDS) project aims to create a standardized API for managing time series-like data. Key objectives include developing a software package to implement this API, which facilitates server-side data operations such as super-setting, sub-setting, filtering, and uniform gridding. The API will ensure accessibility to data holdings from various providers in the heliophysics environment. Additionally, client-side software will be developed for popular data analysis tools such as IDL, MATLAB, Java, Python, and Excel. The API will support diverse output formats for flexible data use.

bela
Télécharger la présentation

Development of TSDS API for Time Series Data Management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TSDS(HPDE DAP)

  2. Objectives • (1) develop a standard API for time series-like data, • (2) develop a software package, TSDS (Time Series Data Server), that implements this API and provides server-side super-setting, sub-setting, filtering, and uniform gridding of time series-like data, • (3) make the data holdings from several key data providers in the heliophysics environment accessible through the TSDS API • (4) develop client-side software for standard data analysis packages (IDL, MATLAB, Java, Python, and Excel) that will allow access to a TSDS-enabled server.

  3. API (non-SPASE) • The base-line API builds on OPeNDAP-compliant URL requests http://host/tsds/dataset.suffix?constraint_expression where • host: name of the computer hosting the TSDS servlet, • dataset: name of a time series to be served, • suffix: type or format of the output, and • constraint_expression: A collection of request parameters such as time range and filter. The suffixes (i.e., output options) include • info: information about the dataset and request options, • html: HTML view of dataset information and a form for requesting data, • dds: dataset Descriptor Structure (ASCII), • das: dataset Attribute Structure (ASCII), • dods: data object as defined by the Data Access Protocol (DAP), • asc: data object represented as ASCII, and • spase: a SPASE record for the request (to be implemented as part of proposed work) Other output options include (or will include as a part of the proposed work) • csv: comma separated values, • dat: tabular ASCII format, • bin: A flat binary table, • nc: Network Common Data Form (NetCDF) file, • cdf: Common Data Format (CDF) file (to be implemented as part of proposed work), • h5: Hierarchical Data Format (HDF) version 5, • json: JavaScript Object Notation (JSON) (to be implemented as part of proposed work), and • xml: An XML representation of the data (to be implemented as part of proposed work; structure to be determined)

  4. API using SPASE (proposed) Generic API http://host/tsds/dataset.suffix?constraint_expression Example: http://tsds.net/tsdsdev/vmo/crres.csv?time,B Proposed: spase://VMO/NumericalData/CRRES/MAG/PT2S

  5. Connecting to a service or file(s) • NcML (netCDF mark-up language) describes data structure of local or remote service or file(s).

  6. Catalog View

More Related