Tools for Accessing Distributed Data Collections for In-Situ Data Exploration
170 likes | 273 Vues
Discover solutions for locating and selecting individual observations from distributed in-situ data collections. Tools like LDAP Directory Service, NdEdit, and SGT aid in exploring diverse data types through interactive Java graphics and scalable platforms, accessible via desktop or web clients.
Tools for Accessing Distributed Data Collections for In-Situ Data Exploration
E N D
Presentation Transcript
Toolsfor accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level Center/ADCP Center, University of Hawaii John R. Osborne, OceanAtlas Software L. Charles Sun, NOAA/NODC Willa H. Zhu, NOAA/JISAO Nancy Soreide, NOAA/PMEL AMS IIPSFeb 9-13 2003, Long Beach, CA
Challenge • Locating and selecting individual observations from large, distributed collections of in situ data observations • Examples: Individual oceanic or atmospheric profiles, time series, buoy tracks, etc.
Some solutions • Tools and Applications • LDAP Directory Services • NdEdit for subsetting large in-situ collections • Interactive Java graphics • Intensive exploration of multiple data types • OPeNDAP (DODS) clients and servers for in-situ data • Access from Desktop and Web • Assembled from OpenSource components • http://www.epic.noaa.gov/epic/software/ep_java.htm
LDAP Directory ServiceFinding distributed data collections • Search on geographic region, observed quantities or keyword • Automatically populated from data servers • Metadata instantly known to LDAP directories • Access control for experimental data products • Open Source • Standards-based • Platform independent, • Scalable, extensible, • Supports desktop or web client
NdEdit Explore Data Locations and Subset Data Collections • Interactive, linked windows • View any 2D sliice • xy, xt, xz, yt, yz, yt • Investigate space-time distribution • Select data • in any View Select time rangeSee datain range X-Y map view Y-Ttime range X-Y map view Y-Ttime range
NdEdit Section Tool - select stations along a depth contour
NdEdit Selected stations are in a narrow time band
NdEdit Polygon tool – select an oblique section line See time range of stations
NdEdit • NdEdit is an interactive Java tool • NdEdit is being re-engineered for the Web
SGT: A Scientific Graphics Toolkit • Java toolkit for scientific graphics • On-line documentation, examples, tutorials, streaming video • JavaBeans in next release • Features • Contour, line and vector plots, • Axes user settable or automatically scaled • multiple Time Axis formats • mouse-movable, customizable Labels, line keys, icons • Legend generation automatic • Widely used, freely available • scientific and commercial applications use SGT • 12836 downloads by 4508 unique sites from 66 countries • http://www.epic.noaa.gov/java/sgt/
Applications Java Desktop and Web clients
ncBrowseJava tool for data/metadata browse • NetCDF and full OPeNDAP support • Desktop Java application • Axis mapping, parametric plots, flexible mapping of independent variables to axes • Line, vector and contour plots • Animations, 3D graphics via VisAD • Popular, freely available • 6471 downloads by 2896 unique sites in 57 countries • OPeNDAP (DODS) client, Unidata netCDF client, WOCE data CD, etc. • http://www.epic.noaa.gov/java/ncBrowse/ See: AMS Paper 15.2 – Thursday 4:45pm - Donald Denbo
Java OceanAtlasfor browsing ocean data • Intensive Java desktop browsing of ocean data • Property-property plots with up to 7 x axes, waterfall diagrams, Contour plots/residual contour plots, Map plots with optional "bubble" isosurface plots, Linked browsing of all plot types, Built-in and custom calculations, NdEdit for data location/selection • Reads WOCE, EPIC, OPeNDAP netCDF data, some ARGO formats • Extended for wide range of data types • Profile, time series, drifting buoy, gridded analyses, model outputs • Widely used, freely available • http://www.epic.noaa.gov/epic/software/JavaJOA.htm • http://odf.ucsd.edu/joa/jsindex.html
Climate Data PortalDistributed ocean observations • Major in situ data collections: • TAO El Nino buoy data (realtime/PMEL), Global sea level data (realtime/U of Hi), GTSPP (NODC), PMEL hydrographic data and time series collection, WOCE ADCP (U of Hi), IPRC/APDRC in situ data, US Coastal Ocean Time Series database (NODC) • OPeNDAP: in-situ data server and client • LDAP directory services • NdEdit for data selection/subsetting • Data Servers, Clients (Java and Web) – focus on in situ data • http://www.epic.noaa.gov/cdp/cdpjava.htm
OceanShareNetwork collaboration tool • Collaboration features • Local, remote data file access and Java graphics • Standard collaboration tool features (annotation, whiteboard, etc) • Secure LDAP Document Repository • Proposals, papers in progress, data, images • Access control by document or by folder • Accessible from web and desktop • OPeNDAP compatible soon • http://www.epic.noaa.gov/collab/
EPIC tools for the Web for building customized web access to data Example applications • EPIC Web Browser (general) • TAO (El Nino buoys) • Unaami (Arctic time series) • OSCAR (Satellite ocean currents) • Multibeam data (hydrography) • http://www.epic.noaa.gov EPIC Web Toolkit • Interface design • Backend graphics • Map data selector
Tools and Applications Java desktop and Web • Modular Web and Open Source components • Java interactivity • Low cost development/maintenance • OpenSource, standards-based • Scalable, extensible • OPeNDAP supported or planned • http://www.epic.noaa.gov • http://www.epic.noaa.gov/epic/software/ep_java.htm