40 likes | 168 Vues
This document outlines challenges and strategies for releasing high-quality datasets from Operation IceBridge to meet the needs of the modeling community. Key recommendations include providing gridded datasets with higher resolution in critical areas, raw datasets at each measurement point, and comprehensive uncertainty analyses. It emphasizes the importance of data consistency over time and the necessity for clear documentation, format standards (e.g., netCDF414, HDF5), and potentially developing format converters. Ensuring that new data remains accessible and understandable is paramount for effective use by modelers.
E N D
Operation IceBridge : Data Release Challenges Marilyn Kaminski, Joel Plummer, Eric Larour and Sophie Nowicki
Gridding and unstructured meshes. • Release gridded datasets as this is the #1 form of data delivery expected by the modeling community. • To address needs of growing number of higher-order models, release gridded datasets with patches of increased resolution in critical areas (PIG, JKS, …) • Release also raw datasets at each measurement point (lat,long,value) for FEM models that rely on unstructured meshes.
Uncertainty analysis. • Release error ranges and error types (i.e. what is the statistical distribution of errors) along with datasets. • If not possible, release coarser resolution error maps that can be mapped onto the datasets. • Release error origin: introduced during the processing? during data handling? during interpolation? during measurement itself?
Modelers’ needs • - Data consistency over time is really important (for formats and grids) • Users need to be sure that new data can be read and understood in same ways as previous data • Same concern noted in development of sea ice community product • What is a good choice for users… ex: netcdfbut not universal? • Format converters could be written so data can be distributed in format of choice • NSIDC’s IceBridge charter to preservedata and increase usage leads to similar goals • Data consistency over time • Changes are OK but need to be planned, and previous data ought to be reprocessed • Standard archive formats (netCDF4 and HDF5 approved by NASA data mgmt) • Complete documentation and metadata