410 likes | 521 Vues
This report summarizes the 4th Annual System Review of the Observing System Monitoring Center (OSMC) held in May 2006. Led by Kevin O’Brien and co-PIs Kevin Kern and Ted Habermann, the review highlights global ocean climate observations, data integration challenges, and advances in observation platforms. It discusses the functionalities of PMEL, NDBC, and NGDC in streamlining data assembly, operations, and user interfaces. The presentation also evaluates current metadata usage, integration needs, and observational adequacy through visualization tools and user interfaces.
E N D
Observing System Monitoring Center (OSMC)Status Update Office of Climate Observation May 2006 Kevin O’Brien Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI) Ted Habermann – NGDC (co-PI)
… to provide a system view of global ocean climate observations OCO 4th Annual System Review
A partnership … • PMELUser interface logic & tools • NDBCData assembly & operations • NGDC Database & GIS consulting OCO 4th Annual System Review
OSMC (meta)database What is the “climate data record”? • Current (meta)data (“realtime”) • GTS -- primary source • Historical (meta)data • poorly integrated • need “DMAC” integration • for now … use a GTS archive(misses e.g. NOAA research cruises) OCO 4th Annual System Review
OSMC (meta)database at NDBC • Met and Ocean surface data are updated daily with GODAE “T-files” (06, 12, 18, 24) from the previous day~350 MB of data per day URL=http://usgodae2.fnmoc.navy.mil/ftp/outgoing/fnmoc/data/met/2005031706.tar.Z • 1x1 degree gridded metadata netCDF summary files are updated daily • The database repository begins 1 June 2004 OCO 4th Annual System Review
OSMC (meta)database at NDBC • Drifter updates from JCOMMOPS URL = ftp://ftp.jcommops.org/Argo/Status/status.txt • Profiling float data from US GODAE Server • Profile repository starts 1 January 2004 • Country information is assigned based on WMO allocation table URL = http://www.wmo.ch/web/aom/marprog/Operational-Information/buoy-ids.htm OCO 4th Annual System Review
OSMC_Datasource ID Name OSMC_Obs_Delay Platform_ID Ob_Date Latitude Longitude SLP SST ATMP DEWPOINT WINDSPD WINDDIR CLOUDS XML Country - is based on ISO 3166, which defines unique 2-character identifiers for each country. OSMC RDBMS – Entity Diagram Organization - identifies an agency, institute, university, or private company that owns or operates a reporting platform Datasource - identifies the source of the data. Platform - identifies a ship, drifting buoy, moored buoy station, or other platform that reports marine data. Observation - records the instance of a marine observation for a reporting date and time. Obs_Delay - used to retain ship observation to enforce the 48 hour delay. OCO 4th Annual System Review
OSMC Observations Summary OCO 4th Annual System Review
OSMC IT Environment • Hosted at NDBC • Dell PowerEdge 2650 • Dual Processor 3.06 GHz/1MB Cache • Five 146 GB Harddrive • Red Hat Enterprise Linux AS 4.0 • Oracle Database OCO 4th Annual System Review
Who are the users? • Office of Climate Observation • NOAA Observing system managers • Scientific Community OCO 4th Annual System Review
Tools OSMC should provide: • Overview (where are the obs?) • Drill-down (what are the obs?) • Evaluation (are the obs adequate?) OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting today OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting air temp. today OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting SST today OCO 4th Annual System Review
Visualization & evaluationOverview all platforms reporting SST today colored by country OCO 4th Annual System Review
Visualization & evaluationOverview Drifters reporting SST today OCO 4th Annual System Review
Visualization & evaluationOverview U.S. drifters reporting SST today OCO 4th Annual System Review
Visualization & evaluationOverview U.S. drifters reporting SST this week OCO 4th Annual System Review
Visualization & evaluationOverview U.S. Pacific drifters reporting SST this month OCO 4th Annual System Review
Visualization & evaluationOverview U.S. Pacific drifters reporting SST this month, colored by tail OCO 4th Annual System Review
Visualization & evaluationOverview OCO 4th Annual System Review
User interface & tools for evaluation • Overview (where are the obs?) • Drill-down (what are the obs?) • Evaluation(adequacy of the observations) OCO 4th Annual System Review
Visualization & evaluationDrill Down mouse click for metadata summary OCO 4th Annual System Review
Visualization & evaluationDrill Down mouse click to view data OCO 4th Annual System Review
User interface & tools for evaluation • Overview (where are the obs?) • Drill-down (what are the obs?) • Evaluation(adequacy of the observations) OCO 4th Annual System Review
Visualization & evaluation Number of platforms per 1x1 degree box reporting SST today OCO 4th Annual System Review
Visualization & evaluation Number of platforms per 5x5 degree box reporting SST this month OCO 4th Annual System Review
Visualization & evaluation 5x5 degree boxes this month that had one or more SST obs every day OCO 4th Annual System Review
OSMC LAS The OSMC doesn’t look like a Live Access Server …but it is (Shown is the more traditional LAS user interface) OCO 4th Annual System Review
“Adopt-a-Drifter” is another specialized user interface to the same OSMC server OCO 4th Annual System Review
Can the database keep up? • Database performance evaluation • Performance has increased by orders of magnitude • Ever-increasing complexity of useful queries • Need for spatially-based queries • Can metrics be efficiently calculated directly from database? OCO 4th Annual System Review
A new view of the OSMC database OCO 4th Annual System Review
Providing an overview of OSMC • Developing summary OSMC data table views • Number of daily observations • by platform • by country, platform, and date, with drop-down country select • As a demonstration of spatial query capabilities: • # of platforms in Exclusive Economic Zones or ocean and sea polygons • Including drill down to observations OCO 4th Annual System Review
OSMC and Google Earth OCO 4th Annual System Review
What’s ahead • Security • Delay ship observations by 48 hours • Performance • Support “time-partitioning” of database • Create daily summary tables • Metrics • User feedback • Continue work with OCO on UI tools OCO 4th Annual System Review
What’s ahead • Accountability • Continue adding variables • Tease apart platforms better • Reduce unidentified/unknown platforms • Integration • With climate products • With ocean/climate modeling efforts • Into IOOS & GEOSS framework OCO 4th Annual System Review
How Can You Help? • Types of metrics needed • Useful tools • Other platforms/datasets/variables, etc • OSMC will be available through • http://www.oco.noaa.gov Thank You! OCO 4th Annual System Review