2013 NOAA Satellite Conference NOAA Center for Weather and Climate Prediction NESDIS Enterprise Distribution though the Product Distribution and Access (PDA) System Christopher Sisko, Jamie Hawkins, Rick Vizbulis, Kevin McMahon, Donna McNamara, Stephen Ambrose, and John Linn. College Park, Maryland April 10th, 2013
Presentation Outline • Enterprise approach to data distribution • Product Distribution and Access (PDA) system overview. • User level interaction: • User interface examples (under refinement) • Subscription process (sequence diagram) • Search and ad-hoc data request process (sequence diagram) • PDA capabilities • Timeline • Summary • Q&A
Enterprise Distribution Approach • TODAY • Environmental Satellite Processing Center (ESPC) distributes data from several different systems: DDS, McIDASADDE servers, AWIPS GINI, ftp services, etc. • WHY CHANGE? • Need to distribute large data volumes from new missions • Want to leverage latest technology improvements, and build in scalability • Required to improve IT security posture • Have to handle data management challenges • THE FUTURE • Product Distribution and Access (PDA), an enterprise solution. • An enterprise distribution system will: • allow authorized real-time users to manage their data subscriptions and delivery • allow those users to tailor their data requests to meet their specific needs • enable ESPC to proactively manage data volume usage
Enterprise Distribution Approach • Uses a PROVEN CONCEPT: • Adapted from data centers that deliver data with less stringent data latency requirements. • Replaces the traditional, mission-specific “point to point” real-time delivery approach. • Implements data management FLEXIBILITY: • NESDIS real-time authorized users can manage their unique data delivery needs. • Meets time-critical delivery requirements. • Provides a secure and scalable enterprise system framework. • Simplifies operations and maintenance for ESPC Operators.
PDA – Product Distribution and Access System Overview Source: Solers
PDA – Product Distribution and Access • System Overview Product Data Providers Product Distribution and Access (PDA) Product Data Consumers GOES-R Subscriptions & Ad-Hoc Requests Product Data Providers Status & Events GOES NWS NMFS POES NOS NESDIS Satellite Data and Products MSG Satellite Data and Products DoD NIC GOES-R GS PG MTSAT EUMETSAT CLASS SNPP/JPSS Ancillary Data Providers STAR Others Ancillary Data Consumers ESPC EUMETSAT NCEP NWS/FOS GOES-R GS PG Legacy GOES PG Ancillary Data Ancillary Data FSL/FOS FNMOC Legacy POES PG NDE/JDE PG PDA NCOF (UK) NASA/GSFC NPP/IDPS NESDIS-IMS NSIDC NHC Source: Solers
PDA User Interfaces (examples)utilize Google Web Toolkit (GWT) • User authenticates or a new user can register for account activation – subject to NESDIS’s data access policy. • Once the user is approved and authenticated, they are able to log into the system and are dropped onto a landing page. • Menu options • System announcements and user specific notifications. Source: Solers
PDA User Interfaces (examples) • Account creation user interfaces Source: Solers
PDA User Interfaces (examples) Tailoring Capabilities Sectorizing Remapping Translation Aggregation subscription interface search / data discovery interface Source: Solers
PDA Data Subscription Sequence Diagram Create new data subscriptions - Receive data by pulling from provider - Receive data pushed by provider • Fulfill data subscription by pushing to subscribers • Fulfill data subscription by notifying data available for pull Source: Solers
PDA Search / Adhoc Request Sequence Diagram Create new data search Search data based on input parameters is returned back to user Deliver ad-hoc data requested by data consumer Source: Solers
PDA Capabilities Tailoring Capabilities Sectorizing Remapping Translation • Remapped to: • Lambert Conformal • Polar Stereographic • Mercator • Platte Carre With GOES-R ABI-based products being delivered in fixed-grid coordinates, remapping to user specifications on PDA can be implemented in a CPU-efficient look-up-table application, saving resources and avoiding latency impacts. • Sectorizing - geographic sub-setting • File sub-setting – layer extraction • Remapping and resolution reduction • Bit-depth scaling • File translation (NetCDF McIDAS) Source: Solers
PDA Capabilities • Create a Region of Interest • define the region bounds or • define center and extent of region • define if data exists within region or • define if data overlaps • save user defined region or • select an existing region to use. Source: Solers
Transition to Operations Timeline Baseline of T2O1/2013 Timeline – Transition to Operations Site TRR 7/2014 ORR 10-11/2014 TRR 1/2014 PSR 5/2014 2nd Quarter 2015 Planning Outreach Training Implementation Sustainment/Ops Support Inform users of PDA capabilities as outreach (now). Provide training information and HOWTOs to users – early 2014. PDA system assumes data distribution in parallel with legacy distribution systems – late 2014. Source: Solers
Summary • PDA: • represents a new paradigm shift in NESDIS’s capability to deliver data to our real-time users. • enables users to manage their data subscriptions. • provides event responders with in-depth data discovery and a powerful search capability. • enables ESPC to manage its entire product distribution from a single enterprise system. • PDA timeline key milestones: • inform users of the system’s capabilities (now) • provide user level training (mid-2014) • transition the system to operations (late-2014)
Thank You • Questions and Answers ? • Note - Feel free to ask more detailed questions or provide comments during the User Feedback Session at 4:00 PM today.