Joint OSSE data set at NASA Portal

1. Joint OSSE data set at NASA Portal DBL91 profile data for T511 Simulated prepbufr data Simulated ozone data Observation template data Jack Woollen and Michiko Masutani December 2009

2. Joint OSSE Nature Run datahttp://portal.nccs.nasa.gov/ossePassword protected The complete data for T511NR and T799NR. Model level data and surface data are saved as a reduced gaussian grid.   Regular lat-lon grid data for pressure levels, isentropic levels and surface data are also provided for verification purposes. For more detail visit: http://www.emc.ncep.noaa.gov/research/JointOSSEs Access to the complete data is available from the NASA/GSFC portal system: http://portal.nccs.nasa.gov/osse Requires a user name and password. Contact person Harper Pryor (Harper.Pryor@nasa.gov) Gradsdods access: T511NR model resolution data are also available from the OPeNDAP server http://opendap.nccs.nasa.gov:9090/dods/OSSE/T511/ Gradsdods access is available for T511 NR. The data can be down loaded  in grib1, NetCDF,  binary.  The data can be retrieved  globally or selected region.              Provide IP number to :Arlindo da Silva (Arlindo.Dasilva@nasa.gov)

3. Product from Joint OSSE team http://portal-dev.nccs.nasa.gov/josse/index.pl This site is not password protected Joint OSSE Data Usage and CreditThis data must not be used for commercial purposes and redistribution rights are not given. Originating institutes must be given credit in any publications in which this data is used. If you are interested in using the data or need assistance please contact the originating institute. For more information about Joint OSSE and the data sets, please visit the Joint OSSE website (http://www.emc.ncep.noaa.gov/research/JointOSSEs)

4. NCEP-NESDIS data posted in December 2009 Dataset Originating Institute Contact NCEP Obs NOAA/NCEP Michiko Masutani (Michiko.Masutani@noaa.gov) NCEP-NESDIS NOAA/NCEP Michiko Masutani (Michiko.Masutani@noaa.gov) NOAA/NESDIS Subdirectories under each data set NCEP-NESDIS osbuvb.n_t511.v0906 prepbufr.n_t511.v0903 thinsats.n_t511.dbl91.v0909 NCEP_Obs thinsats_rad.gdas.mask.v0909 thinsats_rad.gdas.v0905

5. NCEP-NESDIS Simulated data from T511 Nature Run May2,2005-August31, 2005 osbuvb.n_t511.v0906 (BUFR) Ozone data. More detail? prepbufr.n_t511.v0903 (BUFR) Conventional data which is included in prepbufr data at NCEP thinsats.n_t511.dbl91.v0909 DBL91 data explained after slide 6 NCEP_Obs thinsats_rad.gdas.mask.v0909 (BUFR) Template file for DBL91. Foot print used by NCEPGDAS. QC info for each channel. Values 0 for unused channel thinsats_rad.gdas.v0905 Template file for DBL91 with available Observed Brightness temperature.

6. Flexile Radiance data Simulation strategies at NCEP Jack Woollen of NCEP developed more flexible strategies for data bases, nicknamed DBL91.This system consists of two data files per synoptic time. DBL91(binary): These files contain all the relevant background and satellite location and geometry information needed for the radiance simulation. This includes NR surface, upper air, climatology interpolated to the thinned satellite observation locations reported in the operational GDAS “radstat” diagnostic files. OBS-Template(BUFR): The program read the data base which contains information about observation including location. The radiance data records include a mask indicating which channel was assimilated in the operational GDAS. Simulation of radiance requires only DBL 91. After radiance is simulated, OBS-Template supplies addition observation specific information to recreate the satellite BUFR files correctly with the simulated values installed, and, if desired, to mask out channels not used in the GDAS. The first set ofDBL91was generated for existing satellite data used in 2005. Data are processed at foot print used by NCEP operational data assimilation. The mask for used and unused channel is included. AIRS, HIRS2, HIRS3, AMSUA, AMSUB, MSU, GOES are processed. OBS-template was generated in bufr format. This may be good enough for calibration and testing additional future observation. When GMAO produces a set of data locations, that can also be used as a template to generate DBL91 based on the GMAO sampling. DBL91 can be generated for future observation as well, maintaining a consistent interface for the simulation programs being developed at NCEP. It is option whether DBL91 to be saved and exchange among various project, or DBL91 to be treated as temporary file produced in simulation process, depending on size of DBL91 compare to the Nature Run.

7. Nature Run (grib1 reduced Gaussian) 91 level 3-D data (12 Variables) 2-D data (71 Variables) Climatological data Observation template Geometry Location Mask Need complete NR (3.5TB) Random access to grib1 data Need Data Experts Decoding grib1 Horizontal Interpolation DBL91 Need large cpu Need Radiation experts Need Data Experts but this will be small program Running Simulation program (RTM) Post Processing (Add mask for channel, Packing to BUFR) Simulated Radiance Data 7

8. DBL91 Experts for data handling and experts of RTM are different people. • Content of DBL91 • Nature Run data at foot print • 91 level 3-D data (12 Variables) • 2-D data (71 Variables) • Climatological data • All information to simulate Radiances DBL91 The DBL91 also used for development of RTM. DBL91 can be processed for other sampling such as GMAO sampling DBL91 can be processed for new observation It is an option whether DBL91 to be saved and exchange among various project, or DBL91 to be treated as temporary file produced in simulation process. This depends on size of DBL91 compare to the Nature Run. 8

9. Possible template for radiance data Sampling for template for Calibration A. Foot print used by NCEP GDAS B A with mask for channel Let DAS to select channel C Simple thinning 100km etc and simulate cloudy radiance Let DAS to select foot print. D. Sampling based on nature run cloud GMAO can provide template file. save undef or 0 for unused channel does not have to run CRTM • Template for OSSE experiment • A. Instrument designer have to simulate foot print location using orbit generators • Sampling based on Nature Run has to be designed • This is major work to be performed by instrument designers 9

10. Application for DBL91 The DBL91 also used for development of RTM. DBL91 can be processed for other sampling such as GMAO sampling DBL91 can be processed for new observation DWL91 with sampling based on GDAS usage will be posted from NASA portal. In actual simulation, it is optional whether DBL91 to be saved and exchange among various project, or DBL91 to be treated as temporary file produced in simulation process. This depends on size of DBL91 compare to the Nature Run.

11. DBL91 file structure – information for simulating radstat satellites RADSTAT Record used foot print and channel BUFR Observd radiance NATURE RUN Template file with TB (BUFR) Thinsats_rad.gdas.v0905 Template file with QC (BUFR) Thinsats_rad.gdas.mask.v0909 DWL91 (Binary) Thinsats.n_t511.dbl91.v0909 Sat location and geometry Surface type/veg from NCEP Surface and 2D diagnostics quantities from NR 91 level upper air from NR Complete BUFR report Foot print used by NCEPGDAS Available Observed Brightness temperature are saved including channel which was not used by GDAS Complete BUFR report Foot print used by NCEPGDAS QC info for each channel. Values 0 for unused channel

12. Contents of DBL91 binary file From BUFR satellite file 2005.00 004001 YEAR YEAR YEAR 5.00 004002 MNTH MONTH MONTH 1.00 004003 DAYS DAY DAY 21.00 004004 HOUR HOUR HOUR .00 004005 MINU MINUTE MINUTE 3.00 004006 SECO SECOND SECOND 168.67 006002 CLON DEGREES LONGITUDE 59.77 005002 CLAT DEGREES LATITUDE 206.00 001007 SAID CODE TABLE SAT IDENTIFIER 570.00 002019 SIID CODE TABLE SAT INSTRUMENTS 2.00 005043 FOVN NUMERIC BEAM POSITION 1.00 008012 LSQL CODE TABLE LAND/SEA QUALIFIER 52.79 007024 SAZA DEGREE SAT ZENITH ANGLE 59.83 007025 SOZA DEGREE SOLAR ZENITH ANGLE .00 010001 HOLS METER HEIGHT OF LAND SURFACE 813000.00 007002 HMSL METER HEIGHT OR ALTITUDE These variable are sufficient for most of simulation. However further variable required for assimilation will be added from template file. From NCEP Climatology iv=27 ! low vegetation cover iv=28 ! high vegetation cover iv=29 ! low vegetation type iv=30 ! high vegetation type

13. Vegetation type NCEP-GFS vegetation types were saved in DBL91L 1: broadleaf evergreen tree (tropical forest) 2: broadleaf deciduous tree (mid-latitude forest) 3: broadleaf & needleleaf tree (mixed forest) 4: needleleaf evergreen tree (high-latitude pine forest) 5: needleleaf deciduous tree (high-lat pine forest, Siberia only) 6: broadleaf tree with groundcover (savanna) 7: groundcover (grassland) 8: broadleaf shrub with perennial groundcover (desert, dry grassland) 9: broadleaf shrub with bare soil (desert) 10: dwarf tree and shrub with groundcover (tundra) 11: bare soil (desert) 12: cultivations (agricultural land) 13: glacial-ice (Greenland/Antarctica ice sheet only

14. Surface quantities from Nature Run Grib ID 31 1 Sea-ice cover [(0-1)] 32 2 Snow albedo [(0-1)] 33 3 Snow density [kg m**-3] 34 4 Sea surface temperature [K] 44 5 Snow evaporation [m of water] 45 6 Snowmelt [m of water] 50 7 Large-scale precipitation fraction [s] 57 8 Downward uv radiation at the surface [w m**-2 s] 58 9 Photosynthetically active radiation [w m**-2 s] 59 10 Convective available potential energy [J kg**-1] 78 11 Total column liquid water [kg m**-2] 79 12 Total column ice water [kg m**-2] 129 13 Geopotential [m**2 s**-2] 136 14 Total column water [kg m**-2] 137 15 Total column water vapour [kg m**-2] NR 91 levels of: pres cloudcov cloudice cloudh2o ozone mmr temperature spfhumid

15. 141 16 Snow depth [m of water equivalent] 142 17 Stratiform precipitation [m] 143 18 Convective precipitation [m] 144 19 Snowfall (convective + stratiform) [m of water equ 145 20 Boundary layer dissipation [W m**-2 s] 146 21 Surface sensible heat flux [W m**-2 s] 147 22 Surface latent heat flux [W m**-2 s] 148 23 Charnock 151 24 Mean sea-level pressure [Pa] 152 25 Surface pressure {pa] 159 26 Boundary layer height [m] 164 27 Total cloud cover [(0 - 1)] 165 28 10 metre U wind component [m s**-1] 166 29 10 metre V wind component [m s**-1] 167 30 2 metre temperature [K] 168 31 2 metre dewpoint temperature [K] 169 32 Surface solar radiation downwards [W m**-2 s] 172 33 Land/sea mask [(0, 1)] 175 34 Surface thermal radiation downwards [W m**-2 s] 176 35 Surface solar radiation [W m**-2 s] 177 36 Surface thermal radiation [W m**-2 s] 178 37 Top solar radiation [W m**-2 s] 179 38 Top thermal radiation [W m**-2 s] 180 39 East/West surface stress [N m**-2 s] 181 40 North/South surface stress [N m**-2 s]

16. 182 41 Evaporation [m of water] 186 42 Low cloud cover [(0 - 1)] 187 43 Medium cloud cover [(0 - 1)] 188 44 High cloud cover [(0 - 1)] 189 45 Sunshine duration [s] 195 46 Lat. component of gravity wave stress [N m**-2 s] 196 47 Meridional component of gravity wave stress [N m** 197 48 Gravity wave dissipation [W m**-2 s] 198 49 Skin reservoir content [m of water] 205 50 Runoff [m] 206 51 Total column ozone [Dobson] 208 52 Top net solar radiation, clear sky [W m**-2] 209 53 Top net thermal radiation, clear sky [W m**-2] 210 54 Surface net solar radiation, clear sky [W m**-2] 211 55 Surface net thermal radiation, clear sky [W m**-2] 235 56 Skin temperature [K] 238 57 Temperature of snow layer [K] 243 58 Forecast albedo [(0 - 1)] 244 59 Forecast surface roughness [m] 245 60 Forecast log of surface roughness for heat

17. 91 level data Pressure (Pa) Cloud cover (0-1) Cloud ice water content (kg/kg) Cloud liquid water content (Kg/kg) Ozone mass mixing ratio (kg/kg) Temperature (K) Specific Humidity (Kg/Kg) 91 levels are defined http://www.ecmwf.int/products/data/technical/model_levels/model_def_91.html Program to read DBL91 and list of surface data are posted from http://www.emc.ncep.noaa.gov/research/JointOSSEs Under “Data Distribution”

18. Simulation of HIRS3 radiance from NOAA16 from DBL91 Simulation of HIRS3 radiance from NOAA16 from DBL91 CRTM 1.2.2 posted from JCSDA web site was used for simulation DBL 91 was generated at foot print used by NCEP GDAS All information in GDAS bufr files are copied to simulated radiance file. Channel which are not used by GDAS was marked in diag file. Masked out to generate masked radiance data.

19. Simulated where Channel 4 is used Observed radiance where any channel is used Long wave Simulated where any channel is used

20. Radiance Data Simulation strategies at NCEP Step 1. Thinning of radiance data based on real use ► GOES and SBUV are simulated as they are missing from GMAO dataset. ► Prepbufr is simulated based on CDAS prepqc distribution. ► AMSUA, AMSUB, GOES data have been simulated for entire T511 NR period. ► DBL91 for AMSUA, AMSUB, GOES, HIRS2, HIRS3, AIRS,MSU are generated at foot print used by NCEP operational analysis and will be posted from NASA portal. ► Some limited calibration and validation will be conducted by NCEP and NESDIS for their own use. However, users are expected to perform their own calibrations and validation. Step 2. Simulation of radiance data using cloudy radiance Cloudy radiance is still under development. Accuracy of GMAO data sampling will be between Step1 and Step2.