ROSA – ROSSA Validation results - PowerPoint PPT Presentation

slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
ROSA – ROSSA Validation results PowerPoint Presentation
Download Presentation
ROSA – ROSSA Validation results

play fullscreen
1 / 79
ROSA – ROSSA Validation results
79 Views
Download Presentation
luther
Download Presentation

ROSA – ROSSA Validation results

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. ROSA – ROSSA Validation results R. Notarpietro, G. Perona, M. Cucca riccardo.notarpietro@polito.it

  2. INPUT DATA • COSMIC Data • - COSMIC 1: 75 events (10 rising) well distributed in time (2 days for each 06-07 season) and space - COSMIC 2: data related 31/12/2007 (1120 events) CHAMP Data - 120 setting events related to 22/01/2004 observations:

  3. COSMIC 2: data related 31/12/2007 (> 1200 events) INPUT DATA * These figures are related to data couples compared at different levels after outliers removal R S TOT* 90° 65°  North Polar regions 2456 80 65° 35°  North Temperate regions 56188 244 35° 35°  Tropics 68336 404 35° 65°  South Temp. regions 59149 208 1747 64 65° 90°  South Polar regions

  4. 1 Validation considering Third Level Benchmarks (output of other RO SWs) COSMIC Data CHAMP Data We can quantify differences due to different algorithm implementations (CHAMP Data, COSMIC Data or future ROSA-ROSSA products ARE NOTFirst Level Benchmark) This analysis has been carried out even if it is not an absolute validation of ROSA-ROSSA software CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA

  5. CHAMP Data 22/01/04 1 Orbits Excess phases COSMIC 1/2 Data 2006/2007 Ne(h) Validation considering Third Level Benchmarks (output of other RO SWs) COSMIC 2 Data 31/12/2007 stratosph. optimized (a) iono-free n(h) COSMIC 2 Data 31/12/2007 T(h) Specific humidity (h) pwet(h)

  6. 2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) TRSA(h) TCOS(h) WVRSA(h) WVCOS(h)

  7. 2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 ECMWF Re-analysis spatially and temporally co-located following Tangent Points CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h) TRSA(h) TCOS(h) TECM(h) WVECM(h) WVRSA(h) WVCOS(h)

  8. 2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 ECMWF Re-analysis spatially and temporally co-located following Tangent Points CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h) TRSA(h) TCOS(h) TECM(h) WVECM(h) WVRSA(h) WVCOS(h)

  9. 2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) Dati COSMIC 2 31/12/2007 ECMWF Re-analysis spatially and temporally co-located following Tangent Points CDAAC (COSMIC) ISDC (CHAMP) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h) TRSA(h) TCOS(h) TECM(h) WVECM(h) WVRSA(h) WVCOS(h) Outliers identification and removal and Mean Fractional Error evaluation

  10. Statistic definition

  11. Statistic definition

  12. Statistic definition

  13. Statistic definition mean Outlier Identification through T-Student test ( 3 threshold) and rejection Mean + Std Mean - Std

  14. OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phase profiles filtering

  15. OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phase profiles filtering

  16. OPEN PROBLEMS WITH THE FIRST ROSA-ROSSA RELEASE Cosmic Raw Excess-phases filtering Statospheric Bending optimization (we are actually using CIRA-Q climatology; ROSA-ROSSA VE will adopt data coming from Numerical Weather Prediction Models) Wave Optics techniques for Bending angle extraction in low troposphere (foreseen for ROSA-ROSSA VE). Actually DG_ATMO is validated giving COSMIC data in input. Electron Density profile extraction through ROSA observations is critical given ROSA configuration and observation scheduling

  17. 1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) BENDING LEVEL COS(a) RSA(a)

  18. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Rising Setting North Pole North Temperate Tropics South Temperate South Pole Number of events

  19. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole

  20. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole

  21. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole

  22. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA (a) North Pole North Temperate Tropics South Temperate South Pole

  23. 1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) REFRACTIVITY LEVEL NCOS(h) NRSA(h)

  24. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA N(h) North Pole North Temperate Tropics South Temperate South Pole

  25. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA N(h) North Pole North Temperate Tropics South Temperate South Pole

  26. 1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) TEMPERATURE and humidity LEVEL DG_ATMO TCOS(h) TRSA(h) qCOS(h) qRSA(h) eCOS(h) eRSA(h)

  27. DG_ATMO • DG_ATMO is a 1-D VAR scheme developed for retrieving temperature, humidity and pressure (only as dependent variable) for the ROSA observations. • The Background profile is extracted by NCEP long-term mean (365 days) reanalysis. • Simplified version of error covariance matrices

  28. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA T(h)

  29. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA e(h)

  30. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA q(h)

  31. DG_ATMO • Our scheme differs from the COSMIC one. • Formulation of hypotheses to develop the 1D-VAR scheme • Formulation of error covariance matrices • Background fields • Results are not any different!

  32. 1 CDAAC (COSMIC) Validation considering Third Level Benchmarks (output of other RO SWs) ELECTRON DENSITY LEVEL DG_DELN NeRSA(h) NeCOS(h)

  33. DG_DELN • The DG_DELN Data Generator evaluates the electron density profile in the ionosphere, using the Onion Peeling algorithm. • Since the ray bending in the ionosphere is small enough, the straight-line propagation from GPS to LEO satellites has been assumed for the GPS signals. • As required by the inversion technique adopted, the spherical symmetry for the electron density of the ionosphere has been assumed. • Excess phase measurements at L1 and L2 GPS frequencies during one occultation event are used to compute the TEC in the shell determined by the LEO orbit (calibrated TEC).

  34. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  35. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  36. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

  37. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA

  38. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  39. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  40. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  41. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  42. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  43. COSMIC DG_DELN SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  44. average average +/- st.dev. SW ROSA-ROSSA 3.0 VALIDATION VS COSMIC DATA Ne(h)

  45. 2 Validation considering Second Level Benchmarks (ECMWF Re-analysis) REFRACTIVITY LEVEL ECMWF Re-analysis spatially and temporally co-located CDAAC (COSMIC) ROSA-ROSSA NRSA(h) NCOS(h) NECM(h)

  46. SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF RISING RISING North Pole North Temperate Tropics South Temperate South Pole Number of events

  47. 50 40 Height [km] 30 25 16 12 10 7 3 0 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF N(h) RISING North Pole North Temperate Tropics South Temperate South Pole

  48. 50 40 Height [km] 30 25 16 12 10 7 3 0 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF N(h) RISING North Pole North Temperate Tropics South Temperate South Pole

  49. SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF SETTING North Pole North Temperate Tropics South Temperate South Pole Number of events

  50. 50 40 Height [km] 30 25 16 12 10 7 3 0 SW ROSA-ROSSA 3.0 VALIDATION VS ECMWF N(h) SETTING North Pole North Temperate Tropics South Temperate South Pole