Science Data Processing Mission CDR Tim Quinn University of California - Berkeley

1. Science Data Processing • Mission CDR • Tim Quinn • University of California - Berkeley

2. Overview • Requirements • Project Data Management Plan (PDMP) • Data flow diagram • Processing timeline • Ground based data flow • Products • Data access • Data analysis software • Data archiving and distribution

3. Requirements

4. Requirements

5. Project Data Management Plan • Initial draft – Dec03 • Current draft – Jun04 • Describes activities associated with the flow of THEMIS scientific data from collection on the probe through production, distribution and access, and archiving of data and data products. Also includes extensive ground based imager and magnetometer measurements taken by 20 Ground Based Observatories (GBO's) spread across Alaska and Canada, and 10 Education and Public Outreach (E/PO) magnetometers spread across the northern continental United States.

6. Data Flow Diagram

7. Processing Timeline

8. Ground Based Data Flow

9. Data Products • 24 hour instrument data Common Data Format (CDF) files • 30 Gbytes/year/probe • Instrument data calibration files (CDF) • Orbit data files (CDF) • GBO data and calibration files • All sky imager (ASI) • 220-290 Gbytes/year/site • Ground magnetometer (GMAG) • 757 Mbytes/year/site • E/PO GMAG data and calibration files • 757 Mbytes/year/site

10. Data Products • Key parameter data (CDF) • Categories include: • Keograms (GBO Image Data Overview). • Auroral Electrojet Indices (GBO Magnetometer Data Overview). • E/PO Ground Magnetometer Data Overview. • P1 instrument data (Probe Overview). • P2 instrument data “ • P3 instrument data “ • P4 instrument data “ • P5 instrument data “ • Mission overview plot • Probe instrument key parameter data includes (all provided in physical units and at 3-s resolution):  • 3-D magnetic field, DC waveforms and AC spectrograms • 3-D electric field, DC waveforms and AC spectrograms • Core (10eV-40 keV) ion density and velocity moments, temperature and pressure tensor, energy spectrogram • Core (5 eV-30 keV) electron temperature and pressure tensor, energy spectrogram • Energetic ion and electron fluxes

11. Data Access • File Search Tool. • Part of UCB Data Analysis Software Package • Local and remote access to all data • Search by probe, GBO site, E/PO GMAG site, and date • Web Interface • Instrument data CDF files • Key Parameter Data • GBO data • E/PO GMAG data • Space Physics Archive Search and Exchange (SPASE) collaboration • International consortium of space physics data archive groups interested in making the data search and retrieval process easier for the space physics community • Uniform method to search and retrieve data from many different archives

12. Data Analysis Software • UCB will produce, maintain, and distribute a Data Analysis Software package to Co-I’s and general public (via website) • For instrument data, software exists in the form of an extensive library of IDL routines and the Science Analysis Tool (SDT) • Single probe analysis software (FAST, WIND) • Multi-point analysis software (ISTP, CLUSTER II) • Ancillary data software • Event modeling • For ASI/GMAG, tools (IDL routines) already exist for accessing, evaluating, and comparing ground observatory data with space-borne measurements (Adopted from existing NORSTAR and CANOPUS ground networks) • Software training sessions planned

13. Data Archiving and Distribution • Archiving • The following data and products will be permanently archived on disk drives and DVD storage • VC1 and VC3 files from the ground stations • 24 hour LZP files • 24 hour instrument data/calibration/orbit CDF files • GBO data • E/PO GMAG data • Distribution • DVD’s containing 24 hour instrument CDF’s, GBO, and E/PO data will be delivered to the Co-I’s on a monthly basis • Key Parameter Data to NSSDC