90 likes | 217 Vues
The EOVSA (Expanded Owens Valley Solar Array) prototype software review outlines the primary goal of providing software support for hardware performance evaluation, alongside secondary goals for solar observing and software development testing. Key functionalities include real-time data processing and calibration through the Digital Packaging Processor (DPP), which transforms raw correlator output into Miriad-compatible formats. The document also details ongoing projects, data handling, and system maintenance tasks, emphasizing the importance of calibration and data analysis methods in solar observations.
E N D
EOVSA Data and Database System Gordon Hurford and Jim McTiernan EOVSA Prototype Readiness Review 24-Sept-2012
EOVSA Prototype Software • Primary goal • Software support for evaluating hardware performance • Secondary goals • Support for occasional solar observing • Test bed for development of full-array software
1 1 • Role of Digital Packaging Processor • To filter, average, partially calibrate and convert raw correlator output into a Miriad-compatible format that is written to Interim Data Base • Real time, irreversible processing
OVSA Expansion Software and Data Handling - Kickoff Meeting 23-Oct-10 GH/JM+NJIT OVSA-specific CASPER-based Miriad-based RHESSI-based Monitor and Control Operator DSPU Antennas, receivers, analog subsystems NJIT Data Packaging Processor Interim Data Base Data selection, averaging, reformatting & calibration Burst identification Tohban Light curve, spectra display Archive Databases ~6 GB/day Light curve, spectra generation Map generation Map display Quick look & metadata products Hi-Level Analysis IDL Shell Browser Users
Elements of Prototype Software • DPP software to generate Miriad format interim database • Scripts for conversion of interim database to application databases and useful data products • Scripts and modules for calibration analyses and data displays • Selection, acquisition and integration of data processing hardware platforms
EOVSA Prototype – DPP Software Tasks • Ingestion of correlator output • Access of relevant parameters from state frame • Suppression of RFI bands identified using predetermined subbands and spectral kurtosis • (Generation of and display tools for RFI database) • Application of predetermined complex gains • Gains applied at science channel level • Assumes subband level gains applied in correlator • Does nominal correction for attenuator state • Does fine delay corrections (based on Tn, T(n+1)…. • Transfer of RFI and calibration tables from ACC – method? • Output as Interim Database in Miriad format Status: Mostly done Still to be done
Scripts and modules • Conversion of selected scans to calibration and utility data bases • Analysis of calibration data base (Miriad scripts) • Phase and amplitude calibration • Closure phase calculation and display • Baseline calibration • Delay center calibration • Custom modules (NJIT) • Basic data displays • Spectra for individual baselines and/or antennas • Light curves • Dynamic spectra • ???? Support for frequency-synthesis 1-D mapping
Other items (or not) • Basic display of non-engineering parameters • Display Miriad header parameters • Basic index to data • Basic database management • No IDL shell (initially) for prototype analysis • No direct display of stateframe parameters
DPP Hardware Platform • Unit with 4 quad core processors • 2 for input handling • 1 for communications with ACC • 1 for handling state frame • N for packet processing at the subband level • 1 for spectral processing at the science band level • 1 for formatting and output • Single unit located at OVRO ?? • Assumes software development can be done with existing processors • No backup for unit failure • How to support remotely ?? • Linux operating system – flavor? • Next step - Identify and order