80 likes | 165 Vues
EOVSA Catalog Design and VSO Integration D. Zarro. EOVSA Kickoff Meeting 24-26 September 2012. Build on IDL Database. Heritage: IUE, UIT, SOHO/CDS, Hinode /EIS IDL-based, with supporting routines in SSW OS- and Platform-independent (Windows, Unix/Linux, Mac OS X ).
E N D
EOVSA Catalog Design and VSO IntegrationD. Zarro EOVSA Kickoff Meeting 24-26 September 2012
Build on IDL Database • Heritage: IUE, UIT, SOHO/CDS, Hinode/EIS • IDL-based, with supporting routines in SSW • OS- and Platform-independent (Windows, Unix/Linux, Mac OS X)
CatalogDesign Considerations • What data products will be searched (images, spectra, lightcurves)? • What metadata will be stored in catalog (observing ids, engineering parameters)? • What metadata will be searchable (e.g. time, frequency)?
Example EIS Catalog entries #items TL_ID I*4 Timeline ID from planning software OBSTITLE C*80 Observing program title TARGET C*40 Target of observation STUD_ACR C*40 Study Acronym OBS_DEC C*240 Description of observation OBS_NUM I*2 Sequential number of observation JOP_ID I*2 Joint Observing Program ID. EIS_SC C*120 Description of EIS science objective OBSERVER C*60 Name of chief observer DATE_OBS R*8 Date/time of beginning of observation DATE_END R*8 Date/time of end of observation NOAA_NUM I*2 NOAA Active Region Number (from planning software) NOAA_AR I*2 NOAA Active Region Number (calculated) SCI_OBJ C*80 Science objective XCEN R*4 Actual pointing of center of image in solar X YCEN R*4 Actual pointing of center of image in solar Y FOVX R*4 Width of field of view in solar X FOVY R*4 Width of field of view in solar Y DATE C*80 Date the FITS file was written FILENAME C*80 Name of FITS file study data was retrieved from.
CatalogRequirements • Archive of searchable data products • Catalogwriter/updater • Catalogreader/browser
CatalogPopulation Pipeline Continuous process: Extract metadata from data file headers. Populate catalogwith metadata. Push catalogto SSW. Pull search entries into VSO. => Search catalogvia VSO clients and/or IDL directly.
IDL> list_eis_main,’1-may-11’,’2-may-11’,obs ** Structure EIS_MAIN_LIST, 28 tags, length=304, data length=296: TL_ID LONG 21996 OBSTITLE STRING 'HOP 185. AR magnetism with SST. TARGET STRING 'Active Region ' OBS_DEC STRING 'Switch to returning AR on NE limb. JOIN_SB STRING 'E,S,X ' OBS_NUM INT 0 JOP_ID INT 185 STUDY_ID LONG 360' EIS_SC STRING 'UNKNOWN DATE_OBS DOUBLE 1.6830148e+09 DATE_END DOUBLE 1.6830176e+09 SCI_OBJ STRING 'AR XCEN FLOAT 362.712 YCEN FLOAT -260.052 FOVX FLOAT 39.9360 FOVY FLOAT 120.000 DATE STRING '2011-05-07 FILENAME STRING 'eis_l0_20110502_080935.fits.gz • SSW/IDL database reader returns data structures with fields that match metadata entries
VSO/IDL client returns selected metadata and file URL locations IDL> files=vso_search('1-may-08','10-may-08',inst='eis',/url) Records Returned : SDAC_EIS : 206/206 http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_054833.fits.gz http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_055014.fits.gz http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_114027.fits.gz http://sdac.virtualsolar.org/data/hinode/eis/level0/2008/05/01/eis_l0_20080501_120700.fits.gz