1 / 4

Real-time Telemetry Data Processing and Management System

A comprehensive system for immediate processing, storage, and retrieval of real-time telemetry data. Includes mechanisms for quicklook, level-0 and level-1 processing, transient and final observables, and HK data.

kimdeborah
Télécharger la présentation

Real-time Telemetry Data Processing and Management System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Level-0 HSB image Immediate or Retransmitted, permanent Immediate DDS JSOC-OPS quicklook, Temp, 5d Level-0.1 JSOC IOPS Mech Tables Process ISP and Lookup info from upload tables Level-0 HK HSB HK e.g. ISP DDS Level 1.0q Flat fielded and bad pixel list included, Temp 1d HK 1553 Other APID Level-0 HK via MOC Select nearest or average Level-0.3 JSOC IOPS Command logs if needed Level 1.5q Quicklook Observables, Temp, 5d FDS series, temp FDS predict data dayfiles MOC Few minutes lag Level 1.5p Most complete observables, Links to best avail MOC FDS final data dayfiles FDS series, temp Level 1.5 Final Observables, permanent MOC HK 1553 APID dayfiles Level-0 HK, temp Level-0.5 Level 1.0 Flat fielded and bad pixel list included, Temp 60d MOC SDO HK dayfiles From MOC SDO HK lev0 temp Day lag

  2. hmi_lev0_1 lev0.1_newest = hmi.lev0_1[:#$].fsn last_done = hmi.lev0[lev0.1_newest].recnum last_avail = hmi.lev0[max recnum].recnum for (rec=last_done+1, rec<=last_avail, rec++) new_fsn = hmi.lev0[:#rec].fsn waitfor hmi.lev0_ISP[new_fsn] hmi_make_lev0.1 new_fsn sleep 60 then repeat hmi_make_lev0.1 Arg: fsn Copy keys, add ISP keys, lookup mech values, link to image segment mech tables * hmi.lev0_ISP is the current version from e.g. hmi.lev0_0445_<version> or from e.g. hmi.lev0_<other isp apid>_<version> hmi.lev0[fsn] Key: fsn Seg: permanent, 30d hmi.lev0_ISP[fsn]* Key: fsn Seg: none hmi.lev0_1[fsn] Key: fsn Seg: link to hmi.lev0[fsn] Sample PUI commands

  3. hmi_lev0_3 hmi_gather_0.3HK Arg: fsn, time Extract time averages Or samples of a list Of telem points, store By FSN hmi.lev0_HK_XXX[pktime] Key: packet_time Seg: none Transient Series maybe hmi.lev0_HK_XXX[fsn]* Key: fsn Seg: none Transient Series FDS data Hmi.lev0_1[fsn] Key: fsn Seg: link to hmi.lev0[fsn] Hmi.lev0_3 Key: fsn Seg: link to hmi.lev0[fsn] lev0.3_newest = hmi.lev0_3[:#$].fsn last_done = hmi.lev0_1[lev0.3_newest].recnum last_avail = hmi.lev0_1[max recnum].recnum for (rec=last_done+1, rec<=last_avail, rec++) new_fsn = hmi.lev0_1[:#rec].fsn new_time = hmi.lev0_1[:#rec].t_obs hmi_gather_0.3HK new_fsn new_time hmi_gather_0.3FDS new_fsn new_time hmi_make_lev0.3 new_fsn sleep 5 then repeat # throttled by lev0.1 hmi_make_lev0.3 Arg: fsn Copy keys, add HK keys, add FDS keys, link to image segment * hmi.lev0_HK_XXX[pktime] is created from the 1553 real time stream (LMSAL) for a given APID. Data is collected from this series, indexed by time, to make a transient record indexed by FSN containing sampled or running mean values of various telemetry points, e.g. CCD temp, oven temp, etc. hmi_gather_0.3FDS FDS temp FDS data processing similar to HK_XXX data

  4. Issues / questions • Do not know how to make temp records where they are logically part of a continuing series but only need to survive a few minutes or days. If the series is just kept and expands then we have a number of growing series, some of which can be large, which contain records not expected to be ever used after the first access. “delete records” would be nice here. {this is what happens with non-archived records with small retention times!} • Do not know blocking of lev0.1 or higher in terms of slots per SU. Would seem reasonable to make c. 1-minute chunks since that would not increase the latency much. But we should leave as 1 so each image is stand alone as it arrives. • Do not know how to get the temporary series from real time 1553 HK data. • In e.g. lev0.3 should the ancillary processing be caused by the need or run asynchronously and waited for by PUI as the sample for ISP in lev01. If waited for, how to deal with timeouts.

More Related