1 / 19

Methods and related tools

Methods and related tools. Handling data with BEST Producing ICDs with SCRIBE. Handling data with BEST. Denis Minguillon - CNES : DCT/PS/VDO denis.minguillon@cnes.fr. Brief history(1) : the problem to solve. Problem to solve Make exchange of data easier

ivor-davis
Télécharger la présentation

Methods and related tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Methods and related tools Handling data with BEST Producing ICDs with SCRIBE

  2. Handling data with BEST Denis Minguillon - CNES : DCT/PS/VDO denis.minguillon@cnes.fr

  3. Brief history(1) : the problem to solve • Problem to solve • Make exchange of data easier • Syntax : It is hard to read data which format on the medium is not precisely defined • Semantics : it is hard to use data which semantics is not described • Make data samples available earlier for software integration • Real data comes late in general. Simulation can provide test data • Early data allows to facilitate agreement between producer and consumer • Avoid writing the same tedious software to read and write data • New data implies writing new input/output software • Imprecise data description makes this kind of software difficult to work out

  4. Brief history(2) : different solutions • Known solution • Standard data formats : • FITS for astronomy • PDS for planetary data • CDF for space science • etc.... • Specific tools are generally provided • CNES proposal to CCSDS • Standard languages for the description of any kind of data : • EAST for data syntax (CCSDS + ISO standard since 1997) • DEDSL/XML for data semantics (CCSDS + ISO standard since 2000) • Related tools (OASIS + EAST libraries --> BEST workbench since 2005)

  5. Handling data with BEST Handling includes • Design • Describe • Simulate • Write • Check • Read • Print ..... all with the same tool !!!

  6. Design and describe Design : Use of OASIS modeller as soon as possible in the data life cycle : - Avoid informal description to be translated later into formal - Early description allows TBD everywhere needed - Description easy to update as soon as new information is available Description : - The tool checker points what is missing to complete the description - The final description ensures completeness and rigor

  7. XML schema File descriptions USER Design and describe(2) OASIS Design or description through a friendly MMI 3 output formats : • EAST for syntax • DEDSL for semantics • XML schemas for XML data MMI Data dictionary DEDSL/XML EAST File descriptions NO language knowlegde required !!!

  8. EAST File descriptions Simulate USER Simulation can be • Random : • The tool chooses values • Calculated • Formulas assigned to the wished fields • Java functions assigned to the wished fields • Mixed • Some values at random • Some values calculated • Some forced "by hand" MMI Simulated Data Checks can be switched off to generate erroneous test cases

  9. API EAST LIBRARY Write USER APPLICATION EAST File descriptions WRITE ORDER = NAME + VALUE The use of the EAST library makes the user application insensitive to most of the data changes Data formatting Data

  10. Check or print Error report USER DATA CHECKER EAST File descriptions MMI Data data name + value ASCII DUMP The checker can be systematically used for any data exchange in the framework of a project.

  11. API EAST LIBRARY Read USER APPLICATION Value EAST File descriptions REQUEST BY NAME The use of the EAST library makes the user application insensitive to most of the data changes Value Data

  12. "Success Story" • The EAST technology has been used by many projects in its previous version (before BEST) : • SPOT (image metadata) • CDPP (telemetry of many experiments) • SSALTO (data products writing and reading) • PHARAO (telemetry and telecommand simulation) • Hélios (all interfaces reading and writing) • A few projects already adopted BEST • CDPP (migrating from previous tools) • ATV (telemetry simulation) • SOSIE (telemetry simulation)

  13. LINKS • The BEST workbench can be downloaded as follows : • http://debat.c-s.fr • Menu "Product" option "Download" • Available for Windows, Linux, Solaris

  14. Producing ICDs with SCRIBE Béatrice Larzul - CNES : DCT/PS/VDO beatrice.larzul@cnes.fr

  15. The problem to solve • XML schemas are the contractual reference • XML schemas are not human readable • How to get a readable documentation strictly equivalent to the XML schema

  16. Data dictionary DEDSL/XML XML schema File descriptions The solution : SCRIBE OASIS OASIS SCRIBE html ICD Other processes (non BEST)

  17. SCRIBE SCRIBE : step 1 - document model preparation USER model_n.xml model_1.xml MMI SCRIBE is first used to produce the model(s) to be applied to the various data descriptions to produce the corresponding ICDs.

  18. Data dictionary DEDSL/XML SCRIBE : step 2 - ICD generation • Once a model is ready it can be applied to several data descriptions (DED/XML or XML schema) to produce one ICD per description. • Several models can also be applied to the same description to produce different kinds of document (more or less detailed, or differently organized) • If the content of a description changes it is very easy to get the new version of the ICD just by running again SCRIBE with the same model applied to the new content. html ICD = + model.xml + = DOCUMENT CONTENT "LOOK"

  19. SCRIBE : ICD examples • CDPP (Plasma Physics Data Centre) • same model applied to many descriptions • Mission INTERBAL - Hyperboloid experiment • Mission INTERBAL - Coral experiment • PHARAO telemetry • different models applied to the same description • Telemetry Packet structure • Cross reference • PLEIADES • different models applied to different descriptions • Dictionary • Interface

More Related