1 / 16

phase 3 workflow & tools

This document outlines the Phase III workflow for the European Southern Observatory's (ESO) Public Surveys, detailing the process from program creation to release publication. Key components include managing program permissions, creating collections, preparing and validating data, and ensuring proper archiving of releases. A focus is placed on validation processes, including the use of the Java validator and secure FTP for data uploads. It serves as a comprehensive guide for principal investigators (PIs) and collaborators in managing their survey data effectively.

chaney
Télécharger la présentation

phase 3 workflow & tools

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. phase 3 workflow & tools S. Zampieri V. Forchi P. Nunes D. Sforna M. Klein Gebbinck F. Sogni 1 ESO Public Surveys Phase III Workshop30.11.2010

  2. workflow 1. Create Phase 3 Program 2. Manage Program Permissions 3. Create Collection and Release 4. Prepare Data 5. Validate Data 6. Upload Data 7. Close Release 8. Validate Release (automatic) 9. Validate Release (scientific) 10. Archive Release 11. Publish Release ESO/EDP PI PI/COI Legend:

  3. start

  4. login

  5. manage programs

  6. manage program permissions

  7. create new collection

  8. manage collections

  9. create new release

  10. prepare data release science data: *.fits, *.fits.fz, PRODCATG ancillary data: *, associated to science data scientific meta-data: FITS keywords associations: ASSONi, ASSOCi provenance: PROVi description: release-description.tar See Phase 3 User Documentation See Jörg’s presentation

  11. validate data release • java –jar validator.jar –r <dir> \ • -m create|update • Output • Summary: console (OK | ERROR) • Table of contents: validator.toc • Validation errors: validator.error • Application log messages: validator.log

  12. upload data lftp –u user,pass phase3ftp.eso.org cd program/collection/release mput * Requires secure FTP client (FileZilla, lftp, etc.) Standard FTP doesn’t work

  13. close release Only PI can close a release Triggers automatic validation process FTP area becomes unavailable for the user

  14. release states 1. Open 2. Closed PI/COI 3a. Valid 3b. Error ESO/SYSTEM 4. ToBeArchived 5. Archived ESO/EDP

  15. view release contents (only for archived releases) download release description file

  16. updating or superseding a release To update a release: 1. Download release description file CONTENT.ESO 2. Create CHANGES.USER DELETE file REPLACE file 3. Validate -m update 4. Upload data + CHANGES.USER

More Related