phase 3 workflow & tools
DESCRIPTION
phase 3 workflow & tools. S. Zampieri V. Forchi P. Nunes D. Sforna M. Klein Gebbinck F. Sogni. 1 ESO Public Surveys Phase III Workshop 30.11.2010. workflow. 1. Create Phase 3 Program. 2. Manage Program Permissions. 3. Create Collection and Release. 4. Prepare Data. 5. Validate Data. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/1.jpg)
phase 3 workflow & tools
1 ESO Public Surveys Phase III Workshop 30.11.2010
1
S. ZampieriV. ForchiP. NunesD. SfornaM. Klein GebbinckF. Sogni
![Page 2: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/2.jpg)
2
workflow
1. Create Phase 3 Program
2. Manage Program
Permissions
ESO/EDP PI PI/COI
3. Create Collection
and Release
4. Prepare Data
5. Validate Data
6. Upload Data
7. Close Release
8. Validate Release
(automatic)
9. Validate Release
(scientific)
10. Archive Release
11. Publish Release
Legend:
![Page 3: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/3.jpg)
3
start
![Page 4: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/4.jpg)
4
login
![Page 5: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/5.jpg)
5
manage programs
![Page 6: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/6.jpg)
6
manage program permissions
![Page 7: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/7.jpg)
7
create new collection
![Page 8: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/8.jpg)
8
manage collections
![Page 9: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/9.jpg)
9
create new release
![Page 10: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/10.jpg)
science data: *.fits, *.fits.fz, PRODCATG
ancillary data: *, associated to science data
scientific meta-data: FITS keywords
associations: ASSONi, ASSOCi
provenance: PROVi
description: release-description.tar
See Phase 3 User DocumentationSee Jörg’s presentation
10
prepare data release
![Page 11: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/11.jpg)
java –jar validator.jar –r <dir> \ -m create|update
OutputSummary: console (OK | ERROR)Table of contents: validator.tocValidation errors: validator.errorApplication log messages: validator.log
11
validate data release
![Page 12: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/12.jpg)
lftp –u user,pass phase3ftp.eso.org
cd program/collection/release
mput *
Requires secure FTP client (FileZilla, lftp, etc.)
Standard FTP doesn’t work
12
upload data
![Page 13: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/13.jpg)
13
close release
Only PI can close a release
Triggers automatic validation process
FTP area becomes unavailable for the user
![Page 14: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/14.jpg)
14
release states
1. Open 2. Closed
3a. Valid 3b. Error
4. ToBeArchived
5. Archived
PI/COI
ESO/SYSTEM
ESO/EDP
![Page 15: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/15.jpg)
15
view release contents (only for archived releases)
download release description file
![Page 16: phase 3 workflow & tools](https://reader034.vdocuments.net/reader034/viewer/2022051517/56814544550346895db21165/html5/thumbnails/16.jpg)
16
updating or superseding a release
To update a release:
1. Download releasedescription fileCONTENT.ESO
2. CreateCHANGES.USERDELETE fileREPLACE file
3. Validate-m update
4. Upload data +CHANGES.USER