osn archive: current status and future implementations josé miguel ibáñez instituto de...

OSN Archive: Current status and future implementations

José Miguel Ibáñez

Instituto de Astrofísica de Andalucía - CSIC

Sierra Nevada Observatory

First SVO Workshop on data publishing in the Virtual Observatory

Outline

• Observatory• Instruments• Data Archive

• Architecture• Current status• Future implementations

• Conclusions

Observatory• OSN: Observatorio de Sierra Nevada (www.osn.iaa.es)

• Observatory located at the ski resort of Sierra Nevada (2896m), Granada (Spain)

• Founded in 1981 by IAA-CSIC• Instrument Control Systems developed and maintained by IAA staff

• Optics maintained by IAA staff• Remote, In-situ and Service observing• Production: ~20 papers/year

Hard working conditions

Instruments• T150cm

• CCD• VersArray 2048B - 2k x 2k• FOV ~ 8’ x 8’

• Filtros: Johnson, Strömgren, Gunn, Molecular, Halpha, Emission, Cometary

• Albireo Spectrograph (CCD 2kx2k) • Slit, Argus (IFU)• 5 Diffraction Gratings • Under upgrade (GAIA RVS duplicator)

Instruments (II)• T90cm

• CCD • VersArray 2048B - 2k x 2k• FOV ~ 13’ x 13’

• Filtros: Johnson, Strömgren, Gunn, Molecular, Halpha, Emission, Cometary

• Strömgren photometer• simultaneous observations of the bands uvby

• bands n and w Crawford Hb photo-metric system

Instruments (III) – to be archived

• T60cm• BOOTES-IR (under development) – GRBs alerts

• T35cm• CCD Kodak 4008 x 2672

• FOV ~30’ x 20’

Data Archive - www.osn.iaa.es

Data Archive Architecture• Lector

• Automatically retrieve FITS files from the instruments (daily)• Parse headers• FITS renamed YYYYMMDD.HHMMSS.<filaname>.fit • Insert data into BD• User subscription and notification• Generate report

• GUI• Web interface• Queries and data download (public & proprietary)• Image & header preview

Architecture

E-R Database

ADA project

• ADA (Archivo de Datos Astronómico)• Funded by project P07-FQM2864 of Junta de Andalucía

• Started March 2008• First release: Sep 2009• Raw data (science & calibrations)• Collaboration with company

Main functionalities

• Raw data (science & calibrations)• Easy to add new instruments Edit XML config file• Automatic user subscription OBSERVER keyword• Public & Proprietary data• Proprietary period:

• Metadata (headers): used defined, default to 1.5 year• Data (images): used defined, default to 1.5 year

• Name Resolver (Sesame service)• Outputs: html, csv, VOTable• Download: Tarball

Development tools• Linux OS: Debian 5• MySQL DB• Apache Tomcat 6• GUI: Spring Framework v2.5.6 + jQuery 1.3.x

Computer system• 2 x CPU Xeon E5430 @2.66 GHz (2 x 4 cores)• 16 GB RAM• 5 TiB RAID 5+1• Linux Debian 5.05• @ IAA• Radio-link OSN-IAA

Web interface: query

Web interface: results

Current status: numbers• 60 users• 2013: 210 GB / 68k files• Total: 786 GB / 260k files)

Archivo Datos OSN (# Ficheros)

0

10000

20000

30000

40000

50000

60000

70000

2009 2010 2011 2012 2013

Año

# Fi

cher

os

RoperT150

RoperT90 (Dic-2012)

Albireo

Archivo datos OSN (Gigabytes)

0

50

100

150

200

250

2009 2010 2011 2012 2013

Año

# G

igab

ytes

RoperT150

RoperT90 (Dic-2012)

Albireo

Future developments• Update OS: migration to Debian 7• Add Strömgren data (photometric tables) convert to

FITS• Improvements to Web interface

• Query optimization• Improvement of user data search (by campaign ID)• Improvement of file download process (dataset > 3000 files)

• Astrometric calibration (WCS): Astrometry.net• VO services data publication

• ConeSearch• SIAP (Simple Image Access Protocol)• SSAP (Simple Spectrum Access Protocol)

Future++ developments• Make available to the community observations taken

before September 2009 (2002-2009): CD/DVDs ingestion• Reduced data Pipelines

• Spectra• Image• Photometric catalogs

VO

High level data products

Questions ?