dm services and software status (and evolution) · dm services and software status (and evolution)...

LSSTCommissioningPlanReview•January2017LSSTCommissioningPlanReview•January2017 1

DMServicesandSoftwareStatus(andEvolution)

Kian-TatLim

DMSystemArchitect

LSSTCommissioningPlanReviewJanuary24-26,2017

LSSTCommissioningPlanReview•January2017

Outline

− DMSciencePipelinesforCommissioning

− LSSTSciencePlaEormforCommissioning

− DataProductsandProcessingServices

− ServiceEvoluHon

− ServiceTesHng

− HardwareandNetworkEvoluHon

2


DMSciencePipelinesforCommissioning

− DMwillprovidesufficientfuncHonalitytosupporthardwarewhenitisdelivered:

– TheAuxiliaryTelescope:

• InstrumentSignatureRemoval(ISR),spectrophotometry,atmosphericfiTng

– ComCam:• ISR,PSFcharacterizaHon,photometry,astrometry

– LSSTCam:

• CalibraHonproducts(includingCollimatedBeamProjectorprocessing)

• ISR,PSFcharacterizaHon,photometry,astrometry

− DMwillprovideafullstack,capableofcarryingoutthesurvey,beforetheScienceVerificaHonphase

− Inreality,DMexpectstoprovideafullstack,sufficienttostartOperaHons,beforetheComCamsustainedoperaHonsphase.

− WewillhavetestedtheselevelsoffuncHonalityusingprecursordata(predominantlyHSCandZTF)beforethestartofCommissioning.

3

DataProductsDefiniHonReview–PrincetonUniversity,Princeton,NJ–June6-7th2013

HSCvs.HST

4

c.500LSSTvisits(credit:HitoshiMurayama)


TheDMReplan

− Asyoumayknow,

– LSSTDMiscomingtotheendofamajorreplansotheexactstatusofthesystemduringCommissioningisnotyetclear.

− ThisreplanwillbefollowedbyareviewofDM,whichisexpectedbySummer2017.

− InparHcular,wemaydelayimplementaHonofsomecomponents,e.g.:

– "MulHfit"forgalaxyshapemeasurement

– Crowdedfieldphotometry(althoughalertsincrowdedfieldswillbeavailable)

− Wedonotexpectthesedelaystoimpactourabilitytocommissionthehardwaresystems,ortopreventusfromissuingalertsassoonastemplatesareavailable.

5


LSSTSciencePlaEormforCommissioning

− PortalforviewingautomatedmetricsfromproducHon

− Notebookforhuman-drivenanalysisandinvesHgaHon

− CommissioningClusteratBaseCenterprovidesadhoccompuHng,storage,anddatabase;batchproducHonservicesatNCSAareavailable

− Sogwareforsingle-frameprocessingincludingPSFandWCSesHmaHon,imagedifferencing,wavefrontprocessing;spectrophotometricpipelineforAuxTelescope

6


DataProductsProducHonDepartmentServices

7


ServiceStart-Upand OperaHons/MaintenancePlan

8


ServiceList

− Archivingservice(CameraandAuxTelescopeSpectrograph)

− TelemetryGatewayservice

− EngineeringandFaciliHesDatabasetransformaHonservice

− DataBackbone

− OCS-controlledBatchProcessingservice

− Offline(andCatch-Up)Processingservice

− PromptProcessingservice

− DataReleaseProducHonservice

− SciencePlaEormenvironmentonCommissioningCluster

− DataAccessCenteruserservicesandSciencePlaEorm

− LSSTEventMini-BrokerhosHng

9


ServiceAvailabilityatEarlySystemAI&T




− DataBackbone








10

Batch,Notebooks,

Files

Files

5%capacity


ServiceAvailabilitybeforeComCamSustainedOperaHons(Feb2020)




− DataBackbone








11

Fullcapability

Productdatabases


ServiceAvailabilitybeforeLSSTCamDelivery(May2020)




− DataBackbone








12

Archiveonly


ServiceAvailabilitybeforeScienceVerificaHon(Nov2020)




− DataBackbone








13

ArchiveandBase


− ServiceTesHngbeforeDeliverytoCommissioning

− DMConHnuousIntegraHonincludingtesHngatvaryingcadencesusingL1IntegraHon,VerificaHonCluster,andPrototypeDataAccessCenterenvironmentsonsimulatedandprecursordata;realdatawhenavailable

− DPPoperaHons"dressrehearsals"

− Cross-subsystemearlyintegraHonpathfinderexercises

14


HardwareandNetworkAvailabilityatEarlySystemAI&T

− AuxiliaryTelescopearchivingandprocessinghardware

− CommissioningClustercomputeandstorage

− L1archivingandpromptprocessinghardwareatBaseandArchive(5%)

− L2DataReleaseprocessing,QA,QChardwareatArchive(5%)

− Tapelibrarysystem

− NetworklinksoperaHonalatproducHonspeed

− PrototypeDataAccessCenterhardware

− IniHalArchiveandBasehardwareinstalledandtestedduringMay2018-Sep2019

15


HardwareandNetworkEvoluHon

− ExpansionofL1hardwareatBaseandArchiveandL2hardwareatArchiveto100%beforeFullSystemAI&T(May2020)

− ProducHonDataAccessCenterhardwareatArchivebeforeFullSystemAI&T(May2020)

− ProducHonDataAccessCenterhardwareatBasebeforeScienceVerificaHon(Nov2020)

16


BackupSlides

17LSSTCommissioningPlanReview•January2017


EarlyIntegraHonPathfinderExercises

− DMDemonstratesabilitytocompileandlinkagainstthev1DAQsogware

− TestofPopulaHngEFDwithCameraTelemetry

− OCS-DM-TCS-CCSStart/endofnighttest

− TestofEFDtransformaHonunderDMdevicecontrol

− FullOCS-TCS-CCS-DAQ-DMTest:CompleteVisit

− FullOCS-TCS-CCS-DAQ-DMTest:MiniNight

− FullOCS-TCS-CCS-DAQ-DMTest:DailyCycle,IncludingCalibraHon

18

dm services and software status (and evolution) · dm services and software status (and evolution)...

Documents