key performance metrics and end-to-end testing tim jenness
TRANSCRIPT
Key Performance Metrics and End-to-End Testing
Tim Jenness
2
Key Performance Metrics
• LSST Science Requirements (LPM-17) and LSST System Requirements (LSE-29) specify the performance of LSST.
• Key Performance Metrics (KPM) are important metrics used to monitor pipeline development.
• They are monitored annually.
3
4
End-to-End Testing
• Raw data on disk to visualization of catalogs and images in a web browser.
• Does not have to be fully automated. Manual intervention is okay.
• What are we missing?• Do we have enough of a system to calculate
S15 KPMs? Which can’t we attempt?
5
End-to-End Testing
• Alert Production end-to-end requires OCS and other infrastructure.– diffim performance only.
• Focus on Data Release Production– Use HSC data– Use NCSA systems– Scale to LSST for performance metrics.
• Five sessions at this meeting.
6
7
8
Support Documents
• Confluence:https://confluence.lsstcorp.org/display/DM/Data+Processing+End+to+End+Testing