glast large area telescope: instrument science operations center cdr section 5

GLAST LAT Project ISOC CDR, 4 August 2004

Document: LAT-PR-04500 Section 5 1

GLAST Large Area Telescope:GLAST Large Area Telescope:

Instrument Science Operations Instrument Science Operations CenterCenterCDRCDR

Section 5Section 5Software ArchitectureSoftware Architecture

Steve [email protected]

Gamma-ray Large Gamma-ray Large Area Space Area Space TelescopeTelescope



AgendaAgenda

Requirements Mapped to Software Software Architecture Development and Testing Schedule Staffing Level (ROM) Demo



Requirements Mapped to SoftwareRequirements Mapped to Software

– Reviewed all ISOC level III requirements– Identified which required software– Identified existing tools which satisfied all or part of reqt– Identified where new development needed



Requirements breakdownRequirements breakdown

Each requirement was identified as:1. Procedural (non-software) 422. Existing software (commercial or other well-established

software -- i.e. implementation Done!) 2773. Under development by SAS

(mostly done, refer to SAS for status) 394. To be developed by others (I&T, FSW, ITOS) 215. Remaining new development 88

total467

Some requirements map to multiple categories or SW tools, so total exceeds total number of level IIIs (379)



1. Procedural1. Procedural(no SW development)(no SW development)

Name # Level 3 Reqts % of Reqts

N/A (e.g. facility reqts)

19 4.1%

Ops Procedures 12 2.6%

SCS (SLAC Computer Services)

11 2.4%

Total 42 9.0%



2. Existing software2. Existing software

Name Description # Level 3 Reqts

% of Reqts

Source

ITOS satellite C&T package 215 46.0% GSFC

ATNS Anomaly Tracking and Notification System

32 6.9% FASAT (commercial) or

RXTE SOF Process Mgr (RXTE)

FastCopy / DTS secure file transfer 15 3.2% FastCopy (commercial),

DTS (HEASARC)

CVS file config mgmt tool 5 1.1% Open Source

STK Satellite Tool Kit 4 0.9% commercial

LATDocs LAT documentation management tool

4 0.9% existing SLAC LAT tool

NTP synchronize computers 1 0.2% Open Source

email electronic mail 1 0.2% Open Source

Total 277 59.3%



3. Under Development by SAS3. Under Development by SAS

Name Description # Level 3 Reqts

% of Reqts

GINO pipeline manager 21 4.5%

DATACHKTOOL check quality of science data telemetry

6 1.3%

SASTOOL1 generate level 1 science data products

6 1.3%

SASTOOL2 generate level 2 science data products

4 0.9%

SASAUTO manage automatic generation of level 1 & 2 data products

2 0.4%

Total 39 8.4%



4. To be developed by others4. To be developed by others

Tool Name Description # Level 3 Reqts

% of Reqts

Source

ELOG electronic log book 8 1.7% I&T Online (mostly done)

DIAGTOOL diagnostic access 7 1.5% FSW

ITOS Enhancements

minor changes to ITOS to meet specific reqts

3 0.6% GSFC

IRFTOOL generate instrument response function

2 0.4% SVAC

DBCAL create database of LAT calibration data

1 0.2% SVAC

Total 21 4.5%



5. Remaining to be developed5. Remaining to be developed

Tool Name Description # Level 3 Reqts

% of Reqts

Comments

PLOTTOOL plotting 28 6.0% combination of existing tools (e.g. ROOT, HippoDraw, JAS, IDL) & new dev

TRENDTOOL trending 16 3.4% combination of IDL, DTAS (used by MOC), and/or TAPS (GSFC)

PLANTOOL mission planning 6 1.3% generate timeline and commands for LAT operation

CONSTRAINTTOOL

check command sequences against constraints

12 2.6%

DB database definition and implementation

10 2.1% partially done by SAS, I&T, FSW - coordinating dev with SAS, I&T, FSW, SCS

DBIN ingest ISOC data 7 1.5%

WEBTOOL provide web access to data products

9 1.9%

Total 88 18.8%



Software ArchitectureSoftware Architecture



Contingency: LAT Instrument Commands, LAT Instrument Loads

Level 0 Data, Integrated Observ. Timeline,

As-Flown Timeline,Flight Dynamics Products,

Anomaly Reports,PDB updates,

LAT/GBM Sci Alerts,LAT/GBM/SC Problem Alerts

Primary Software Data FlowsPrimary Software Data Flows

MOC

WebAccess

AnomalyTracking &Notification

System

MissionPlanning

CHSmonitoring& trending

Database

LAT Test Bed

Science Data Analysis

Pipeline

MOC

Commands to Verify

Tested OK

Receive& Archive

Integrated Observ. Timeline,As-Flown Timeline,

Flight Dynamics Products

Level 0Sci Data

Level 0Hkpg Data

Level 1&2Sci Data Products

Level 1&2 Sci Data Products,LAT Science Activity Timeline,LAT Instrument Commands,LAT Instrument Loads

LAT Science Activity Timeline,LAT Instrument Commands,LAT Instrument Loads

GSSCScience Plan

GSSCArchive& Send

LAT ISOC

Alerts, Logs,Process status,

File status

Archive& Send

Receive& Archive

All data into ISOC,and products out



Automatic Telemetry ProcessingAutomatic Telemetry Processing

MOC

LAT ISOC

Receive& Archive

Level 0sci & hkpg telemetry

Level1 & 2data

products

Level 0 hkpg

telemetry

GINO & FastCopy/DTS

Monitor hkpg parameters

ITOS


System

FASAT

Beeper / email message

Level 0 science

telemetry

Realtime Level 0 hkpg telemetry

(during contacts)

MonitorData

STOL Config monitor scripts

Beeper / email message

Text & Stripchart displays (optional)

Science Data Analysis Pipeline

Subsystem-level

monitor

ApplyCalibration

Recon-struction

TransientSearch

GCN

Level 1 processing

Level 2 processing

GSSCArchive& Send

GINO & FastCopy/DTS

System-levelMonitor

ITOS

Calib.DB

Calibration Trending

MonitorTrends

Alerts, Logs,Process status,File status

Database

Reports, Log entries, Data Products received

and sent



Report Generation and UseReport Generation and Use

Report Frequency Source Auto Generation

Manual Input

Destination Read By

LAT Health and Status Daily ISOC Yes Optional Web Human

LAT Performance Daily (TBR) ISOC Yes Optional Web Human

Level 0 Transmission Level 0 receipt ISOC Yes No MOC Computer

Data Trending Level 0 receipt ISOC Yes No Web Human

LAT Command History Daily (TBR) ISOC Yes No Web Human

Data Processing Reports

Level 0 receipt ISOC Yes No Web Human

LAT Incident Reports As needed ISOC No Yes MOC Human

SC Incident Reports As needed MOC No Yes ISOC Human

As-Flown Timeline TBD MOC Yes TBD ISOC Computer/Human



Command and TelemetryCommand and TelemetryDefinition File VerificationDefinition File Verification

LAT ISOC

Replay Commands & Receive Telemetry

ITOS

telemetry

LAT Testbed

CCSDS Commands

.dbxfiles

Modify .dbx file(s)

Project Database(master Cmd &Tlm

definitions)OK (test passed with

new .dbx file(s)

Command log, error log and optional

Text/Stripchart displays

Test Suiteof STOL

Commands

MOC



Nominal LAT Command ProcessNominal LAT Command Process

GLAST Science Support Center

(GSSC)

Operations Plan

Command Plan Build &

Review

Mission Operations Center (MOC)

Final Science Timeline

Preliminary and Final Science Timelines

ISOC

Science Plan (Phase 2)

Feedback

Mission Planning

Verification & Validation

ATS Commands

File Uploads

Command Procedures

Command Plan

TDRSS ScheduleEngineering PlanMission Timeline

Command Plan



Command Load Generation & VerificationCommand Load Generation & Verification

GSSC

LAT ISOC

Issue Commands & Receive Telemetry

ITOS

telemetryLAT Test Bed

CCSDS Commands

Verified OK

Generate Command Load &

PerformConstraint Checking

STOL commands

(new)

Command log, error log and optional

Text/Stripchart displays

Command Load



Data Display and Analysis SupportData Display and Analysis Support

Web access– Data products (logs, reports, level 0/1/2 data)– Electronic logbook provides log entry, log and report viewing,

and file download– Password protection on privileged actions (e.g. log entry, data

download) Tools

– Includes ROOT, HippoDraw, IDL, and JAS– Used in ISOC to generate reports accessible over web– Data download allows users to process data locally with tools

installed on their machine



Electronic LogbookElectronic Logbook

Running record of ISOC and its data products in and out– Program currently in use by I&T can meet ISOC requirements– All entries go in relational database– Web-accessible

Includes– Record of data products received and sent

and links to each– User comments– Time tag on each entry

Suggested Metric for ISOC– Response times – e.g. from receipt of level 0 data to sending of

level 1 & 2 products



ISOC Network and Hardware ArchitectureISOC Network and Hardware Architecture

LAT ISOC

Internet

…

SAS/SPWorkstations

PVOWorkstations

FSWWorkstations

CHSWorkstations

SCS Storage Farm

SCSCPU Farm

LAT Test Bed Lab

LAT Test Bed

SIIS(S/C Sim)

Linux PC(Test Bed

ITOS)

1553

LVDS

SolarisWorkstation

(VxWorkstools)

GatewaySystem

(Oracle, GINO,FastCopy/DTS)

Firew

all

Abilene Network


System

SLAC

Linux PC(Realtime

connectionITOS)

Web Server

Linux PC(HkpgReplayITOS)

MOC

GSSC

Firewall Firew

all



Software Development & Testing ScheduleSoftware Development & Testing Schedule



TestingTesting

Four software releases

– Each level 3 requirement will

• be mapped to the release where first needed

• have test procedures defined

– Each release includes functionality required for subsequent GRTs

• R3 (Dec 05) includes all requirements

• R4 (Jul 06) includes enhancements based on user experience (e.g. during Mission Simulation)

– Two weeks prior to each release

• test that requirements newly included in that release are met

• regression test previously included requirements



Summary of ISOC Software CapabilitiesSummary of ISOC Software Capabilitiesfor GRTs & ETEsfor GRTs & ETEs

Date What Release Required ISOC capabilities

15-Apr-05 GRT 2 ISOC 1

(1 Apr 05)

receive real-time HK data from MOC,

provide basic LAT P&S (Planning & Scheduling)

15-Jun-05 GRT 3 “ level 0 data processing on science data,

IOC processes science level 0 data into level 1 products

1-Sep-05 GRT 4 ISOC 2

(15 Aug 05)

receive level 0 data from MOC

15-Nov-05 GRT 5 “ provide level 1 and 2 data products to GSSC,

provide more complex LAT P&S,

provide LAT file uploads to GSSC,

provide simulated science data

11-Feb-06 ETE 1 ISOC 3

(15 Dec 05)

provide Level 1 data products to GSSC,

receive Level 0 files from MOC (post-test)

15-Feb-06 GRT 6 “ contingencies added

15-Apr-06 ETE 2 “ provide instrument commands and file loads,

support memory dumps of instrument

1-May-06 GRT 7 “ clean-up and regression tests

1-May-06 Mission Sims “ full ISOC capabilities to support Mission Sims (from May 2006 through launch)

15-Jun-06 ETE 3 “ support basic observatory operations

25-Aug-06 ETE 4 ISOC 4

(25 Jul 06)

instrument turn on

14-Oct-06 ETE 5 “ regression test and contingencies

1-Feb-07 ETE 6 “ final ETE at launch facility



SW Dev Slack Times

ISOC Software Development ScheduleISOC Software Development Schedule

Launch

Mission Simulations

ISOC testing at NRL

Environmental tests at NRL

ISOC SW Releases

ISOC Simulation Testing

ISOC Demos

ISOC Verif. with Test Bed

Plotting/Trending Dev

DB/Web/E-logbook Dev

Mission Planning Dev

Diagnostic Tool Dev

End-to-End Tests

Ground Readiness Tests

ISOC CDR

Mar-07

Feb-07

Jan-07

Dec-06

Nov-06

Oct-06

Sep-06

Aug-06

Jul-06

Jun-06

May-06

Apr-06

Mar-06

Feb-06

Jan-06

Dec-05

Nov-05

Oct-05

Sep-05

Aug-05

Jul-05

Jun-05

May-05

Apr-05

Mar-05

Feb-05

Jan-05

Dec-04

Nov-04

Oct-04

Sep-04Phase / Milestone

Aug-04

2 3 4 5 6 7

ITOS setup/configuration

1 2 3 4 5 6

1 32

ISOC ready to take over LAT operation

ISOC used to I/F with LAT (front-door only)

4

SW enhancements



Staffing Level (ROM)Staffing Level (ROM)

Based on review of level 3 requirements– Average LOC per reqt is >10 and <100– 80 LOC per reqt appears conservative (probably high)

Of 467 reqts, 88 remain to be developed and all need to be verified– 88 reqts x 80 LOC/reqt = ~7,000 LOC (ROM)– Estimate 2,000 LOC per programmer per year– 7,000 LOC to develop / 2,000 LOC/pgmr-yr

= 3.5 programmer years Release 4 is July 06

~ 2 calendar years of development– But with slack time and more intensive 1st year of

development, need 3 programmers + 1 tester



StatusStatus

Architecture concept is solid Ready to proceed

– Refine and document software design– Implement it– Lots of testing and demos

I.e. lots of work to do…



ITOS DemoITOS Demo



ITOS DemoITOS Demo

Play back simulated LAT housekeeping telemetry• In real-time --

this simulates:– Real-time connection to MOC for S/C contact periods

– ISOC test bed use for verifying command sequences and ITOS Command & Telemetry definition files

• Fast replay --this simulates:

– Rapid replay of LAT and S/C housekeeping data files received from MOC after download from SSR

• Examine print file generated during playback– Configured to record parameters of interest

– Available for download through e-logbook

glast large area telescope: instrument science operations center cdr section 5

Documents