observation scheduling boyd waters, nrao
DESCRIPTION
EVLA Data Processing PDR. Observation Scheduling Boyd Waters, NRAO. Proposal Preparation and Submission. Observation Preparation. Observation Scheduling. Data Archive. Image Pipeline. Data Post-Processing. Monitor and Control System. CBE. Correlator. Antenna. Feed. Receiver. - PowerPoint PPT PresentationTRANSCRIPT
EVLA Data Processing PDR
Observation Scheduling
Boyd Waters, NRAO
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 2
Proposal Preparation and
SubmissionObservation Preparation
ObservationScheduling
Monitor and Control System
Antenna Feed Receiver IF System
Local Oscillator
Fiber Optics Transmission
System
Correlator
Image PipelineData Archive Data Post-Processing
CBE
e2e-EVLA Interaction
ObservationSchedulingSoftware
Monitor &ControlSystem
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 3
e2e-EVLA II
Diagram Design:B. Clark
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 4
Observation Scripting Path
IntentionalProposal
$
VISIOCORPORATION
PrioritizedProposal
project
Datarepresentation
ScriptorQueue
;
XML XMLObserving
TableGlish Script
Real-time
Scheduling Phases
Real-TimeScheduler
ControlScripts
TestEngineer
ObservingSystem
Monitor Data
Visibility Data
ArrayOperator
ObservationMonitor
9. Remote
Observing
Toolkit
Queue
ControlScripts
8. Observation Scheduling Toolkit
DynamicScheduler
conditions
Queue
project
Calibration Data is aspecific kind of“conditions” data.
Scheduler
CalibrationData
Control Scripts -“as observed”
5. Observation Scripting Toolkit
GenerateObserving
Scripts
NormalizedProposal
project
$
VISIOCORPORATIO
N
PrioritizedProposal
-or-
Scriptor
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 6
Dynamic Scheduling
Structure the Observation……so that we can…Respond to Events on a Short Time
ScaleChanging conditions (e.g. weather)Targets of Opportunity (e.g. GRBs)
…
Block-Based Scheduling
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 7
Observing Block
~20(?) minutes nominal
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 8
Observing “Session”
• A series of blocks
• Preamble is run ONLY for the FIRST
• Post-amble is run ONLY for the LAST
Observing BlockObserving Block
Pre
am
ble
Observing BlockObserving Block Observing BlockObserving Block
“Post-a
mble
”… …
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 9
Observing Block Constraints
• “Run this block until the calibrations converge”
• “I can’t run unless the previous block has run successfully”
• “I MUST run at 16:42:30 GST on 30 May 2002”– (fixed scheduling is dynamic scheduling with
time-domain constraints)
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 10
Block Templates
• Debug blocks
• Template blocks
• “Default” blocks
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 11
Block-Based Scheduler
Telescope sees ONE BLOCK AT A TIME:
Block Queue
Telescope
“ready for next block”
“here it is”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
Implications:
•Simplifies the telescope state data
•Telescope reports block execution status back to the block queue
•All “observing logic” is maintained by the Block Queue
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 12
Block Execution
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”Input Queue:
Execution:Observing Block
Observing Block
Pre
am
ble
“Post-a
mb
le”
3
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
1
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
1
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
2
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
3
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
2
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
2
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 13
Block Execution: Detail
Input Queue:
Execution:Observing Block
Observing Block
Pre
am
ble
“Post-a
mb
le”
3
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
1
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
1
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
2
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
3
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
2
Archive:
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
4
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
5
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
MeasurementSet
MeasurementSet
MeasurementSet
MeasurementSet
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
3
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
1
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
2
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
3
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
4
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
ready ready ready ready
Pre
am
ble 2
Observing BlockObserving Block
Observing Block
Pre
am
ble
“Post-a
mb
le”
Observing BlockObserving Block
Pre
am
ble
“Post-a
mb
le”
2
ok ok ok ok
readyFailed!
?
July 18 - 19, 2002 EVLA Data Processing PDR Boyd Waters 14
Next Steps
• Gather and Codify Requirements– Observing Block constraints
• M&C Observing System Interaction– Formal Model
• Observing System Scripting– How instrument commands and observing
constraints are expressed