ames research center incremental contingency planning richard dearden, nicolas meuleau, sailesh...
DESCRIPTION
Ames Research Center The Planning Problem Visual servo (.2, -.15) Warmup NIR Dig(5)Drive(-1)NIR ……… Compress Drive(2) Maximize (Expected) Scientific Return Given: start time pose energy available actions with uncertain: durations resource usage Possible science objectives images samplesTRANSCRIPT
![Page 1: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/1.jpg)
AmesResearchCenter
Incremental Contingency Planning Richard Dearden, Nicolas Meuleau,
Sailesh Ramakrishnan, David E. Smith, Rich Washington
window
[10 ,14:30]
power power
Workspace pandata
Drive (-1)Dig(5)Visual servo (.2, -.15) NIR
Lo res Rock finder Hi res Carbonate
[10 ,14:30]
X X XX?
![Page 2: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/2.jpg)
AmesResearchCenter
Limited onboard processingCPU, memory, time
Safetysequence checking
Anticipationsetup steps
Why Contingency Planning ??
![Page 3: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/3.jpg)
AmesResearchCenter The Planning Problem
Visual servo (.2, -.15)
Warmup NIR
Dig(5) Drive(-1) NIR ………Compress
Drive(2)
Maximize (Expected) Scientific Return
Given:start timeposeenergy availableactions with uncertain:
durationsresource usage
Possible science objectivesimagessamples
![Page 4: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/4.jpg)
AmesResearchCenter Technical Challenges
Continuous time (& resources)
Continuous outcomes
Time (& resource) constraints
Concurrency
Goal selection & optimizationg1, g2, g3, g4 …
Visual servo (.2, -.15)
Warmup NIR
Lo res Rock finder NIR
∆p =∆t =
NIR
E > 2 Aht [10:00, 14:00]
Time Power Storage
![Page 5: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/5.jpg)
AmesResearchCenter Just in Case (JIC) Scheduling
1. Seed schedule2. Identify most likely failure3. Generate a contingency branch4. Integrate the branch
Advantages: TractabilitySimple plansAnytime
.4 .2.1
![Page 6: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/6.jpg)
AmesResearchCenter Just in Case (JIC) Planning
1. Seed plan2. Identify most likely failure3. Generate a contingency branch4. Integrate the branch
.4 .2.1
![Page 7: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/7.jpg)
AmesResearchCenter Limits of JIC Scheduling Heuristics
Dig(60)Visual servo (.2, -.15)
Lo res Rock finder LIB
= 120s = 60s
= 300s = 5s
= 1000s = 500s
t [9:00, 16:00] = 5s = 1s
= 120s = 20s V = 50
HiRes
V = 10
t [10:00, 13:50] = 600s = 60s
t [9:00, 14:30] = 5s = 1s
V = 5
Warmup LIB
= 1200s = 20s
Most probable failure points may not be the best branch-points:
It is often too late to attempt other goals when the plan is about to fail.
: most probable failures$ : most interesting branch point
ExpectedUtility
PowerStart time
10
1520
5
13:20
14:4014:20
14:0013:40
True for all initial states in the grey box.
Drive (-2) NIR
V = 100
t [10:00, 14:00] = 600s = 60s $
![Page 8: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/8.jpg)
AmesResearchCenter Just in Case (JIC) Planning
1. Seed plan2. Identify best branch point3. Generate a contingency branch5. Evaluate & Integrate the branch
? ??
Construct plangraph
Back-propagate value tables
Compute gain
Select branch condition & goals
?
r
Vb
Vm
![Page 9: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/9.jpg)
AmesResearchCenter Construct Plangraph
g1
g2
g3
g4
![Page 10: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/10.jpg)
AmesResearchCenter Value Tables
g1
g2
g3
g4
V1
V2
V3
V4
r
r
r
r
![Page 11: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/11.jpg)
AmesResearchCenter Example
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
![Page 12: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/12.jpg)
AmesResearchCenter Simple Propagation
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
![Page 13: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/13.jpg)
AmesResearchCenter Simple Propagation
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
![Page 14: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/14.jpg)
AmesResearchCenter Simple Propagation
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
12
![Page 15: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/15.jpg)
AmesResearchCenter Conjunctions
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
12
12
r
12
t
![Page 16: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/16.jpg)
AmesResearchCenter Propagation
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
12
12
r
12
t
51
r
![Page 17: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/17.jpg)
AmesResearchCenter Propagation
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
12
12
r
12
t
51
r
15
t
115
t
![Page 18: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/18.jpg)
AmesResearchCenter Combining Tables
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
12
12
r
12
t
51
r
15
t
115
t
15
t
![Page 19: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/19.jpg)
AmesResearchCenter Discharging Assumptions
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
12
r
12
t
51
r
15
t
115
t
15
t
15
15
![Page 20: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/20.jpg)
AmesResearchCenter Propagation
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
5
25
15
15
16
![Page 21: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/21.jpg)
AmesResearchCenter Combining Tables
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
15
15
61
18
5
2515
![Page 22: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/22.jpg)
AmesResearchCenter Combining Tables
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
15
15
61
5
2515
5
258
18
![Page 23: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/23.jpg)
AmesResearchCenter Ordering
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
15
15
61
5
2515
5
258
DCE
CDE
AB
18
![Page 24: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/24.jpg)
AmesResearchCenter Achieving Multiple Goals
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
15
15
61
5
2515
5
258
18
30
g+g’g
g’ +
![Page 25: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/25.jpg)
AmesResearchCenter Achieving Multiple Goals
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
15
15
61
18
5
2515 30
g+g’g
g’
5g+g’
g
g’
258 30
![Page 26: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/26.jpg)
AmesResearchCenter Goal Annotation
A
E
B
e
5
(1, 5)
(3, 3)
(10, 15) (10, 15)
(2, 2)
C
Ds t
r
q
p
g
g’
e1
5
15
15
15
61
18
gg
g’
g’
g’g’
g’
5
2515 30
g+g’g
g’
5g+g’
g
g’
258 30
![Page 27: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/27.jpg)
AmesResearchCenter Just in Case (JIC) Planning
1. Seed plan2. Identify best branch point3. Generate a contingency branch5. Evaluate & Integrate the branch
? ??
Construct plangraph
Back-propagate value tables
Compute gain
Select branch condition & goals
?
r
Vb
Vm
![Page 28: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/28.jpg)
AmesResearchCenter Estimating Branch Value
V1
V2
V3
V4
V
r
V
r
V
r
MaxV
r
![Page 29: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/29.jpg)
AmesResearchCenter Plan Statistics
r
V1
V2
V3
V4
P
r
plan value functionresource probability
Vm
Vb
r
![Page 30: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/30.jpg)
AmesResearchCenter Expected Branch Gain
V1
V2
V3
V4
P
r
Gain = ∫ P(r) max{0,Vb(r) - Vm(r)} dr∞
0
Vb
r
rVb
Vm
![Page 31: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/31.jpg)
AmesResearchCenter Selecting the Branch Condition
V1
V2
V3
V4
P
r
branch condition
rVb
Vm
Vb
r
branch condition
![Page 32: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/32.jpg)
AmesResearchCenter Selecting Branch Goals
r
V1
V2
V3
V4
P
r
branch goals
g1
g3
g3
g1
Vb
r
rVb
Vm
![Page 33: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/33.jpg)
AmesResearchCenter Evaluating the Branch
1. Seed plan2. Identify best branch point3. Generate a contingency branch4. Evaluate & integrate the branch
? ?? ?
r
Vb
Vm Compute value function
Compute actual gain
![Page 34: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/34.jpg)
AmesResearchCenter Actual Branch Gain
rVb
P
r
Gain = ∫ P(r) max{0,Vb(r) - Vm(r)} dr∞
0
Vm
r
Vb Branch value function
actual branch condition
![Page 35: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/35.jpg)
AmesResearchCenter Remarks: Single Plangraph
1. Seed plan2. Identify best branch point3. Generate a contingency branch5. Evaluate & Integrate the branch
? ??
Construct plangraph
Back-propagate value tables
Compute gain
Select branch condition & goals
?
r
Vb
Vm
![Page 36: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/36.jpg)
AmesResearchCenter Plan Graph
g1
g2
g3
g4
V1
V2
V3
V4
r
r
r
r
![Page 37: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/37.jpg)
AmesResearchCenter Branch Initial Conditions
g1
g2
g3
g4
V1
V2
V3
V4
r
r
r
r
v
rv
r
v
rv
r
v
r
{p}
{q,r}
{p,r}
![Page 38: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/38.jpg)
AmesResearchCenter Single Plangraph
1. Seed plan2. Identify best branch point3. Generate a contingency branch4. Evaluate & integrate the branch
? ?? ?
r
Vb
Vm
Discharge conditions
Compute gain
Select branch condition & goals
Construct single plangraph
Back-propagate value tables
![Page 39: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/39.jpg)
AmesResearchCenter Issues
Sensor costs
Setup steps
Utility updates
Floating contingencies
Drive (-1)Dig(5)Visual servo (.2, -.15) Hi res
Warm NIR
Lo res Rock finder NIR[11 ,14:00]
Visual servo Hi res Visual servo NIR
V = 100
V’ = 30
Lo res Rock finder NIR
Drive (-1)Dig(5)Visual servo (.2, -.15) Hi res?
![Page 40: Ames Research Center Incremental Contingency Planning Richard Dearden, Nicolas Meuleau, Sailesh Ramakrishnan, David E. Smith, Rich Washington window [10,14:30]](https://reader033.vdocuments.net/reader033/viewer/2022052706/5a4d1ace7f8b9ab059970905/html5/thumbnails/40.jpg)
AmesResearchCenter
The End.