energy parity games
DESCRIPTION
Energy Parity Games. Laurent Doyen LSV, ENS Cachan & CNRS Krishnendu Chatterjee IST Austria. Analysis - Synthesis. Synthesis. System Implementation Algorithm “How”. Specification Properties Model “What”. Verification. Analysis. Analysis - Synthesis. Synthesis. System - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/1.jpg)
Energy Parity GamesLaurent Doyen
LSV, ENS Cachan & CNRS
Krishnendu ChatterjeeIST Austria
![Page 2: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/2.jpg)
Specification
PropertiesModel
“What”
Specification
PropertiesModel
“What”
VerificationVerification
Synthesis
SystemImplementation
Algorithm
“How”
SystemImplementation
Algorithm
“How”
Analysis - Synthesis
Analysis
![Page 3: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/3.jpg)
Specification
PropertiesModel
“What”
Specification
PropertiesModel
“What”
VerificationVerification
Synthesis
SystemImplementation
Algorithm
“How”
SystemImplementation
Algorithm
“How”
Analysis - Synthesis
Analysis
Reactive Systems (e.g. servers, hardware,…)• Interact with environment• Non-terminating• Finite data (or data abstractions)• Control-oriented
![Page 4: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/4.jpg)
Two-player games on graphs
• Games for synthesis
- Reactive system synthesis = finding a winning strategy in a two-player game
- ω-regular spec : safety, reactivity, …
- quantitative spec : resource constraints
• Game played on a finite graph
- Infinite number of rounds
- Player’s moves determine successor state
- Outcome = infinite path in the graph
![Page 5: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/5.jpg)
Two-player games
![Page 6: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/6.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
![Page 7: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/7.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 8: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/8.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 9: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/9.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 10: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/10.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 11: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/11.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 12: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/12.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 13: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/13.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 14: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/14.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 15: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/15.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 16: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/16.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Play:
![Page 17: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/17.jpg)
Two-player games
Player 1 (good guy)
Player 2 (bad guy)
• Turn-based
• Infinite
Strategies = recipe to extend the play prefixPlayer
1:Player 2:
outcome of two strategies is a play
![Page 18: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/18.jpg)
Two-player games on graphs
Parity games
Energy games
Qualitative Quantitative
ω-regular specifications(reactivity, liveness,…)
Resource-constrainedspecifications
![Page 19: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/19.jpg)
Two-player games on graphs
Parity games
Energy games
Energy parity games
Qualitative Quantitative
Mixed qualitative-quantitative
ω-regular specifications(reactivity, liveness,…)
Resource-constrainedspecifications
![Page 20: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/20.jpg)
Energy games
![Page 21: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/21.jpg)
Energy games
Energy game:
Positive and negative weights
![Page 22: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/22.jpg)
Energy games
Play:
Energy game:
Positive and negative weights
Energy level: 3, 3, 4, 4, 3, 2, 1,…(sum of weights)
![Page 23: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/23.jpg)
Energy level: 3, 3, 4, 4, 3, 2, 1,…
Energy games
Energy game:
Positive and negative weights
3
Initial credit
A play is winning if the energy level is always nonnegative.
Play:
“Never exhaust the resource (memory, battery, …)”
![Page 24: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/24.jpg)
Energy games
Player 1 (good guy)
Initial credit problem:
Decide if there exist an initial credit c0 and a strategy of player 1 to maintain the energy level always nonnegative.
![Page 25: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/25.jpg)
Energy games
Player 1 (good guy)
Initial credit problem:
Decide if there exist an initial credit c0 and a strategy of player 1 to maintain the energy level always nonnegative.
For energy games, memoryless strategies suffice.
![Page 26: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/26.jpg)
Energy games
A memoryless strategy is winning if all cycles are nonnegative when is fixed.
Initial credit problem:
Decide if there exist an initial credit c0 and a strategy of player 1 to maintain the energy level always nonnegative.
![Page 27: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/27.jpg)
Energy games
Initial credit problem:
Decide if there exist an initial credit c0 and a strategy of player 1 to maintain the energy level always nonnegative.
A memoryless strategy is winning if all cycles are nonnegative when is fixed.
See [CdAHS03, BFLMS08]
![Page 28: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/28.jpg)
Energy games
Initial credit problem:
Decide if there exist an initial credit c0 and a strategy of player 1 to maintain the energy level always nonnegative.
c0=0
c0=0c0=0
c0=0
c0=1
c0=2
c0=3
A memoryless strategy is winning if all cycles are nonnegative when is fixed.
Minimum initial credit can be computed in
![Page 29: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/29.jpg)
Parity games
![Page 30: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/30.jpg)
Parity games
Parity game:
integer priority on states
![Page 31: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/31.jpg)
Play:
Parity games
Parity game:
integer priority on states
A play is winning if the least priority visited infinitely often is even.
“Canonical representation of ω-regular specifications ” (e.g. all requests are eventually granted – G[r -> Fg])
5, 5, 5, 1, 0, 2, 4, 5, 5, 3…
![Page 32: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/32.jpg)
Parity games
Player 1 (good guy)
Decision problem:
Decide if there exists a winning strategy of player 1 for parity condition.
![Page 33: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/33.jpg)
Player 1 (good guy)
For parity games, memoryless strategies suffice.
Parity games
Decision problem:
Decide if there exists a winning strategy of player 1 for parity condition.
![Page 34: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/34.jpg)
A memoryless strategy is winning if all cycles are even when is fixed.
Parity games
Decision problem:
Decide if there exists a winning strategy of player 1 for parity condition.
![Page 35: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/35.jpg)
Decide if there exists a winning strategy of player 1 for parity condition.
A memoryless strategy is winning if all cycles are even when is fixed.
Parity games
Decision problem:
See [EJ91]
![Page 36: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/36.jpg)
Summary
Strategy Algorithmic
Player 1 Player 2 complexity
Energy games
memoryless
memoryless
NP coNP
Parity gamesmemoryle
ssmemoryles
sNP coNP
Energy games - “never exhaust the resource”
Parity game – “always eventually do something useful”
![Page 37: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/37.jpg)
Summary
Strategy Algorithmic
Player 1 Player 2 complexity
Energy games
memoryless
memoryless
NP coNP
Parity gamesmemoryle
ssmemoryles
sNP coNP
Energy parity games
? ? ?
Energy games - “never exhaust the resource”
Parity game – “always eventually do something useful”
![Page 38: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/38.jpg)
Energy parity games
![Page 39: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/39.jpg)
Energy parity games
“never exhaust the resource”Energy parity games: and “always eventually do something useful”
![Page 40: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/40.jpg)
Energy parity games
“never exhaust the resource”Energy parity games: and “always eventually do something useful”
Energy games – a story of cycles
Parity games – a story of cycles
Energy parity games - ?
Decide the existence of a finite initial credit sufficient to win.
Decision problem:
![Page 41: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/41.jpg)
A story of cycles
A good cycle ?
![Page 42: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/42.jpg)
A story of cycles
A good cycle ?
A bad cycle ?
- energy is (strictly) negative
- or, least priority is odd
![Page 43: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/43.jpg)
A story of cycles
A good cycle ?
A bad cycle ?
- energy is (strictly) negative
- or, least priority is odd
Player 1 looses energy parity game iff the opponent can force a bad cycle.
The opponent can force bad cycles without memory.
![Page 44: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/44.jpg)
A story of cycles
In energy parity games, memoryless strategies are sufficient for Player 2.
Proof
![Page 45: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/45.jpg)
A story of cycles
Proof
Preliminary fact: under optimal strategy, energy in q is always greater than on first visit to q.
In energy parity games, memoryless strategies are sufficient for Player 2.
![Page 46: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/46.jpg)
A story of cycles
Proof
Assume player 1 looses with initial credit cr,
then show that player 1 looses also against one of the
“memoryless strategies in q”:
In energy parity games, memoryless strategies are sufficient for Player 2.
cl cr≤
cr
![Page 47: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/47.jpg)
A story of cycles
Proof
Fix winning strategy of Player 2,
all outcomes are loosing for Player 1:
In energy parity games, memoryless strategies are sufficient for Player 2. cr
![Page 48: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/48.jpg)
Then also in since
A story of cycles
Proof
Fix winning strategy of Player 2,
all outcomes are loosing for Player 1:
In energy parity games, memoryless strategies are sufficient for Player 2.
Energy < 0 ?
cr
![Page 49: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/49.jpg)
A story of cycles
Least ∞-visited priority is odd ?
Then also in or
Proof
Fix winning strategy of Player 2,
all outcomes are loosing for Player 1:
In energy parity games, memoryless strategies are sufficient for Player 2. cr
![Page 50: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/50.jpg)
Complexity
Strategy Algorithmic
Player 1 Player 2 complexity
Energy games
memoryless
memoryless
NP coNP
Parity gamesmemoryle
ssmemoryles
sNP coNP
Energy parity games
memoryless
NP coNP
![Page 51: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/51.jpg)
A story of cycles
A good cycle ?
A one-player energy Büchi game
![Page 52: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/52.jpg)
A story of cycles
A good cycle ?
good for parity
good for energy
![Page 53: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/53.jpg)
A story of cycles
Winning strategy:
1. reach and repeat positive cycle to increase energy; 2. visit priority 0; 3. goto 1;
![Page 54: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/54.jpg)
A story of cycles
Winning strategy:
1. reach and repeat O(2nW) times the positive cycle; 2. visit priority 0; 3. goto 1;
requires exponential memory !
![Page 55: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/55.jpg)
Complexity
Strategy Algorithmic
Player 1 Player 2 complexity
Energy games
memoryless
memoryless
NP coNP
Parity gamesmemoryle
ssmemoryles
sNP coNP
Energy parity games
exponential
memoryless
NP coNP
![Page 56: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/56.jpg)
Note
Energy-winning and parity-winning ≠ EnergyParity-winning
![Page 57: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/57.jpg)
Structure of strategies
![Page 58: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/58.jpg)
Structure of strategies
0 0
0
1
(optimal) energy-winning
≥0 & min.pr. 1
parity-winning <0 & min.pr.
2
![Page 59: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/59.jpg)
Structure of strategies
0 0
0
1
(optimal) energy-winning
≥0 & min.pr. 1
parity-winning <0 & min.pr.
2
Bad
![Page 60: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/60.jpg)
Structure of strategies
0 1
1
2
energy-winning≥0 & least priority is even if
=0
parity-winning <0 & min.pr.
2
![Page 61: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/61.jpg)
Good-for-energy strategies
A good-for-energy strategy is a winning strategy in the following cycle-forming game:
Cycle-forming game: play the game until a cycle is formed
Player 1 wins if energy of the cycle is positive, or energy is 0 and least priority is even.
If Player wins in an energy parity game, then a memoryless good-for-energy strategy exists.(not iff)
![Page 62: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/62.jpg)
Winning strategy = alternate good-for-energy strategy and parity-winning strategy ?
Good-for-energy strategies
good-for-energy and parity-winning ≠ EnergyParity-winning
Good-for-energy and parity-winning strategiesare necessary to win…
![Page 63: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/63.jpg)
1. Play good-for-energy. Either energy stabilizes and then least priority is even,or energy (strictly) increases.
2. When energy is high enough (+2nW):
2a. If (and while) game is in Q \ Attr(0), play a winning strategy in subgame defined by Q \ Attr(0).
2b. Whenever game is in Attr(0), reach 0 and start over.
• If least priority is 0
Structure of strategies
0Attr1(0)
Win
![Page 64: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/64.jpg)
• If least priority is 1
Structure of strategies
1Attr2(1)
Win
![Page 65: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/65.jpg)
1. Game can be partitionned into winning regions and their attractor.
2. Winning strategy combines subgame winning stragies and reachability strategies.
• If least priority is 1
Structure of strategies
1Attr2(1)
W1
![Page 66: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/66.jpg)
1. Game can be partitionned into winning regions and their attractor.
2. Winning strategy combines subgame winning stragies and reachability strategies.
• If least priority is 1
Structure of strategies
1Attr2(1)
W1
W2
W3
Attr1(W1)
Attr1(W2)
Attr1(W3)
Corollary: memoryless strategies are sufficient in coBüchi energy games.
![Page 67: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/67.jpg)
An NP solution
Assume NP-algorithm for d-1 priorities
NP-algorithm for d priorities:
- guess the winning set and good-for-energy strategy
- compute 0-attractor, and solve subgame in NP
0Attr1(0) Cd(n) ≤ p(n) + Cd-1(n)
least priority 0
![Page 68: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/68.jpg)
An NP solution
Assume NP-algorithm for d-1 priorities
NP-algorithm for d priorities:
- guess the winning set and partition
- compute 1-attractor, and solve subgames in NP
1Attr2(1)
W1
W2
W3
Attr1(W1)
Attr1(W2)
Attr1(W3)
Cd(n) ≤ p(n) + Cd-1(n1) + … + Cd-
1(nk)
≤ p(n) + Cd-1(n1+ … + nk)
≤ p(n) + Cd-1(n-1)
least priority 1
![Page 69: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/69.jpg)
Complexity
Strategy Algorithmic
Player 1 Player 2 complexity
Energy games
memoryless
memoryless
NP coNP
Parity gamesmemoryle
ssmemoryles
sNP coNP
Energy parity games
exponential
memoryless
NP coNP
![Page 70: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/70.jpg)
Algorithm
Good-for-energy:
All cycles are either >0, or =0 and even
Algorithm for solving energy parity games ?
Determine good-for-energy winning states – a story of cycles
Reduction to (pure) energy games with modified weights:
cycles =0 and even >0cycles =0 and odd <0other cycles remain >0 or <0
![Page 71: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/71.jpg)
Algorithm
Reduction to energy games with modified weights:
cycles =0 and even >0cycles =0 and odd <0other cycles remain >0 or <0
Positive increment for transitions from even states
Negative increment for transitions from odd states
Δenergy
priority0
1
2 430
1/n
-1/n2
![Page 72: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/72.jpg)
Algorithm
Positive increment for transitions from even states
Negative increment for transitions from odd states
Increment is exponential (in nb. of priorities)
Δenergy
priority0
1
2 430
1/n
-1/n2
![Page 73: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/73.jpg)
Algorithm
Algorithm for solving energy parity games ?
Determine good-for-energy winning states
by solving modified-energy game in O(E.Qd+2.W)
Recursive fixpoint algorithm, flavour of McNaughton-Zielonka
Note: a reduction to parity games (making energy explicit) would give complexity O(E.(Q2W)d).
![Page 74: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/74.jpg)
Relationship with mean-payoff parity
games
![Page 75: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/75.jpg)
Two-player games on graphs
Parity games
Energy games
Mean-payoff games
Energy parity games
Mean-payoff parity games
Qualitative Quantitative
Mixed qualitative-quantitative
![Page 76: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/76.jpg)
Mean-payoff
Mean-payoff value of a play = limit-average of the visited weights
Optimal mean-payoff value can be achieved with a memoryless strategy.
Decision problem:
Given a rational threshold , decide if there exists a strategy for player 1 to ensure mean-payoff value at least .
![Page 77: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/77.jpg)
Mean-payoff
Memoryless strategy σ ensures nonnegative mean-payoff value
iff
all cycles are nonnegative in Gσ
iff
memoryless strategy σ is winning in energy game
Mean-payoff games with threshold 0 are equivalent to energy games.
![Page 78: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/78.jpg)
Mean-payoff parity
Mean-payoff parity games [CHJ05]
Objective:
- satisfy parity condition
- maximize mean-payoff
Infinite memory may be necessary !
However, finite-memory ε-optimal strategies exist.
![Page 79: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/79.jpg)
Mean-payoff parity
Mean-payoff parity games are polynomially equivalent to energy parity games.
Reduction idea:
from MPP game, construct EP game by incrementing all weights by ε=1/(n+1)
If Player 1 wins MPP ≥0, then finite-memory ε-optimal strategy exists, which is winning in EP game.
If Player 1 wins EP game, then he wins MPP ≥ -ε and then also MPP ≥0 since the value in MPP has denomiantor ≤n.
![Page 80: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/80.jpg)
ComplexityStrategy Algorithmic
Player 1 Player 2 complexity
Energymemoryle
ssmemoryles
sNP coNP
Paritymemoryle
ssmemoryles
sNP coNP
Energy parity
exponential
memoryless
NP coNP
Mean-payoff parity
infinitememoryles
sNP coNP
By-product: a conceptually simple algorithm for mean-payoff parity games.
![Page 81: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/81.jpg)
Thank you !
Questions ?
The end
![Page 82: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/82.jpg)
References
[CdAHS03]
A.Chakrabarti, L. de Alfaro, T.A. Henzinger, and M. Stoelinga. Resource interfaces, Proc. of EMSOFT: Embedded Software, LNCS 2855, Springer, pp.117-133, 2003
[EM79] A. Ehrenfeucht, and J. Mycielski, Positional Strategies for Mean-Payoff Games, International Journal of Game Theory, vol. 8, pp. 109-113, 1979
[BFL+08] P. Bouyer, U. Fahrenberg, K.G. Larsen, N. Markey, and J. Srba, Infinite Runs in Weighted Timed Automata with Energy Constraints, Proc. of FORMATS: Formal Modeling and Analysis of Timed Systems, LNCS 5215, Springer, pp. 33-47, 2008
[CHJ05] K. Chatterjee, T.A. Henzinger, M. Jurdzinski. Mean-payoff Parity Games, Proc. of LICS: Logic in Computer Science, IEEE, pp. 178-187, 2005.
![Page 83: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/83.jpg)
Energy parity
![Page 84: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/84.jpg)
Mean-payoff parity
![Page 85: Energy Parity Games](https://reader035.vdocuments.net/reader035/viewer/2022062221/56813b8f550346895da4be21/html5/thumbnails/85.jpg)
ComplexityStrategy Algorithmic
Player 1 Player 2 complexity
Energymemoryle
ssmemoryles
sNP coNP
Paritymemoryle
ssmemoryles
sNP coNP
Energy parity
exponential
memoryless
NP coNP
Mean-payoffmemoryle
ssmemoryles
sNP coNP
Mean-payoff parity
infinitememoryles
sNP coNP