combinatorial generation problemsperezguillau.me/document/combi_tutorial_2018.pdf · •...
TRANSCRIPT
![Page 1: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/1.jpg)
CombinatorialGenerationProblems
GuillaumePerez
![Page 2: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/2.jpg)
Motivations
• Combinatorialproblemsareeverywhere
2
Pickupanddeliveries
DamsplacementinamazonKnapsackproblems
Musicandtextgeneration
![Page 3: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/3.jpg)
CombinatorialOptimizationProblems
• Findinganoptimal objectfromafinitesetofobjects• Example:Findingtheshortestpathinagraph
• Decisionvariablesarediscrete• Differentfromcontinuousoptimization
3
Easywithcontinuous variables Hard withdiscretevariables
max
Pi2S xivi
subject to:
Pi2S xiwi W
Knapsackproblems
xixi
Theend?
![Page 4: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/4.jpg)
ThankYou
• Questions?
4
![Page 5: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/5.jpg)
OnSolvingCombinatorialProblems
5
ProblemModeling
Optimization
SolutionModel
![Page 6: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/6.jpg)
OnSolvingCombinatorialProblems
6
ProblemModeling
Optimization
SolutionModel
![Page 7: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/7.jpg)
OnSolvingCombinatorialProblems
7
ProblemModeling
Overapproximation
Optimization
SolutionModel
![Page 8: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/8.jpg)
OnSolvingCombinatorialProblems
8
ProblemModeling
Overapproximation
Underapproximation
Optimization
Solution
ModelingisanArt,butoptimizingisascience
Model
![Page 9: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/9.jpg)
SequenceGeneration
• Generateasequence
• Butwithconstraints• #orange<3• #apple>1• Finishbystrawberry
9
Productlinescheduling
x1 x2 x3 x4 x5 x6 x7
7 5 3 5 3 7 7
![Page 10: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/10.jpg)
Generationunderconstraints
• WhatifIwanttogenerateatextwithrhymes?
• Textandmusicusingsomeone’s“style”?
• Musicwithoutplagiarism?
• Poetrywithagivennumberofsyllables?
10
FindarhymewithcombinatorialThatdoesn’tsound artificial
Letitgo,letitgoCan'thold itbackanymore
Inthemonthofthe longdeclineofrosesI,beholdingthesummerdeadbeforeme,Setmyfacetotheseaandjourneyedsilent,
Algernon CharlesSwinburne
Examplewithimage
![Page 11: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/11.jpg)
Generationunderconstraints
• WhatifIwanttogenerateatextwithrhymes?
• Textandmusicusingsomeone’s“style”?
• Musicwithoutplagiarism?
• Poetrywithagivennumberofsyllables?
11
FindarhymewithcombinatorialThatdoesn’tsound artificial
Letitgo,letitgoCan'thold itbackanymore
Inthemonthofthe longdeclineofrosesI,beholdingthesummerdeadbeforeme,Setmyfacetotheseaandjourneyedsilent,
Algernon CharlesSwinburne
Examplewithimage
![Page 12: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/12.jpg)
SequencewithRhymes
• Example,rhymesbetweeneachtwolines
• Howtoexpress that?• 1variablepersyllable?• 1variableperword?
12
IbePuertoRicandayparadefloatin’ThatBenzMarinaDelReycoastin’SheinschooltobearealestateagentLastmonth Ihelpedherwiththecarpayment
Famous– KanyeWest
x1 x2 x3 x4 x5x6 x7 x8 x9 x10
Constraint:x5 andx10 mustrhyme.
https://youtu.be/1wYXSxCvN68?t=73
![Page 13: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/13.jpg)
SequencewithRhymes
• Givenacorpus
• Generatesentencesthatrhyme
• WhatvaluesfortheXi withi ≠{5,10}?
• WhatvaluesfortheXi withi ={5,10}?
13
x1 x2 x3 x4 x5x6 x7 x8 x9 x10
Constraint:x5 andx10 mustrhyme.
Section2inexercises
![Page 14: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/14.jpg)
Generationunderconstraints
• WhatifIwanttogenerateatextwithrhymes?
• Textandmusicusingsomeone’s“style”?
• Musicwithoutplagiarism?
• Poetrywithagivennumberofsyllables?
14
FindarhymewithcombinatorialThatdoesn’tsound artificial
Letitgo,letitgoCan'thold itbackanymore
Inthemonthofthe longdeclineofrosesI,beholdingthesummerdeadbeforeme,Setmyfacetotheseaandjourneyedsilent,
Algernon CharlesSwinburne
Examplewithimage
![Page 15: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/15.jpg)
SequencewithStyle
• What’ssomeonestyle?• It’sownwayofdoing orpresentingthings.
• Howtoextract it?
• Howtouseittogenerate newcontents?
15
Blindweare,ifcreationofthisclonearmywecouldnotsee.
Yoda
extract Style
generate
![Page 16: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/16.jpg)
SequencewithStyle
• Example• Extract thewordstransitionprocess
• Generate• Great lords build
16
• Toycorpus:Great lords listenbuteverybourgeois listenwhilegreat bourgeoisbuildwheneverylordsbuild
redcatsfollowbutyellowdogssleepwhilereddogsfollowwhenyellowcatssleep
Section3inexercises
ThisisastateJ
![Page 17: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/17.jpg)
SequencewithStyleandRhymes
• Complexity?• NP-complete (reductionfrom3-SAT)toprovethatitexistsasolution• #P-complete(reductionfromcounting3-SAT)forexactsampling
17
Theend?
![Page 18: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/18.jpg)
ThankYou
• Questions?
18
![Page 19: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/19.jpg)
ModelingWithConstraints
• Manyframeworksexist• Satsolvers• MIPsolvers• ConstraintProgramming(CP)solvers
• Modeling• Variableswithdomain
• Constraints
19
x1 x2 x3 x4 x5x6 x7 x8 x9 x10
Constraint:x5 andx10 mustrhyme.
BlackboxSolvers
![Page 20: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/20.jpg)
SequencewithStyleandRhymes
• Ourfirstmodel• 10Variables
• 5bysentence• Domain:allpossiblewordsfromcorpus
• Transitionconstraint• Betweenconsecutivevariables
• Rhymeconstraint• Betweenthetwolastwords
20
X1
X2
X3
X4
X5
X6
X7
X8
X9
X10
Variables
Transitio
n
Transitio
n
Transitio
n
Transitio
n
Transitio
n
Transitio
n
Transitio
nTransitio
n
Transitio
n
Rhym
e
![Page 21: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/21.jpg)
Transitionconstraint?
• Standalone• Justpickonewordinthepossiblenext
• Constraint• Booleanformula:• Table:
21
• Toycorpus:Great lords listenbuteverybourgeois listenwhilegreat bourgeoisbuildwheneverylordsbuild
redcatsfollowbutyellowdogssleepwhilereddogsfollowwhenyellowcatssleep
Xi
Xi+1Transitio
n =great
=lords∨ =bourgeois
Xi Xi+1
great lordsgreat bourgeois
Xi Xi+1
great lordsgreat bourgeois… …
Xi=great∧ Xi+1=lords∨Xi=great∧ Xi+1=bourgeois
Section5inexercises
![Page 22: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/22.jpg)
Generationunderconstraints
• WhatifIwanttogenerateatextwithrhymes?
• Textandmusicusingsomeone’s“style”?
• Musicwithoutplagiarism?
• Poetrywithagivennumberofsyllables?
22
FindarhymewithcombinatorialThatdoesn’tsound artificial
Letitgo,letitgoCan'thold itbackanymore
Inthemonthofthe longdeclineofrosesI,beholdingthesummerdeadbeforeme,Setmyfacetotheseaandjourneyedsilent,
Algernon CharlesSwinburne
Examplewithimage
![Page 23: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/23.jpg)
SequenceWithoutplagiarism
• Problem:• MaxOrder (Papadopoulosetal.,AAAI2014)• Avoiding plagiarisminMarkovsequencegeneration
• Exampleofgoal:• Basedonacorpus
• Generate sequences
• All thesubsequences ofsize2belongtothecorpus• “Greatlordssleep”Fail(unknowntransition)
• None ofthesubsequences ofsize3belongstothecorpus• “Greatlords listen“Fail(plagiarism)
• “Redcatssleep”Success
23
• Toycorpus:Greatlordslistenbuteverybourgeois listenwhilegreatbourgeoisbuildwheneverylordsbuild
redcatsfollowbutyellowdogssleepwhilereddogsfollowwhenyellowcatssleep
![Page 24: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/24.jpg)
SequencewithStyleandRhymes
• Ourfirstmodel• 10Variables
• 5bysentence• Domain:allpossiblewordsfromcorpus
• Transitionconstraint• Betweenconsecutive2variables
• Rhymeconstraint• Betweenthetwolastwords
• PlagiarismConstraint• Betweenconsecutive3variables
24
X1
X2
X3
X4
X5
X6
X7
X8
X9
X10
Variables
Transitio
n
Transitio
n
Transitio
n
Transitio
n
Transitio
n
Transitio
n
Transitio
nTransitio
n
Transitio
n
Rhym
e
Forbidden
Forbidden
Forbidden
Forbidden
Forbidden
Forbidden
Forbidden
Forbidden
Section6inexercises
![Page 25: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/25.jpg)
Inconsistency
• Example
• Solution:• Usemodelingtools
25
X1
X2
X3
X4
Constraint
1
Constraint
2
X1 X2 X3 X4
a b a bb a b a
X1 X2 X3 X4
a a a ab b b b
Constraint 1
Constraint 2Nosolution!
![Page 26: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/26.jpg)
Combinatorialproblemsolving
• Needforefficientmodelingtools• Hardtoexpress
• Let’susethesolutions
• Efficientdatastructure:1. Efficientlyrepresentsdiscreteproblemsolutions
1. Compression
2. Efficientlycombinable2. Combination
3. Integratedintosolversviafastandincrementalalgorithms.3. Integration
26
![Page 27: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/27.jpg)
root
a
0
b
1
c
0 2 1
d
02
tt
1 2 0
• BDDgeneralization
• EachLayerrepresentsavariable• Eacharc islabeledbyavalue
• Eachpath fromroot nodetott noderepresentsavalidassignment
• Exponentialcompressionpower• Exponentialnumberortuples
Multi-valuedDecisionDiagram(MDD)
X1
X2
X3
27
![Page 28: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/28.jpg)
root
a
0
b
1
c
0 2 1
d
02
tt
1 2 0
Multi-valuedDecisionDiagram(MDD)
28
X1 X2 X30 0 10 0 20 2 10 2 21 1 11 1 21 0 01 2 0
24valuesVS 10arcs+6nodes
1090 tuplesVS14,000nodes100variables600,000arcs
root
a
0
b
1
c
0 2 1
d
02
tt
1 2 0
![Page 29: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/29.jpg)
Reduction• Operationwhichmerges equivalent nodes
• Twonodesareequivalentiftheyhavethesameoutgoingarcs
• Foragivenvariableordering• Canonical
root
a
0
b
1
c
0 1
d
2
e
0 1
tt
0 1 1 0 1
29
![Page 30: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/30.jpg)
Reduction• Operationwhichmerges equivalent nodes
• Twonodesareequivalentiftheyhavethesameoutgoingarcs
• Foragivenvariableordering• Canonical
• Compressionismadebyreduction• Sub-graphsharing
root
a
0
b
1
ce
0 1
d
2 01
tt
011
30
![Page 31: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/31.jpg)
Combination
root1
a
0
b
1
ce
0 1
d
2 01
tt1
011
root2
k
0 2
l
0 2
tt2
1 2
31
∩ =
root
0
0 2
tt
1
Allsetoperations
![Page 32: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/32.jpg)
GoalMDDTransition∩¬Plagiarism
32
• Toycorpus:Greatlordslistenbuteverybourgeois listenwhilegreatbourgeoisbuildwheneverylordsbuild
redcatsfollowbutyellowdogssleepwhilereddogsfollowwhenyellowcatssleep
Redcatssleep
r
great every red yellow
lords bourgeois bourgeois lords
tt
build listen
cats dogs cats dogs
sleep follow
![Page 33: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/33.jpg)
MaxOrderMDDmodel
Corpus
M
MarkovMDDm (Size3)
33
![Page 34: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/34.jpg)
MarkovMDD
34
• Toycorpus:Greatlordslistenbuteverybourgeois listenwhilegreatbourgeoisbuildwheneverylordsbuild
redcatsfollowbutyellowdogssleepwhilereddogsfollowwhenyellowcatssleep
Redcatssleepr
great every red yellow
lords bourgeois
tt
build listen
cats dogs
sleep follow
![Page 35: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/35.jpg)
MaxOrderMDDmodel
Corpus
M
P
MarkovMDDm (Size3)
ProhibitedsequencesMDD3 (Size3)
35
![Page 36: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/36.jpg)
ProhibitedMDD
36
• Toycorpus:Greatlordslisten buteverybourgeois listenwhilegreatbourgeoisbuildwheneverylordsbuild
redcatsfollowbutyellowdogssleepwhilereddogsfollowwhenyellowcatsleep
r
great every red yellow
lords bourgeois bourgeois lords
tt
listen build
cats dogs cats dogs
follow sleep
![Page 37: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/37.jpg)
MaxOrderMDDmodel
Corpus V
Allthesolutions (size3)
MDDv (valid)
M
P
MarkovMDDm (Size3)
ProhibitedsequencesMDD3 (Size3)
DeletionM– P
Remark:P⊆M
37
![Page 38: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/38.jpg)
Removing
38
r
great every red yellow
lords bourgeois bourgeois lords
tt
build listen
cats dogs cats dogs
sleep follow
r
great every red yellow
lords bourgeois
tt
build listen
cats dogs
sleep follow
r
great every red yellow
lords bourgeois bourgeois lords
tt
listen build
cats dogs cats dogs
follow sleep
=-MarkovMDD ProhibitedMDD
Allsolutions
![Page 39: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/39.jpg)
MaxOrderMDDmodel
V
X1
X2
X3
X4
X5
X6
X7
X8
X9
X10
X11
IntersectionMDDGlobalValid
VariablesConstraints
39
V
V
V
V
V
V
V
V
![Page 40: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/40.jpg)
MaxOrder Results
• MDDcontainsallthesolutions• NolongerneedasolverJ• Canbeembeddedwithotherconstraints
• Benchmark“Proust– Àlarecherchedutempsperdu”• 11,000differentwords(domain)• MaxPlagiarism:4• Generatesequencesoflength20• 2creations&1deletion&16intersections
• MDDSize• 1Mnodes, 190Marcs• 2.2*1035 tuples
• Results• First:~400seconds, equivalent totheadhocalgorithm• Orderingeffect:143s
40
Compressionratio:1027
MDDGlobalValid
![Page 41: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/41.jpg)
Generationunderconstraints
• WhatifIwanttogenerateatextwithrhymes?
• Textandmusicusingsomeone’s“style”?
• Musicwithoutplagiarism?
• Poetrywithagivennumberofsyllables?
41
FindarhymewithcombinatorialThatdoesn’tsound artificial
Letitgo,letitgoCan'thold itbackanymore
Inthemonthofthe longdeclineofrosesI,beholdingthesummerdeadbeforeme,Setmyfacetotheseaandjourneyedsilent,
Algernon CharlesSwinburne
Examplewithimage
![Page 42: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/42.jpg)
Sequencewithagivennumberofsyllables
• Syllabicpoeticmeter• 12syllables
• Frenchpoetsfrom17th to19th century
• Automaticgenerationfromacorpus• Example• Grands seigneurs, toutbourgeoisveut batir comme unBœuf
• Greatlords,everybourgeoiswantstobuildlikeaBeef• Grands – sei – gneurs - tout– bour – geois – veut – bâ- tir – comme – un– Bœuf• 1 2 3 4 5 6 78910 11 12
42
![Page 43: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/43.jpg)
Sampling Model
Corpus
M
MarkovMDDm (Sizen)
43
![Page 44: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/44.jpg)
MarkovMDD
44
• Toycorpus:Greatlordslistenbuteverybourgeois listenwhilegreatbourgeoisbuildwheneverylordsbuild
redcatsfollowbutyellowdogssleepwhilereddogsfollowwhenyellowcatsleep
Redcatssleepr
great every red yellow
lords bourgeois
tt
build listen
cats dogs
sleep follow
![Page 45: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/45.jpg)
Sampling Model
Corpus
M
MarkovMDDm (Sizen)
M ∑
Arclabelreplacedbytheirnumberofsyllables
45
![Page 46: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/46.jpg)
ValueTransformation
46
Transformationr
great every red yellow
lords bourgeois
tt
build listen
cats dogs
sleep follow
r
1 3 1 2
1 2
tt
1 2
1 1
1 2
![Page 47: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/47.jpg)
Sampling Model
Corpus
M
MarkovMDDm (Sizen)
∑
∑(1,k)=12Sumofnvariableshavingthevalues1tokasdomain
M ∑
Arclabelreplacedbytheirnumberofsyllables
47
![Page 48: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/48.jpg)
SumMDD
• ∑(1,3)=5• Allthepathsarecomposedofvalueswhosesumis5.
r
1
1
2
2
3
3
2
1
3
2
4
3 1 2 1
tt
3 2 1
48
![Page 49: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/49.jpg)
Sampling Model
Corpus
M
MarkovMDDm (Sizen)
∑
∑(1,k)=12Sumofnvariableshavingthevalues1tokasdomain
M ∑
Arclabelreplacedbytheirnumberofsyllables
AIntersection
Allthesolutions
49
![Page 50: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/50.jpg)
Intersection
50
r
1
1
2
2
3
3
2
1
3
2
4
3 1 2 1
tt
3 2 1
r
1 3 1 2
1 2
tt
1 2
1 1
1 2
∩ =r
1
1
3
3
2
2
3
2
4
1
tt
2 1
3
11
2
![Page 51: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/51.jpg)
Conversion
r
1
1
3
3
2
2
3
2
4
1
tt
2 1
3
11
2
• Solutions:• Sequencesofsize2fromthecorpus• Sumofsyllablesequal5• (Usually12)
51
r
1
great
3
every
2
yellow
3
bourgeois
4
lords
tt
listen build
3
cats dogs
follow
Transformation
• NowSample!• BigMDDs
• Millionsofnodes• Hugeamountofsolution• 1090 in our problems
![Page 52: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/52.jpg)
Conclusion
• Learntomodelandsolvesomeproblems
• Usingstandalonemethods
• Usingbasicsofmodelingandsolvers
• Usingsomeadvancemodelingtools
• Providedgoodmodelforsomehardproblems
52
![Page 53: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/53.jpg)
ThankYou
• Questions?• ForrealJ
53
![Page 54: Combinatorial Generation Problemsperezguillau.me/document/combi_tutorial_2018.pdf · • Combinatorial problems are everywhere 2 Pickup and deliveries Knapsack problems Dams placement](https://reader033.vdocuments.net/reader033/viewer/2022053015/5f159275bc649e779b770f7c/html5/thumbnails/54.jpg)
CombinatorialGenerationProblems
GuillaumePerez