department of engineering math, university of bristol a geometric approach to uncertainty oxford...
TRANSCRIPT
![Page 1: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/1.jpg)
Department of Engineering Math, University of Bristol
A geometric approach to uncertainty
Oxford Brookes Vision Group
Oxford Brookes University12/03/2009
Fabio Cuzzolin
![Page 2: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/2.jpg)
My path
Master’s thesis on gesture recognition at the University of Padova
Visiting student, ESSRL, Washington University in St. Louis
Ph.D. thesis on random sets and uncertainty theory
Researcher at Politecnico di Milano with the Image and Sound Processing group
Post-doc at the University of California at Los Angeles, UCLA Vision Lab
Marie Curie fellow at INRIA Rhone-Alpes
Lecturer, Oxford Brookes University
![Page 3: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/3.jpg)
My background
research
Discrete math
linear independence on lattices and matroids
Uncertainty theory
geometric approach
algebraic analysis
generalized total probability
Machine learning
Manifold learning for dynamical models
Computer vision gesture and action recognition
3D shape analysis and matching
Gait ID
pose estimation
![Page 4: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/4.jpg)
A geometric approach to uncertainty theory
Uncertainty measures
A geometric approach
Geometry of combination rules
Simplex of probability measures
Complex of possibility measures
The approximation problem
Generalized total probability
Vision applications and developments
![Page 5: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/5.jpg)
assumption: not enough evidence to determine the actual probability describing the problem
second-order distributions (Dirichlet), interval probabilities
credal sets
Uncertainty measures: Intervals, credal sets
Belief functions [Shafer 76]: special case of credal
sets
a number of formalisms have been proposed to extend or replace classical probability
![Page 6: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/6.jpg)
Multi-valued maps and belief functions
suppose you have two different but related problems ...
... that we have a probability distribution for the first one
... and that the two are linked by a map one to many
[Dempster'68, Shafer'76]
the probability P on S induces a belief function
on T
![Page 7: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/7.jpg)
Belief functions as sum functions
1)( B
Bm• if m: 2Θ -> [0,1] is a mass function s.t.
• the belief value of an event A is
AB
BmAb )(
• m: Θ -> [0,1] is a mass function s.t.• probability function p: 2Θ -> [0,1]• the probability value of an event A is
1)( x
xm
Ax
xmAp )(
![Page 8: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/8.jpg)
Examples of belief functions
two examples of belief functions on domain of size 4
b2({x1,x3}) = 0; b1({x1,x3})=m1({x1});
b2({x2,x3,x4}) = m2({x2,x3,x4}); b1({x2,x3,x4})=0.
x1 x
2
x3
x4
• b1:
m({x1})=0.7, m({x1 ,x2})=0.3
• b2:
m()=0.1, m({x2 ,x3 ,x4})=0.9
![Page 9: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/9.jpg)
Consistent probabilitiesinterpretation: mass m(A) can “float” inside A
Ex of probabilities consistent with a belief function
half of {x,y} to x, half to y
all of {y,z} to y
![Page 10: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/10.jpg)
10
Two equivalent formulations
belief function b(A)
is the lower bound to the probability of A for a probability consistent with b
plausibility function pl(A)
is the upper bound to the probability of A for a consistent probability
![Page 11: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/11.jpg)
A geometric approach to uncertainty theory
Uncertainty measures
A geometric approach
Geometry of combination rules
The approximation problem
Credal semantics of Bayesian transformations
Complex of consonant and consistent belief functions
Moebius inverses of plaus and common
Vision applications
![Page 12: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/12.jpg)
Belief functions as points
if n=||=2, a belief function b is specified by b(x) and b(y) as for all bfs, b()=0 and b()=1 belief functions can be seen as points of a Cartesian space of dimension 2n-2
![Page 13: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/13.jpg)
Belief functions as credal sets
a belief function can be seen as the lower bound to a convex set of “consistent” probabilities
![Page 14: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/14.jpg)
it has the shape of a simplex
IEEE Tr. SMC-C '08, Ann. Combinatorics '06, FSS '06, IS '06, IJUFKS'06
A geometric approach to uncertainty
belief space: the space of all the belief functions on a given frame
![Page 15: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/15.jpg)
A geometric approach to uncertainty theory
Uncertainty measures
A geometric approach
Geometry of combination rules
The approximation problem
Credal semantics of Bayesian transformations
Complex of consonant and consistent belief functions
Moebius inverses of plaus and common
Vision applications
![Page 16: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/16.jpg)
Dempster's sum
comes from the original definition in terms of multi-valued maps
assumes conditional independence of the bodies of evidence
several aggregation or elicitation operators proposed
• original proposal: Dempster’s rule
![Page 17: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/17.jpg)
Example of Dempster's sum
• b1:
m({x1})=0.7, m({x1 ,x2})=0.3
x1
• b1 b2 :
m({x1}) = 0.7*0.1/0.37 = 0.19
m({x2}) = 0.3*0.9/0.37 = 0.73
m({x1 ,x2}) = 0.3*0.1/0.37 = 0.08
• b2:
m()=0.1, m({x2 ,x3 ,x4})=0.9
x2
x3
x4
![Page 18: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/18.jpg)
18
Convex form of
i
iii
ii bbbb
jjj
iii
AA
A
Bbb
bb bbBplBm
AplAmbb
, '
'
)()(
)()('
• Dempster's sum commutes with affine combination
can be decomposed in terms of Bayes' rule
![Page 19: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/19.jpg)
Geometry of Dempster’s rule
Dempster’s sum <-> intersection of linear spaces!
[IEEE SMC-B04]
Possible “futures” of b conditional subspace
b
b b’b’
other operators have been proposed by Smets, Denoeux etctheir geometric behavior? commutativity with respect to affine operator?
![Page 20: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/20.jpg)
A geometric approach to uncertainty theory
Uncertainty measures
A geometric approach
Geometry of combination rules
The Bayesian approximation problem
Credal semantics of Bayesian transformations
Complex of consonant and consistent belief functions
Moebius inverses of plaus and common
Vision applications
![Page 21: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/21.jpg)
how to transform a measure of a certain family into a different uncertainty measure → can be done geometrically
Approximation problem
Probabilities, fuzzy sets, possibilities are all special cases of b.f.s
IEEE Tr. SMC-B '07, IEEE Tr. Fuzzy Systems '07, AMAI '08, AI '08, IEEE Tr. Fuzzy Systems '08
![Page 22: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/22.jpg)
22
),(minarg bpdpPp
Probability transformations
finding the probability which is the “closest” to a given belief function
different criteria can be chosen
pignistic function
• relative plausibility of singletons
![Page 23: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/23.jpg)
23
Geometric approximations
the approximation problem can be posed in the geometric approach [IEEE SMC-B07]
pignistic function BetP as barycenter of P[b]
• orthogonal projection [b]
intersection probability p[b]
![Page 24: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/24.jpg)
24
Intersection probability
it is derived from geometric arguments [IEEE SMC-B07]
but is inherently associated with probability intervals
it is the unique probability such that [AIJ08]
p(x) = b(x) + (pl(x) - b(x))
b(x) pl(x) b(y) pl(y) b(z) pl(z)
![Page 25: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/25.jpg)
25
Two families of probability transformations (or three..)
• Pignistic function i.e. center of mass of consistent probabilities
• orthogonal projection of b onto Pintersection probability
• Relative plausibility of singletons
• Relative belief of singletons [IEEE TFS08]
• Relative uncertainty of singletons [AMAI08]
commute with affine
combination
commute with Dempster's combination
![Page 26: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/26.jpg)
A geometric approach to uncertainty theory
Uncertainty measures
A geometric approach
Geometry of combination rules
The approximation problem
Credal semantics of Bayesian transformations
Complex of consonant and consistent belief functions
Moebius inverses of plaus and common
Vision applications
![Page 27: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/27.jpg)
Interval probs as credal setseach belief function “is” a credal set
each belief function is also associated with an interval probability
interval probabilities correspond to credal sets too
“lower” and “upper” simplices
![Page 28: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/28.jpg)
Focus of a pair of simplices
different Bayesian transformations can be seen as foci of a pair of simplices among (P,T1,Tn-1)
• focus = point with the same simplicial coordinates in the two simplices
when interior is the intersection of the lines joining corresponding vertices
![Page 29: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/29.jpg)
Bayesian transformations as foci
relative belief = focus of (P,T1)
relative plausibility = focus of (P,Tn-1)
intersection probability = focus of (T1,Tn-1)
[IEEE SMC-B08]
![Page 30: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/30.jpg)
TBM-like frameworks
Transferable Belief Model: belief are represented as credal sets, decisions made after pignistic transformation [Smets]
reasoning frameworks similar to the TBM can be imagined ...
... in which upper, lower, and interval constraints are repr. as credal sets ...
... while decisions are made after appropriate transformation
![Page 31: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/31.jpg)
A geometric approach to uncertainty theory
Uncertainty measures
A geometric approach
Geometry of combination rules
The approximation problem
Credal semantics of Bayesian transformations
Complex of consonant and consistent belief functions
Moebius inverses of plaus and common
Vision applications
![Page 32: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/32.jpg)
Consonant belief functions
focal elements = non-zero mass events
consonant belief function = belief function whose focal elements are nested
they correspond to possibility
measures
they correspond to fuzzy sets
![Page 33: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/33.jpg)
Simplicial complexes
simplicial complex = structured collection of simplices
All faces of a simplex belong to the complex
Pairs of simplices intersect in their faces only
![Page 34: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/34.jpg)
Consonant complexconsonant belief functions form a complex [FSS08]
examples: the binary and ternary cases
![Page 35: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/35.jpg)
Consistent belief functions
consistent belief function = belief function whose focal elements have non-empty intersection
consonant bfs <-> possibility/necessity measures
consistent bfs <-> possibility distributions
they possess the same geometry in terms of complexes
consistent approximation → allows to preserve consistency of the body of evidence [IEEE TFS07]
can be done using Lp norms in geometric approach
![Page 36: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/36.jpg)
Projection onto a complexidea: belief function has a partial approximation on all simplicial components of CS
global solution = best such approximation
b CSxCSy
CSz
![Page 37: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/37.jpg)
the binary case again
consistent/consonant approximation are the same in the binary case
not so in the general case
![Page 38: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/38.jpg)
Partial Lp
approximationsL1 = L2 approximations have a simple interpretation in terms of belief [IEEE TFS07]
left: a belief function right: its consistent approx
focused on x
m'(Ax) = m(A) A
![Page 39: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/39.jpg)
Outer consonant approximations
each component of the consonant complex → maximal chain of events A1 Ai An
in each component of the complex consonant approxs form a simplex
[FSS08]
each “vertex” is obtained by re-assigning the mass of each event to an element of the chain
![Page 40: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/40.jpg)
A geometric approach to uncertainty theory
Uncertainty measures
A geometric approach
Geometry of combination rules
The approximation problem
Credal semantics of Bayesian transformations
Complex of consonant and consistent belief functions
Moebius inverses of plaus and common
![Page 41: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/41.jpg)
Moebius inversionBelief function are sum functions
analogous of integral in calculus
derivative = Moebius inversion
belief function
b.b.a.
plausibility function
commonality function
?
?
![Page 42: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/42.jpg)
Congruent simplicesplausibility functions pl(A) live in a simplex too
same is true for commonality functions Q(A)
geometrically, they form congruent
simplices
![Page 43: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/43.jpg)
Equivalent theoriesthey all have a Moebius inverse
alternative formulations of the theory can be given in terms of such assignments [IJUFKS07]
belief function
b.b.a.
plausibility function
commonality function
b.pl.a.
b.comm.a.
![Page 44: Department of Engineering Math, University of Bristol A geometric approach to uncertainty Oxford Brookes Vision Group Oxford Brookes University 12/03/2009](https://reader036.vdocuments.net/reader036/viewer/2022062511/5515eb0a55034638038b5060/html5/thumbnails/44.jpg)
Conclusions
uncertainty measures of different classes can be represented as points of a Cartesian space
evidence aggregation/revision operators can be analyzed
the crucial approximation problem can be posed in a geometric setup
geometric quantities and loci have an epistemic interpretation!
extension to continuous case: random sets, gambles
behavior of aggregation operators: conjunctive/disjunctive rule, t-norms, natural extension