visual motion tracking

42

Upload: martemartemarte

Post on 21-Jul-2016

14 views

Category:

Documents


1 download

DESCRIPTION

Visual Motion TrackingVisual Motion TrackingVisual Motion TrackingVisual Motion TrackingVisual Motion Tracking

TRANSCRIPT

Page 1: Visual Motion Tracking

! #"%$'&)(+*+,.-/$102(3"! #"546$879"%$:79".;<(3,540>=?7%@A; =?(B$102(3"?CD(3=!EF,5$'0>".@!GB024H,.79IJ=?(.$102(3"KL0M4H,579IF$1&N7%-PO%0Q".@

Page 2: Visual Motion Tracking

! #"$#%&#')(*+'-,/.0'(1#"324"$(5(.768'96:;#.<! +=>%?6(.76@'BA"3 -A.C+=EDF %&6G(H.6@'B,(1-A!(.768'JIK)(L(M#'(.76@'-NF .'(M#"324"$(O)(H.6@'&6:; @F(8P8=?(B$'0M(3"F (OQ"SR(T("U-AV4.0'-R

XW YAZ6@'!.[,#"KDF \ "]61^-A!(M-,.0%_`RY%&6G(H.6@'F ! #"3.'-R.'ZM(5#')(O+'446@ &.0%_`Ra%?6(.768'/IK#'`,#2#2+=.[A`)(.76@'HNF b "U`AV4.'-R

Page 3: Visual Motion Tracking

@ @ 0

x

z^

y^

Image plane

Opticcentre

x^

SceneV

Ω

f

X

!" # $ %'&)(+*,(.-0/21

3 $ 4 # -56879:;<=?>=+@+BACDFE;GD+HI"@<

J3 $ 4J#- K 4

# J--ML

NO=PQRTSU<VW"@< XS8S+YSZ:[\>]S^_>= ` >]RHa<>=cb ;:^_>=edRf+gQVZV>:"@<\>ihkjlnm

J# $ % J&o( J* ( J-0/ 1 $p`pqrb sI#t #'-AZBIYu " . (H.0'-R vw x vy z=|~ #'`, (V4& Z!.0'-R (V4&24#" !24-A!(. ;Q* )(H.6@' (16_#=.0%a.0')(1 y ND

v x K yw y I K y N z|

w x K w

I K z| Nw

IU N z|

Page 4: Visual Motion Tracking

@ @ 0 -

v x K w w

IU N

6(M?(V(ZD b 4a,#2(V w ,6Z?'Q6(*#2#2Q4" u*.<(V "$6(5(.768'

F !#"$%&(') * +,-.&/) 02134 657')* 65* 89-:;1<$%* =57'>

b 4a,#2(V w +2#244" )u*. (&("U#'Z!=[(.768' K Z K0? w

F *1@ *A;5E5$*ACBP4HEF; ;P* 1<$*D"E4 GFHD&0I7JF)KDLM

b 4 ,#2)(N+!244-, A`+=.0'-R*#%PO#. R #.<(Q %?#'(V(68'4 A`+'#'46G( (1#=0= uB4(V4#">568%&R(+.'-R?.< =C4"SR : Q" Ru Q*+'-,?%?6G;+.'-R #.[AV4=SQ 6>" !%_+== '44"TR (16B#'-,?%?6G;+.0'-R !=76iu*=UQWV

Page 5: Visual Motion Tracking

0 =

' (V#.<##%Y2#=7 (4#"$ . /+' .0'-,#24#'`,#'(=UQ %?6G;+.'`R 6)O ^-A!( .' (4 AZ#'4 O# (_(V4A`+%?#" Y.< #=<56 "$6(5)(H.0'-R)V

!"$#&%(')#*)+&# ,-#/./01'23#&46587& +/.2:9$ <; =>?@#>A'2B& .)+1C*/DEFGH.< :*).29$ <;I ,6@%?(H"TQ :K"$6@% (V4&A`#%?#"U&J-Z 24"$6G;+.[,- K A4-AVO--AV (16ML '`,&(V)(*"]6G(O)(.76@'-#=%?6(.768'+= .< .'-,-#24#'-,#'( 6:(V4?(V4&AZ#'4Y,#2)( w V

vONQP-RTSJRVUPXWQSZY x I. N zl|

Page 6: Visual Motion Tracking

1 k 0

#2#2465&()( x x O# ( # x V 6iu

v x w I N x

w &

_, . ;4#"SR#')( 6 u L #= , u*. ( v x )( x W 4#'r x : 6>" AZ#'Q v x uB4#' K x# 6>"

v x uB4#' x K#

b +. (.768'aH QZ*(-(Q 6@ A`#'B(H"$)( (Q_(" +'Z!=[R(.768'+=;Q#=76A.<(QLK ZB " Q #'`, L '-, uB4#"$ .<( #.<(L (Q.0%_`RY2#=C+'4+V b #.<[email protected]'(X.'/(V4 .0%_`R .<aA`#=0=7-,/(Q/: 6 A ZY6G: <R2-#'Z!.6@' IA6V0: V ;5EF0>EF(3I2;8N

2#24"$6 `A#.'-R

-AZ-, .0'-R

Page 7: Visual Motion Tracking

~ . ` >l +2#246 5/`RG+.'B(-( x O# ( (V( w ;-4"3.7Z*!%?6>6(V#=SQ V b 4J24"$6 ^ -A!(1-, %?6(.76@'.<

v x[ v v] x

w I K N xw

[ #

]

b Q*J0 G ;.& @A;5"B- ; 6:(V4 %?6(.768' L #= ,J. z v x v

v

x w

(

w

) I N~ w

(

w

) I N w

: HQ (4&AZ#'Q . +2#24"$6 `A#.'-R u .<(V x x (Q#'X( x x

z v x w x

ua4#"$ . (V4$'0>=?;!$:( - (3"%$:7%-/$L 68.'-R O`AV (M6 B:K"$68'(16!R 2Q"U#=0=7#=2#=[#'Q (Q#' x x +'-,Y56 D M * .' (4 .0%_`R z v x

Page 8: Visual Motion Tracking

T~M >l =

Page 9: Visual Motion Tracking

T~M >l =

Page 10: Visual Motion Tracking

T~M >l = O

Page 11: Visual Motion Tracking

T~M >l = O

Page 12: Visual Motion Tracking

@ E >kM O t !;4 AZ68'Z!.[,-#"]-, 568%& Z5Z 6G: 24"$6 ^ -A!(1-, %&6G(H.6@' O# ( '46((Q!(_, . A 15-, Q6 u (166)O(5#.0' %&6G(H.6@' L #=[,9:K"$6@% .%B-R-#" QWV V Vb +"]4ou Q`D V b 68V5#' OZ5-,

AZ6@%Y2# (M_AZ6@'+"]#" .0'9! -A4AZZ1!. ;Q :K"U+%&Z %_)( A_AZ6>"3'4#" Z!.0'-RY56@%? 24"$6 .%Y.<(Q9#'-,!N6>" !.%Y..0=C4"3. (Q AZ6"]Z

V "U`, .7#'( O5-, , ."$-A!(=UQ :K"$68% O4"3. R #'4Z1 ;-#=0 4Z R "$( .<:AZ6>"3'4#",(M-A!(16>" 6" %B)(5A4#" +'#"$#=.C7O#=

V \ Z5 O5-,W == =766@V&)(?I N .'?56@%?_,(5#.0= 6>" I N 54ou 6>"3V 6: I -R#N t 4-R#" =4( +'-,X6(V4#" DV V V

Page 13: Visual Motion Tracking

> 0 @V @ 0 O u 6>"S,X6G:Pu 4"3'#.0'-R)V V V68%a2Q"$?B"$6(5(.'`R !'46>68VO#" O+==-#'-,_ M(O)(.76@'-4"TQB=0.[R )( 568 #"SAZ u .<(V& M(5(.768'4"TQO-#=0=+'-,X%&6#;#.0'-RJ=0.[R (T56@ +"UAZD

moves, so visual motionis non-zero.

Scene still, but highlight

Highlight stationary

Highlight moves

Scene moves, butvisual motion is zero

' R#'4#"U#= 6)OZ5#" ;-!O#= .0%_`R %&6G(H.6@' u*.0== '46G( G`A!(=UQ += 24"$61^-A!(M-, .%B-R%?6(.768'+V ( 6:U(M#' . ( (V4/O4ZM(cu YA`#'Y,-6 IK#'-,X"$Z568'7O#=7a+2#24"$6 .%B(.768'+V V V N

Page 14: Visual Motion Tracking

> l@ >kM 0 O -R#4"S, (V4 .%B-R H+%a2#=0.'-R6: AZ68'(.'# 468 Z ."3"U`, .C+'-AZ :K #'-A!(.768'0x I N*V 6@==6 u E.7 & $10M- , I27 & .0%_`R 2)( A 6G;Q#"(H.0%&+V 'T(V#.< A`5 x I N #'`, x I N +'-,(16G(O+= ? %Y ZM( . M(LDV

I(x,y,t)

t

!.'-R_(V4YA+.' "3 #=D

x

)( . : .< AZ6@'ZM(5+'( .0'?(Q .%B-Ra2( A ? x 56J(V( x

Page 15: Visual Motion Tracking

> l@ >kM 0 - O

x

t #'-AZX. :Pu ou*"3.<(M 0x [

]

x[

]

t #'-AZ u aQ"3" . ;QY( (V4=?(B$102(3" 6>"5& 0M@ A5$'"5; 4 4 - (3"546$1&N790>"%$ ;+,57P$102(3" Pz x

ua4#"$ . A`+==7-,&(Q (3E%$10M- 79IJ( V

Page 16: Visual Motion Tracking

~ ~ 3 U O

W !;Q '46( "]-AZ6#;Q#"]-, V V V6@'#=SQ (V4 AZ68%a2468'4#'(?6G: +=768'-R/(4 , .UR"$-A!(H.6@'96G: Vb #. D5F #& D" 6>" * ! * *" $ M.

G x ( z

) (

)

x (

)

µ

v

b +. : +.=0 #"$ (M6B"]-AZ6#;Q#" O46(V*AZ68%a2468'4#'(L .<A`#=0=7-, (V4 EF;.& $1,F&);D&)( FI2;.= V b #V4.0'-RR" `, .#'( %?+'Z (V49.':36>"3%_)(H.6@' !OQ6@ ((4?.'(M#'Z!.<(Q&. =76A`#= *.<: 54#'*(#"$68 -R &+'+24#" ( #"$+V

Page 17: Visual Motion Tracking

K @ E ~ ~ 3 U @ O

'( #. (H.6@' (M#==< Z (V( (V4#"$ :46@ +=[,0O49'46#2Q#" ( #"$_24"]6)O#=7#% .<: (V4#"$Y.<* O4" . R ('4Z1R "U-,.7#'(.' ( u 69, .0"$-A!(H.6@'Z. V +V( - (9& P"5;.&)4

"URu*.0'-RJ.'!2#."U)(H.6@'?:K"$68% (V4 \ =7Z15QBAZ6>"3'4#",-(1-A!(M6>" 24"$6 AZ4-,XZ : 68==76iu `D 6@'!.[,#" (" `AV4.'`RX !%B#=0=Q.%B`R 2)(5A 1! #%&-,*(M6 !;4 ("U#'Z!=[(.768'+=4.%B-R%&6G(H.6@'+V

#( I N x ∑

I 9 N I N

[ I N

o I N

I N

]

Page 18: Visual Motion Tracking

K @ E ~ ~ 3 U @ - O

I N ∑

[ I N

o I N

I N

]

. #"$#'(.C)(H.0'-R u(V " V0(<V =Q+.7#=[,4`D

x ∑

[

o

]

x

x ∑

[

o

]

x

]u " . (1a

( )

( )

(

)

(

)

[ ] x

[ ( )

(

)

]

Page 19: Visual Motion Tracking

@ E O

]u*"3.<(MY

( )

( )

(

)

(

)

[ ] x

[ ( )

(

)

]

x

.<*6: AZ68 #" 5?(Q %_)(H"3. a,ZA"3.EO#.0'-R_(Q =76 A`+=G# (M6 AZ6" "$#=[(.768'+V b # Z`D ' "]-R.76@' 6: #'+.<: 6>"3% O4"3.[R )(H'4Z1 a"U+'#V +'-, u JA`#' 0( 568= ;Qa: 6>" 6@2)(H. A 6 u

I '9#' -,+R " +'#V +'-, u &A`+' L '-, (V4 "5(9& =?79I.- (3=!EF(3"5;."%$ 6:6@2)(H. A 6 u

( AZ6>"3'4#" :K #=0=8"U+'#V IL.LV +V N +'-, u A`+'a568= ;QY(V4 -(.768'Z (M6 L '-,F(B$<A - (3=!EF( ".;5"%$84 6G: 6 u@V

Page 20: Visual Motion Tracking

@ E O (B$:; 4 b 4 L " M(&6>"S,#" +2#24"$6 .%B)(H.6@' 5-,6@'+=UQW468=[,`: 6";4#"TQ !%B#=0=L;-#=0 4Z 6: V

b 6 "$-AZ6G;Q#" O#.[R+R#" 6 u Z5B.[, 6: 79,.4 4H0279" E &)79=!0M* DF -A4AZZ1!. ;4#=SQ !%&66(V #'-, ! !O RH+%a2+=7 .%B`RZ

Page 21: Visual Motion Tracking

>k E O b Q +.% 6: ;+.<! #= (H"U`AV4.'-R . (M6 =76A`(Ma(V4 246 !. (H.6@'N246 5J6: a(OQ"UR-(B.' .%B-R! `A4AZZ1!. ;Q#=UQ?6#;Q#" +'_Q(1#'`,-,_5 4#'`AZB6: .0%_`RZDV 7 & @A;<$ "$ +."$&56@%? +2#24Q"U#'-AZ %&6,#=

.%B-R-X2)(5A AZ68=768 #"f#. M(M6 R" +% ,: 6>"3%B!O+=7BAZ68'(M6@ #" BIL.LV +V -,#R-ZHN %&6,#=

(94H0 $102(3"CBBEF(94 ; .%B-R-X246 !. (H.6@' .%B-R-X246 !. (H.6@' 2+= Z ,: 6" %B)(H.6@'Y24"U+%&(M#" (H"U+'Z!=C)(H.6@'X+'-,/"$6(5(.768' :K #=0=6O46,%Q 246 5_6: 4" (H. A #=C)(M-,_6)O ^-A!(<V V V

#( M(54" ( !.0%a2#=SQ0OQ (H"U`AV4.'-RX2#=C+'Q" .0%_`RX2-( A+V V V

Page 22: Visual Motion Tracking

_ 0 OL

fp ( )

T I

W 54#V (Q .%B`R 2Q6 !.<(.768' E x uB#. A9%B.%Y. 5Z (Q !.%Y.=CQ"3.<(Q(16 (Q?(1#%Y2#=C)(M n! (. ;Q 54"SA 246 1!.4O#=7 O# )( #'-,R!."U7O#=7 ( (1#"(M6_,6_R" `, .#'( AZ#'(N ,ZAZ#'(

Page 23: Visual Motion Tracking

k l U 8 O

6>"3%a +=C)(1 54"SA Z #' 6@2)(H.0%a.<H(.768'24"$6 O#=#% Z!.'-R O4"3. R ('4Z1AZ6@'ZM("U#.0'( 6@ +"6)O ^ -A!(H. ;4 :K #'-A!(.768'

I 2(.%Y. !.0'-R "5(3" P - (3" G ; :K +'-A!(H.6@' 56'44-,B(M6JM(54" ( '44" 56@=0 (.76@'

#2#24659M(OQ" (.'`R/[email protected]'( .< D .0'#.%Y. 5D

I N x ∑

I N I N

u(V " V0(<V V

Page 24: Visual Motion Tracking

k l U 8 O

2#'`, .'-R_(M6 L " M( 6>"S,#" u B6 O)(O+.'D I N ∑

[

I NM [

]

I N ]

b +V4.'`R 2-4" (H.[#=< u(V " V0(<V Q+.#=[,``D ∑

[

I NM [

]

I N ] x

t #'`AZ

[

] x

I +N I N

6G(1&(V4/IL #'Z! #"324"3. !.0'-RGN !.%Y.=CQ"3.<(Q (16(4B682(.[A 6iu 56@=0 (H.6@' ( #'`,/.<(M#" )(MX #'(.=GA#'`R '4-R =. R .EO+=7+V

Page 25: Visual Motion Tracking

k l E 0 O

\ #"$ (H"U+'Z!=C)(H.6@' A`+' O4 6#;Q#" =SQ "$RM(" . A!(H. ;Q

=[R6" . (+% R#'4#"U#=0. 5Z M(H"U+.[R )(L: 6" Ru 4"S, =SQ

fp ( )

T I

#2+246 5 "]#24"$Z5#'(L =6 A`)(H.6@'a.'a $8;5=!E I27P$8;W &54#V?95( 6: 2-4"U#%?(M#" E ! `A&()( (4 7 & E ,F".-/$102(3"

E I N+=. R 'Z (V4?(M#%a2#=[(MIu .<(VX#' .0%_`R I N<V

Page 26: Visual Motion Tracking

k l E 0 O b Q?:K #'-A!(.768' AZ68 #=[, OQ #.<(MYR#'4#"U+=LV b Q+2#.[A`+==SQ . (cu .==O4D

\>]GSD^?> $ ]( ,mP4 % 3 / $

\>]GSD ;: $ ( ]( m 4 % 3 /$

\>]GSDVSUR>]^ $ i( ]( mP4 % 3 / $

>TA]:R<\>]^ > Ceim 4 % 3 / $

! " ! L # %$ L L!L L $

Page 27: Visual Motion Tracking

k l E 0 OL ( #"3'#.'-R9(16 (4 O4"3.[Rn(H'QZ1 AZ68'ZM(" +.')( `RG+.' u '44-,9(16 %a.0'#.%Y.ZD

I E N x ∑

[ I EPE I N N I N ]

u@V " V0(%V E V 2+'-, .0'-R_(M6 L " M( 6>"S,#" u _6 O(5#.0'D

IE N ∑

[

I E I N NM E

E I N ]

b +V4.'-R/2Q" (H.[#=< u(V " V0(<V E Q+.#=[,``D ∑

[ E

] [ E

E I E I N N I N ] x

t #'-AZ∑

[ E

] [ E

]

E x ∑

[ E

] [ I N I E I N N ]

Page 28: Visual Motion Tracking

k l E 0 - O

[ E

] [ E

]

E x ∑

[ E

] [

I N I E I N N ]

E x

x

6(M ()( (V4 R "U`, .7#')( Q"$AZ6@%Y2# (M-, )( E I N

f ( )p x

T I

Page 29: Visual Motion Tracking

k l M O

. ;Q#' (M#%Y2#=C)(1 .0%_`R I N +'-, A #"3"$#'( (H"U`AVO#" 2-4"U#%?(M#" E I ND E E I N #2Q(ZD

x ∑

[ E

] [ E

]

x ∑

[ E

] [

I N I E I N N ]

E x

E IKN x PE E IKN

#'(.= E E I N E

Page 30: Visual Motion Tracking

k l O

b 4_24"]Z1!.6@'Z =6>68VB'ZM(.7#" (V+'&(4QYQ"]+V Z Q?(M6 R6 O-AV (M6(V4?(" +'Z!=[(.768'#=GA`Z5D

E I N x E

x [

]

PE I N E I N x

x

a

XW a4"$a`A!(H -#=0=UQB,68.'-R X=76G( %?6>"$ u 6>"3V (V+' u '44-,B(M6 A`+=[A #=[(.'-RaR "U-,.7#'(L.'&(V4 .%B`RY)( `A .<(M#"U(.768'+VF .'ZM(M`,_24"$R AZ68%a2# )(1 *&('+" R "U`, .7#')( *&' " t Z1!.[#' (5A +'-, u Q"32 (V4B6(V4#" u Q VTV V 54?(H (M&:44(

>. ;4B,#%&6CV V V

Page 31: Visual Motion Tracking

K @E O = (1#"3')(H. ;QX"$-R .768'?(H"U`AV5#" V4'46 u*'X (4 =?;<79" P 4GAF0 $$'&)7%-PO ;.& V 5-,a68'D #'X+2#24Q"U#'-AZ %?6 ,-#=iuB+.[A .< (4?(54"SR( AZ6@=6@ #"0#.<M(16R "U#%

%&! #"$ 6G: !.%Y.=[4"3.<(QOQ(+u 4#' AZ6@=768 #"k#.<M(16R "U#% V4'46 u ' Z(4D7P$:$87%- A57 & 7- (3; - 02;."%$#D

IE I N N x ∑

√ I N

uB4#"$E I N .< (V4?AZ6@=6@ #" #.<M(16R "U#% 6: B"$-R .6@'?AZ#'("$-,_( .0%_`R92468.'( 6 +'-, . (V4aAZ6@=768 #"f#.<M(16R "U#% 6:(V4?(54"SR(<V

p4#'-AZ (H"U`AV4.'-R "$ #.0"]ZY Z (16 %BJ .0%a.<5 I N&Z_ :K #'`A!(H.6@'J6: .0'J-A ! -AWRAZZ1!. ;Q?:K"U+%&

Page 32: Visual Motion Tracking

K @E O L #.0"$

%B IE I N N RG+.' u AZ68'Z!.[,-#"8R "U-,.7#'( AZ#'( O# ( (H +" ' 6@ ( '46G( (16 O4 56B+%&#'-!O#= (16&+'#=SQ)(H. A+2#24"$6 `A+V #. ;Q'# #%?#" . A`#= +2#24"$6 `ADYZM(H.0%_)(M I N ? I N? OQ/:#.<:S(H.0'-R !%B+==+%?6@ #'(*+'-,/"$4);+= -(.'-R

I N

[ I # N I N ] ? # I N

[ I % N I N ] ?% dx

dy

( (+. . AZ68%a2# )(O)(H.6@'+==SQ9AZ6 M(=UQ 'M(1`, A=7);Q#". ,X. (M6 Z5 &/<# 1W! - ZM(.%B)(1?6: R "U`, .7#')(%V VTV

Page 33: Visual Motion Tracking

K @E O W )( .< (V4 =?;<79" P 4GA 0 N$

xx

6>" #'QB,-#'Z!.<(Q :K #'-A!(.768' (V4Y%&+'&6G: 5(T6G: H+%Y2#=7Zgu*.=0= O4 O#.[Z5-,?(16iu 4"S,` =6 A`+=%&6,/IL.LV +V =6 A`+=%B.0%a #%BN b 4 =?;<79" P 4GA 0 N$ ;Q-A!(M6>" [email protected]'(L?.0'?(V4 5DE D$ )- F6!5D * 8

Page 34: Visual Motion Tracking

K @E O `AV (M6 .%B`RZ`D(V4Y,#'Z!. (Q (16 %_J.%Y. 5_. (V4 ( (O`AQ" QBAZ6> A.7#'(

IE I N N 6@%Y2# (M E I N (V4aAZ6@=6@ #"f#.<M(16R "U#% )(T(V4aA #"3"$#'( =6 A`)(H.6@' -AY2#. #= .' (QIu*.0'-,6 u 4"$6@ +'-, 24"$6#;#. ,Z *JF 8 D5 H#%Y2#=7+V #2#2465X.<(LAZ6@=6@ #" . .0'/O#.0'/6G:(V4 #. M(M6 R" +% (4#' (4ou #. R ( . R . ;4#' OQ

x √ ? .LV +V(V4&V Q"$"$66( 6:(V4 =0.V5#=. 46>6, "U)(H.6

6@%Y2# (M?(V4 %&+'?:+.<:U(ZD I N x ∑

2-,G)(MXA +" "$#'( 246 !. (H.6@' #'-,/. (1#"U)(1 I N 6>"^ ZM(

∑ ∑

Page 35: Visual Motion Tracking

K @E O (B$:; 4 b 4 u #. R (LX4"$ A" `A.C+= !.0'-AZ 6G(R#"\u*. 5 (V4 H+%a2#=Z 4"$ !.%Y2#=SQ (2#. #=_=6 A`)(H.6@'Z +'-, (V4#"$: 6>"$ #'#.UR: 6>"3%Y=UQ9,. M(" .4O# (M-,

( u 6>"3VH O4-A`+ Z5 (Q #')(H. (Q∑ ∑

. O#.C5-, (M6 u 4"S,` %?6 ,DAZ6@=6@ #" B4"$ %&6"] =0.V5#=UQY(M6 %B( A .' AZ6>"3"$-A!( , ."$-A!(.76@' Q#'-AZ (V4u #.[Rn( u*.0== 6@' );Q#"U`R O4 R#"U(M#"A=765#" (16 (Q " ( 4 =76A`(.768'

.[, . A #=768 Z!=UQ !.0%a2#= (M6 .%Y2#=#%&#'( ;Q#"TQB -A!(H. ;Q_+'-,B;Q#" Q : ZM(

>. ;Q_,#%?6

lower weights,on average higher weights

on average

True location

Current location

Page 36: Visual Motion Tracking

_ 7 1 O $1&N7%-PO ;5& t Q"3" .< 1! #%&Z A`+=.4O4" )(M-,XA`+%&#"U_#'`,/" . R .[, 2Q6@=UQl4-," +=>%?6 ,-#=GAZ68'Z!. M(.'-RY6:

F -,#RZF $% 8 "')4 8 1 68' %&6,#=-,#RZ

C

z

x

y

Optic axis

P

T

ωv

Page 37: Visual Motion Tracking

& O L

6>6"U,.')(1Z*6G: _AZ6@'("$6@=>2Q6@.')(*R . ;Q#'/IL.'aA`+%&#"U :K"U+%&N OQy x

:U(1#"&!%_+==%?6(.76@'G y x G

t #'`AZ x

[ ? w ? w

]

[ I I 6 N5NC? I N I ) , I , `N N ? I N

]

x

[ 6 6 6

] [ G

]

Page 38: Visual Motion Tracking

& O

x [ G

]

6>"`A AZ6@'("$6@= 2468.'( %?Z! #"$ , . R(5#'-AZ (16 -,+R .' .0%_`R x " z I N x "

[ G

]

W . ( AZ6@')(H"$6@[email protected]'(L %a.0'#.%Y.Z I G N x ∑

[

" [ G

]]

u(V " V0(<V G (16/6 O(5+.' 2465 #2-,G)(1+V W "U+2?(+. #2 .'Y 79IQ=?79" 30QI2$:;.&

predicted edge

measured edge

control point

located edge

x’

x

n

Page 39: Visual Motion Tracking

l M M O

2Q6@=UQl4-," +=>%?6 ,-#= 5Q"SAa( ;-4"3.768 Z 2468.'(L '46>"3%_+=4(16 24"]61^-A!(M-,%?6 ,-#=+-,#R-Z .= (1#" M(5(M/I/,6G:HN !.'-R AZ68'ZM(O+'( ;4#=6 A. (Q

Predict

Measure

Update

Page 40: Visual Motion Tracking

l M M O

2Q6@=UQl4-," +=>%?6 ,-#= 5Q"SAa( ;-4"3.768 Z 2468.'(L '46>"3%_+=4(16 24"]61^-A!(M-,%?6 ,-#=+-,#R-Z .= (1#" M(5(M/I/,6G:HN !.'-R AZ68'ZM(O+'( ;4#=6 A. (Q

Predict

Measure

Update

Page 41: Visual Motion Tracking

l M M O

2Q6@=UQl4-," +=>%?6 ,-#= 5Q"SAa( ;-4"3.768 Z 2468.'(L '46>"3%_+=4(16 24"]61^-A!(M-,%?6 ,-#=+-,#R-Z .= (1#" M(5(M/I/,6G:HN !.'-R AZ68'ZM(O+'( ;4#=6 A. (Q

Predict

Measure

Update

Page 42: Visual Motion Tracking

l O b " `AV4.'`R/" . R .[,Y6 O ^ -A!( T: 6>" (1#=46@24#"U)(H.6@'Z