human stereo mpg class slidescs.wellesley.edu/~cs332/ppt/human_stereo_mpg_class...stereo disparity...

4
1 Matching features for the MPG stereo algorithm zero-crossings of image convolutions with Ñ 2 G operators of different size L M S rough disparities over large range accurate disparities over small range 1 Zero-crossings for stereo matching 2 Zero-crossings for stereo matching 3 disparity map left right 30 20 10 0 evolving depth map bird’s eye view screen 4

Upload: others

Post on 27-Jan-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

  • 1

    MatchingfeaturesfortheMPGstereoalgorithm

    zero-crossingsofimageconvolutionswithÑ2GoperatorsofdifferentsizeL

    M

    S

    roughdisparitiesoverlargerange

    accuratedisparitiesoversmallrange

    1

    Zero-crossingsforstereomatching

    … …

    2

    Zero-crossingsforstereomatching

    … …

    3

    disparitymap

    left right

    3020100

    evolvingdepthmap

    bird’seyeview

    screen

    4

  • 2

    disparitymap

    left right

    3020100

    evolvingdepthmap

    bird’seyeview

    screen

    5

    disparitymap

    left right

    24144-6

    evolvingdepthmap

    bird’seyeview

    6

    disparitymap

    left right

    20100-10

    evolvingdepthmap

    bird’seyeview

    7

    disparitymap

    left right

    6-4-14-24

    evolvingdepthmap

    bird’seyeview

    8

  • 3

    disparitymap

    left right

    100-10-20

    evolvingdepthmap

    bird’seyeview

    9

    disparitymap

    left right

    0-10-20-30

    evolvingdepthmap

    bird’seyeview

    10

    Multi-scalestereoprocessing

    left right

    Addtogether:(likeahybridimage)•coarsescaleimageswithcoherentstereodisparities

    •finescaleimageswithuncorrelated”noise”

    Outcome:•canstillfuseimages•toleratelargerangeofstereodisparity•getaroughsenseofdepth

    11

    Multi-scalestereoprocessing

    left right

    Addtogether:(likeahybridimage)•coarsescaleimageswithuncorrelated“noise”

    •finescaleimageswithcoherentstereodisparities

    Outcome:•canstillfuseimages•onlytoleratesmallrangeofstereodisparity

    •morevergenceeyemovements

    12

  • 4

    SelectivityforstereoboundariesinV2

    VonderHeydt &colleagues:SomeV2cellsareselectivefortheorientation,contrast,andsideofborderownershipofanedge...foredgesdefinedbyluminanceorstereodisparity

    13