critical configurations for projective reconstruction fredrik kahl joint work with richard hartley...

32
Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct 2015

Upload: ethel-thompson

Post on 18-Jan-2018

220 views

Category:

Documents


0 download

DESCRIPTION

Given images, reconstruct: –Scene geometry (structure) –Camera positions (motion) Unknown camera positions Structure and Motion Problem

TRANSCRIPT

Page 1: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Critical Configurations for Projective Reconstruction

Fredrik Kahl

Joint work with Richard Hartley

Chalmers University of TechnologyLund University

Oct 2015

Page 2: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

• Problem statement• Two-view critical configurations• Three views and more• Conclusions

Outline

Page 3: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

• Given images, reconstruct: – Scene geometry (structure)– Camera positions (motion)

Unknown cameraUnknown camerapositionspositions

Structure and Motion Problem

Page 4: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 5: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 6: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Investigated previously by:• Krames (1940)

• Hartley & Kahl (2007)

• Buchanan (1988)• Maybank (1993)• Maybank & Shashua (1998)

When is the solution unique?

• Bertolini, Besana, Turrini (2007,2009,2015)

• And others...

This work: Complete classification of all critical configurations in two and more views

Page 7: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 8: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 9: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Notation

Page 10: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 11: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 12: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 13: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 14: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

hyperboloid cone

Page 15: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 16: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 17: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 18: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 19: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 20: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 21: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 22: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 23: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 24: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 25: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct
Page 26: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Proof based on a generalization of Pascal’s Theorem

Page 27: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Pascal’s Theorem (1639)

For generalization to quadrics, see:

Richard Hartley, Fredrik Kahl,Critical Configurations for Projective Reconstruction from Multiple Views, International Journal of Computer Vision, 2007.

Page 28: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

N-view critical configurations

• Given N>3 cameras and a point set, then critical iff each subset of three cameras and point set critical

Page 29: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Open problem

• What are the critical configurations for the calibrated case?

Page 30: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Carlsson duality and critical configurations

• Exchange role of points and cameras via a Cremona transformation

• Dual configurations:– N cameras and M+4 points– M cameras and N+4 points• Example: ”2-view ambiguity and

arbitrary points on a hyperboloid” is dual to ”arbitrary cameras and 6 points on a hyperboloid”

Page 31: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Conclusions• Critical configurations for the structure and

motion problem• Main criticalities:

– (i) elliptic quartics (intersection of two quadratic surfaces)

– (ii) rational quartic curve on a non-degenerate quadratic surface

– (iii) twisted cubic ...• Projective geometry essential tool

Page 32: Critical Configurations for Projective Reconstruction Fredrik Kahl Joint work with Richard Hartley Chalmers University of Technology Lund University Oct

Thank you for your attention!