the uncanny valley in 3d modeling steve seitz and rick szeliski birs workshop on computer vision and...

The Uncanny Valleyin 3D Modeling

Steve Seitz and Rick Szeliski

BIRS Workshop onComputer Vision and the Internet

August 31, 2009

The Uncanny Valley

• "The uncanny valley hypothesis holds that when robots and other facsimiles of humans look and act almost like actual humans, it causes a response of revulsion among human observers. The "valley" in question is a dip in a proposed graph of the positivity of human reaction as a function of a robot's lifelikeness. It was introduced by Japanese roboticist Masahiro Mori in 1970." <exerpt from Wikipedia>

Final Fantasy

Polar Express

Façade

View-dependent texture mapping

1. Determine visible cameras for each surface element

2. Blend textures (images) depending on distance between original camera and novel viewpoint

Model-based stereo

• Compute offset from block model

• Some more results:

Graz reconstruction

Photo Tourism

Piecewise planar proxiesSinha, Steedly, Szeliski ICCV’09

http://research.microsoft.com/en-us/um/redmond/groups/ivm/PlanarStereo/

Reflections

Change blindnesshttp://www.psych.ubc.ca/~rensink/flicker/download/

Lightness constancy

Image Based Rendering

Real Scene

Real Cameras-or-

Expensive Image Synthesis

Images+Model

Image

Output

SyntheticCamera

Graphics/Imaging Continuum

Lumigraph

Light field

Geometry centric

Image centric

Warping Interpolation

Polygon rendering + texture mapping

Fixed geometry

View-dependent geometry

View-dependent texture

Concentric mosaics

Sprites with depth

LDI