continuous projection for fast l1 reconstruction

53
Continuous Projection for Fast L1 Reconstruction Reinhold Preiner* Oliver Mattausch† Murat Arikan* Renato Pajarola† Michael Wimmer* * Institute of Computer Graphics and Algorithms, Vienna University of Technology Visualization and Multimedia Lab, University of Zurich

Upload: serge

Post on 05-Jan-2016

36 views

Category:

Documents


2 download

DESCRIPTION

Continuous Projection for Fast L1 Reconstruction. Reinhold Preiner*Oliver Mattausch†Murat Arikan* Renato Pajarola†Michael Wimmer*. * Institute of Computer Graphics and Algorithms, Vienna University of Technology † Visualization and Multimedia Lab, University of Zurich. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Continuous Projection for Fast L1  Reconstruction

Continuous Projection for Fast L1 Reconstruction

Reinhold Preiner* Oliver Mattausch† Murat Arikan*Renato Pajarola† Michael Wimmer*

* Institute of Computer Graphics and Algorithms, Vienna University of Technology

† Visualization and Multimedia Lab, University of Zurich

Page 2: Continuous Projection for Fast L1  Reconstruction

Dynamic Surface Reconstruction

Input (87K points)

Page 3: Continuous Projection for Fast L1  Reconstruction

Dynamic Surface Reconstruction

Online L2 Reconstruction Input (87K points)

Page 4: Continuous Projection for Fast L1  Reconstruction

Dynamic Surface Reconstruction

Online L2 Reconstruction Input (87K points) Weighted LOP (1.4 FPS)

Page 5: Continuous Projection for Fast L1  Reconstruction

Dynamic Surface Reconstruction

Online L2 Reconstruction Input (87K points) Our Technique(10.8 FPS)

Page 6: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Attraction

Page 7: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

Attraction

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Page 8: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

Attraction

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Page 9: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

Attraction

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Page 10: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

Repulsion

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Page 11: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Page 12: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Page 13: Continuous Projection for Fast L1  Reconstruction

Recap: Locally Optimal Projection

LOP [Lipman et al. 2007], WLOP [Huang et al. 2009]

Page 14: Continuous Projection for Fast L1  Reconstruction

Performance Issues

Attraction: performance strongly depends on the # of input points

Page 15: Continuous Projection for Fast L1  Reconstruction

Acceleration Approach

Reduce number of spatial components!Naïve subsampling information loss

Page 16: Continuous Projection for Fast L1  Reconstruction

Our Approach

Model data by Gaussian mixture fewer spatial entities

Page 17: Continuous Projection for Fast L1  Reconstruction

Our Approach

Model data by Gaussian mixture fewer spatial entitiesRequires continuous attraction of Gaussians

?

Page 18: Continuous Projection for Fast L1  Reconstruction

Our Approach

Model data by Gaussian mixture fewer spatial entities Requires continuous attraction of Gaussians

Continuous LOP (CLOP)

Page 19: Continuous Projection for Fast L1  Reconstruction

Solve Continuous Attraction Compute Gaussian Mixture

CLOP Overview

Input

Page 20: Continuous Projection for Fast L1  Reconstruction

Solve Continuous Attraction Compute Gaussian Mixture

CLOP Overview

Input

Page 21: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Hierarchical Expectation Maximization: 1. initialize each point with Gaussian

Page 22: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Hierarchical Expectation Maximization: 1. initialize each point with Gaussian

Page 23: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Hierarchical Expectation Maximization: 1. initialize each point with Gaussian

Page 24: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Hierarchical Expectation Maximization: 1. initialize each point with Gaussian

Page 25: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Hierarchical Expectation Maximization: 1. initialize each point with Gaussian

2. pick parent Gaussians

Page 26: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Hierarchical Expectation Maximization: 1. initialize each point with Gaussian

2. pick parent Gaussians3. EM: fit parents based

on maximum likelihood

Page 27: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Hierarchical Expectation Maximization:

CLOP (8 FPS)

1. initialize each point with Gaussian

2. pick parent Gaussians3. EM: fit parents based

on maximum likelihood4. Iterate over levels

Page 28: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Conventional HEM: blurring

CLOP (8 FPS)

Page 29: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Conventional HEM: blurring

Page 30: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Conventional HEM: blurringIntroduce regularization

Page 31: Continuous Projection for Fast L1  Reconstruction

Gaussian Mixture Computation

Conventional HEM: blurringIntroduce regularization

Page 32: Continuous Projection for Fast L1  Reconstruction

Solve Continuous Attraction Compute Gaussian Mixture

CLOP Overview

Input

Page 33: Continuous Projection for Fast L1  Reconstruction

K

Continuous Attraction from Gaussians

q

p1 p3p2

Discrete

Page 34: Continuous Projection for Fast L1  Reconstruction

K

q

Continuous Attraction from Gaussians

Discrete

ContinuousΘ1Θ2

Page 35: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 36: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 37: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 38: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 39: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 40: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 41: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 42: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 43: Continuous Projection for Fast L1  Reconstruction

Continuous Attraction from Gaussians

Page 44: Continuous Projection for Fast L1  Reconstruction

Results

Weighted LOP Continuous LOP

Page 45: Continuous Projection for Fast L1  Reconstruction

Results

Weighted LOP Continuous LOP

Page 46: Continuous Projection for Fast L1  Reconstruction

Results

Weighted LOP Continuous LOP

Page 47: Continuous Projection for Fast L1  Reconstruction

Performance

Input (87K points )

7x Speedup

Weighted LOP Continuous LOP

Page 48: Continuous Projection for Fast L1  Reconstruction

Performance

Page 49: Continuous Projection for Fast L1  Reconstruction

WLOP

Accuracy

CLOP

Page 50: Continuous Projection for Fast L1  Reconstruction

Accuracy

Gargoyle

Page 51: Continuous Projection for Fast L1  Reconstruction

L1 Normals

Page 52: Continuous Projection for Fast L1  Reconstruction

L1 Normals

Page 53: Continuous Projection for Fast L1  Reconstruction

LOP on Gaussian mixturesfastermore accurate

See the paper:Faster repulsionL1 normals

Conclusion

Come to our Birds of a Feather!Harvest4D – Harvesting Dynamic 3D Worlds from Commodity Sensor CloudsTuesday, 1:00 PM - 2:00 PM, East Building, Room 4

=