360° (stereo) panoramas - christian richardt · 2019-08-19 · 360° (stereo) panoramas 1. 360°...
TRANSCRIPT
![Page 1: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/1.jpg)
360° (Stereo) Panoramas
Christian Richardt
![Page 2: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/2.jpg)
360° (Stereo) Panoramas
1. 360° panoramas
– alignment + stitching [Brown & Lowe 2007]
– parallax-aware stitching [Zhang & Liu, 2014]
2. Stereo panoramas
– Omnistereo [Peleg et al. 2001]
– MegaStereo [Richardt et al. 2013]
3. Towards 6-DoF with motion parallax
– Parallax360 [Liu et al. 2018]
– MegaParallax [Bertel et al. 2019]
1 Aug 2019 Capture4VR: From VR Photography to VR Video 2
Luo
et
al.,
TV
CG
2018
![Page 3: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/3.jpg)
1. Detection:
Identify the interest points
2. Description:
Extract vector feature descriptor
surrounding each interest point.
3. Matching:
Determine correspondence
between descriptors in 2 views
Feature matching
1 Aug 2019 Capture4VR: From VR Photography to VR Video 3
Slid
e b
y K
rist
en G
rau
man
![Page 4: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/4.jpg)
SIFT features
1 Aug 2019 Capture4VR: From VR Photography to VR Video 4
Matt
hew
Bro
wn
an
d D
avid
Lo
we
Slid
e b
y M
att
hew
Bro
wn
![Page 5: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/5.jpg)
Matched SIFT features
1 Aug 2019 Capture4VR: From VR Photography to VR Video 5
Matt
hew
Bro
wn
an
d D
avid
Lo
we
Slid
e b
y M
att
hew
Bro
wn
![Page 6: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/6.jpg)
Aligned images
1 Aug 2019 Capture4VR: From VR Photography to VR Video 6
Matt
hew
Bro
wn
an
d D
avid
Lo
we
Slid
e b
y M
att
hew
Bro
wn
![Page 7: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/7.jpg)
Image alignment
1 Aug 2019 Capture4VR: From VR Photography to VR Video 7
Slid
e b
y M
att
hew
Bro
wn
![Page 8: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/8.jpg)
Multi-band blending [Burt & Adelson, TOG 1983]
Image blending
1 Aug 2019 Capture4VR: From VR Photography to VR Video 8
Slid
e b
y M
att
hew
Bro
wn
Automatic Panoramic Image Stitching using
Invariant Features
Matthew Brown & David G. Lowe
International Journal of Computer Vision, 2007
Image alignment and stitching: a tutorial
Richard Szeliski
Foundations and Trends in Computer Graphics
and Vision, 2006
![Page 9: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/9.jpg)
Parallax-aware stitching
image alignment generally
relies on homography estimates
– perfect for camera rotation
or planar scene content
– but problematic for photos
that are captured handheld
need to explicitly handle
parallax between images
– e.g. Parallax-tolerant Image
Stitching [Zhang & Liu, CVPR 2014]
1 Aug 2019 Capture4VR: From VR Photography to VR Video 9
Brown & Lowe 2007
Zhang & Liu 2014
![Page 10: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/10.jpg)
Applications
now built into all mobile phones
one simple camera sweep
panorama computed on the fly
consumer 360° cameras
stitch views of two 180°+
fisheye cameras
capturing photos and videos
1 Aug 2019 Capture4VR: From VR Photography to VR Video 10
Face
bo
ok
Ben C
lare
mo
nt
![Page 11: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/11.jpg)
Capturing stereo panoramas
111 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 12: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/12.jpg)
Capturing stereo panoramas
121 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 13: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/13.jpg)
Capturing stereo panoramas
131 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 14: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/14.jpg)
Capturing stereo panoramas
141 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 15: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/15.jpg)
Capturing stereo panoramas
151 Aug 2019 Capture4VR: From VR Photography to VR Video
Omnistereo: Panoramic Stereo Imaging
Peleg et al., IEEE TPAMI 2001
![Page 16: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/16.jpg)
Capturing stereo panoramas
16
Capturing 3D panoramas
1 Aug 2019 Capture4VR: From VR Photography to VR Video
Omnistereo: Panoramic Stereo Imaging
Peleg et al., IEEE TPAMI 2001
![Page 17: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/17.jpg)
Capturing stereo panoramas
171 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 18: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/18.jpg)
Capturing stereo panoramas
181 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 19: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/19.jpg)
Input video:
Capturing stereo panoramas
19
©2013
Ric
hard
t et
al.
1 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 20: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/20.jpg)
Capturing stereo panoramas
201 Aug 2019 Capture4VR: From VR Photography to VR Video
©2013
Ric
hard
t et
al.
Megastereo: Constructing High-Resolution Stereo Panoramas
Richardt et al., CVPR 2013
![Page 21: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/21.jpg)
Image alignment
21
image-based alignment
SfM-based alignment
1 Aug 2019 Capture4VR: From VR Photography to VR Video
©2013
Ric
hard
t et
al.
![Page 22: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/22.jpg)
Strip blending artefacts
22
far: duplication
near: truncation
1 Aug 2019 Capture4VR: From VR Photography to VR Video
© d
ata
set
‘refa
im’ b
y R
av-A
cha
et
al.,
IJC
V 2
008
![Page 23: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/23.jpg)
Duplication + truncation
23
near objectsfar objects
panoramic
imaging surface
1 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 24: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/24.jpg)
Flow-based ray interpolation
24
near objectsfar objects
panoramic
imaging surface
1 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 25: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/25.jpg)
Strip blending artefacts
25
far: duplication
near: truncation
1 Aug 2019 Capture4VR: From VR Photography to VR Video
© d
ata
set
‘refa
im’ b
y R
av-A
cha
et
al.,
IJC
V 2
008
![Page 26: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/26.jpg)
Flow-based blending
26
far: stretching
near: squeezing
1 Aug 2019 Capture4VR: From VR Photography to VR Video
©2013
Ric
hard
t et
al.;
data
set
‘refa
im’ b
y R
av-A
cha
et
al.,
IJC
V 2
008
![Page 27: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/27.jpg)
No blending Flow-based blending
1 Aug 2019 Capture4VR: From VR Photography to VR Video 27
Blending comparison
©2013
Ric
hard
t et
al.
![Page 28: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/28.jpg)
Stereo 3D panorama
28
©2013
Ric
hard
tet
al.
Megastereo: Constructing High-Resolution Stereo Panoramas
Richardt et al., CVPR 2013
1 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 29: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/29.jpg)
360 º
zoom
©2013
Ric
hard
tet
al.
Megastereo: Constructing High-Resolution Stereo Panoramas
Richardt et al., CVPR 2013
![Page 30: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/30.jpg)
Motion parallax
1 Aug 2019 Capture4VR: From VR Photography to VR Video 30
Luo
et
al.,
TV
CG
2018
![Page 31: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/31.jpg)
Key frames: colour information of the scene
Disparity motion fields: implicit 3D information at each key frame
Pairwise motion fields: efficient and smooth viewpoint transitions
in novel-view synthesis
Parallax360: Scene representation
311 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 32: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/32.jpg)
Parallax360: Image capture scheme
1 Aug 2019 Capture4VR: From VR Photography to VR Video 32
Key frames
Relative frames
![Page 33: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/33.jpg)
Parallax360: Novel-view synthesis
331 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 34: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/34.jpg)
Parallax360: Novel-view synthesis
341 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 35: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/35.jpg)
Parallax360: Novel-view synthesis
351 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 36: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/36.jpg)
Evaluation of view synthesis quality:
Experiments and Results
361 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 37: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/37.jpg)
Parallax360: Novel-view synthesis
371 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 38: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/38.jpg)
Comparison on real-world scenes:
Parallax360: Results
381 Aug 2019 Capture4VR: From VR Photography to VR Video
![Page 39: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/39.jpg)
1 Aug 2019 Capture4VR: From VR Photography to VR Video 39
![Page 40: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/40.jpg)
MegaParallax: Proxy-based novel-view synthesis
1 Aug 2019 Capture4VR: From VR Photography to VR Video 40
![Page 41: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/41.jpg)
MegaParallax: Per-ray novel-view synthesis
1 Aug 2019 Capture4VR: From VR Photography to VR Video 41
![Page 42: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/42.jpg)
MegaParallax: Flow-based blending
1 Aug 2019 Capture4VR: From VR Photography to VR Video 42
![Page 43: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/43.jpg)
MegaParallax: Forward–backward motion
1 Aug 2019 Capture4VR: From VR Photography to VR Video 43
Bert
elet
al.,
Meg
aP
ara
llax,
TV
CG
2019
![Page 44: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/44.jpg)
MegaParallax: Input video
1 Aug 2019 Capture4VR: From VR Photography to VR Video 44
Bert
elet
al.,
Meg
aP
ara
llax,
TV
CG
2019
![Page 45: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/45.jpg)
MegaParallax: result
1 Aug 2019 Capture4VR: From VR Photography to VR Video 45
Bert
elet
al.,
Meg
aP
ara
llax,
TV
CG
2019
![Page 46: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/46.jpg)
MegaParallax: Lateral translation
1 Aug 2019 Capture4VR: From VR Photography to VR Video 46
Bert
elet
al.,
Meg
aP
ara
llax,
TV
CG
2019
![Page 47: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/47.jpg)
Panoramas:
– widespread adoption in smartphones + 360 cameras
– but flat appearance due to lack of depth
Stereo panoramas:
– appearance of depth in all directions
– extended to stereo 360 video [Anderson et al. 2016, Schroers et al. 2018]
– but no support for head translation (or depth at poles)
Motion parallax:
– additional degrees of freedom allow more immersive exploration
Panoramas summary
1 Aug 2019 Capture4VR: From VR Photography to VR Video 47
![Page 48: 360° (Stereo) Panoramas - Christian Richardt · 2019-08-19 · 360° (Stereo) Panoramas 1. 360° panoramas –alignment + stitching [Brown & Lowe 2007] –parallax-aware stitching](https://reader035.vdocuments.net/reader035/viewer/2022062918/5edc94c9ad6a402d66674e5b/html5/thumbnails/48.jpg)
Next up
1 Aug 2019 Capture4VR: From VR Photography to VR Video 48
Start Topic Speaker
14:00 1. Introduction Christian Richardt, Bath
14:20 2. 360° (Stereo) Panoramas Christian Richardt, Bath
14:40 3. 3D Photography Peter Hedman, UCL
15:00 4. Light Field Photography Ryan S. Overbeck
15:20 Q&A + Break
15:35 5. 360 and ODS Video Brian Cabral, Facebook
15:55 6. Live ODS Video Robert Konrad, Stanford
16:15 7. 6-DoF Video Brian Cabral, Facebook
16:35 8. MR Capture Studios Steve Sullivan, Microsoft
16:55 9. Conclusion + Q&A All presenters