Transcript
Page 1: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

1

Bidirectional LightcutsBruce Walter Pramook Khungurn Kavita Bala

Cornell University

Friday, August 10, 2012

Page 2: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Realistic Rendering Challenge

• Complex light sources• Global illumination• Wide range of materials

2Images: Autodesk® 360 Rendering & Autodesk® Homestyler®Friday, August 10, 2012

Page 3: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Realistic Rendering Challenge

• Complex light sources• Global illumination• Wide range of materials– Glossy, subsurface, volumetric ...

3Friday, August 10, 2012

Page 4: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Equal Time Comparison

4

Probabilistic Photon Map

Bidirectional Path Trace

MultidimensionalLightcuts (VPL)

[Knaus & Zwicker 11] [Walter et al. 06] [Veach & Guibas 94,95]

Friday, August 10, 2012

Page 5: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Equal Time Comparison

5

Probabilistic Photon Map

Bidirectional Path Trace

MultidimensionalLightcuts (VPL)

Friday, August 10, 2012

Page 6: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Equal Time Comparison

6

Probabilistic Photon Map

Bidirectional Path Trace

MultidimensionalLightcuts (VPL)

Friday, August 10, 2012

Page 7: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Equal Time Comparison

7

Probabilistic Photon Map

New MethodBidirectional Path Trace

MultidimensionalLightcuts (VPL)

Friday, August 10, 2012

Page 8: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Equal Time Comparison

8

Probabilistic Photon Map

New MethodBidirectional Path Trace

MultidimensionalLightcuts (VPL)

Friday, August 10, 2012

Page 9: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Goal: Combine Strengths

• Multidimensional Lightcuts– Biased virtual point light (VPL) method✓Low noise and scalable performance

• Bidirectional Path Tracing– Noisy and slow to converge✓Supports wide range of materials

9Friday, August 10, 2012

Page 10: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Lightcuts

• Bidirectional VPL algorithm– Bidirectional estimators– Novel weighting scheme‣Control bias vs. noise tradeoff

– Scalable and low noise‣ Integrated with Lightcuts

10Friday, August 10, 2012

Page 11: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Outline

• Prior work: VPL and Bidirectional review• New weighting strategy• Integration with Multidimensional Lightcuts• Results

11Friday, August 10, 2012

Page 12: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Virtual Point Light Methods

• Approximate global illumination using point lights

12

Camera

Light Source

Friday, August 10, 2012

Page 13: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Virtual Point Light Methods

• Approximate global illumination using point lights• Generate point lights (VPL)

13

VPL

Light Source

Friday, August 10, 2012

Page 14: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Virtual Point Light Methods

• Approximate global illumination using point lights• Generate point lights (VPL)• Generate point sensors (VPS)

14

Camera VPS

Friday, August 10, 2012

Page 15: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Virtual Point Light Methods

• Approximate global illumination using point lights• Generate point lights (VPL)• Generate point sensors (VPS)• Gather illumination

• More VPLs = more accurate

15

Camera

Friday, August 10, 2012

Page 16: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Material Appearance Problem

16

Naive VPL(no clamping)

Friday, August 10, 2012

Page 17: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Material Appearance Problem

17

Naive VPL(no clamping)

Standard VPL(with clamping)

- Clamping distorts material appearance [Krivanek et al. 10]Friday, August 10, 2012

Page 18: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Material Appearance Problem

18

Naive VPL(no clamping)

Standard VPL(with clamping)

Our Result

- Clamping distorts material appearance [Krivanek et al. 10]Friday, August 10, 2012

Page 19: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Prior VPL Work– Adaptive VPL generation‣ [Segovia et al. 06, Davidovic et al. 10]

– Modified VPLs‣ [Hasan et al. 09]

– VPL bias compensation‣ [Kollig & Keller 04, Engelhardt et al. 10, Novak et al. 11]

– Specialized BSSRDF extension‣ [Arbree et al. 08]

– Hybrid algorithms‣ [Dammertz et al. 10]

19Friday, August 10, 2012

Page 20: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Bidirectional Path Tracing

20

Camera

Light Source

Friday, August 10, 2012

Page 21: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Bidirectional Path Tracing– Trace path from light

21Friday, August 10, 2012

Page 22: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Bidirectional Path Tracing– Trace path from light– Trace path from camera

22Friday, August 10, 2012

Page 23: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Bidirectional Path Tracing– Trace path from light– Trace path from camera– Sum over all connections

23Friday, August 10, 2012

Page 24: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Multiple ways to generate each path

24Friday, August 10, 2012

Page 25: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Multiple ways to generate each path

25Friday, August 10, 2012

Page 26: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Multiple ways to generate each path

26Friday, August 10, 2012

Page 27: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Multiple ways to generate each path– Combine using weights: wi

‣ e.g., Balance heuristic– Best connection depends on path– Unbiased if: ∑wi = 1

27

w1

w2

w0

Friday, August 10, 2012

Page 28: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Path Tracing Review

• Advantages– Wider range of paths handled efficiently

• Disadvantages– Increased cost per sample– Some paths are still hard to find‣May be noisy or slow to converge

28Friday, August 10, 2012

Page 29: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional VPL Rendering

• Standard VPL rendering– Limited subset of bidirectional methods– Clamping causes weight sum < 1

29Friday, August 10, 2012

Page 30: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional VPL Rendering

• Standard VPL rendering– Limited subset of bidirectional methods– Clamping causes weight sum < 1

• Bidirectional extension

30Friday, August 10, 2012

Page 31: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional VPL Rendering

• Standard VPL rendering– Limited subset of bidirectional methods– Clamping causes weight sum < 1

• Bidirectional extension– Unbiased weighting [Kollig & Keller 04]‣ Low noise properties of VPL rendering is lost

31Friday, August 10, 2012

Page 32: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Outline

• Prior work: VPL and Bidirectional review• New weighting strategy• Integration with Multidimensional Lightcuts• Results

32Friday, August 10, 2012

Page 33: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

New Weighting Strategy

• Designed for low noise while minimizing bias

• Four weight constraints– 1) Energy conservation– 2) Clamping– 3) Diffuse VPLs– 4) Exclude high variance eye paths

• Actual weight is the minimum of constraints33

Friday, August 10, 2012

Page 34: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

First Weight Constraint

• 1) Energy conservation– Weight sum ≤ 1– Reduce amortized cost ‣Prefer shorter eye paths

34

Lower cost

Higher cost

Friday, August 10, 2012

Page 35: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Second Weight Constraint

• 2) Clamping– Control VPL noise‣Matches previous clamping [Walter et al. 06]

35No clamping With clampingFriday, August 10, 2012

Page 36: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Third Weight Constraint

• 3) Diffuse VPLs:– Primarily a cost optimization‣Narrowly directional VPLs are inefficient‣Typically expensive with little effect

36

Glossy Surface

Friday, August 10, 2012

Page 37: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

• 3) Diffuse VPLs:– Primarily a cost optimization‣Narrowly directional VPLs are inefficient‣Typically expensive with little effect

– New diffuse vs. glossy classifier‣ Independent of material model‣Preserves Lambertian, isotropic, etc.‣Applicable to other rendering algorithms

Third Weight Constraint

37Friday, August 10, 2012

Page 38: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

• 4) Exclude high variance eye paths:– Control VPS noise– Based on directional spread heuristic

‣ 4a) Narrow eye ray spread– E.g., sharp glossy reflections– Unrestricted recursion

‣ 4b) Wide eye ray spread– E.g., Subsurface, diffuse indirect– Restrict to short range effects only

Fourth Weight Constraint

38Friday, August 10, 2012

Page 39: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

39Narrow gloss Broad gloss

Diffuse Back Wall

Plate 1 Plate 2 Plate 3

Friday, August 10, 2012

Page 40: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

40

Standard VPL(not bidirectional)

Narrow gloss Broad gloss

Diffuse Back Wall

Plate 1 Plate 2 Plate 3

Friday, August 10, 2012

Page 41: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

41

Without constraint 4(unbiased)

Standard VPL(not bidirectional)

Narrow gloss Broad glossFriday, August 10, 2012

Page 42: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

42

With Constraint 4

Without constraint 4(unbiased)

Standard VPL(not bidirectional)

Narrow gloss Broad glossFriday, August 10, 2012

Page 43: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Subsurface Extensions

• Path-based representation– 2 vertices plus special segment

• New BSSRDF sampling method– Ray tracing random chords on spheres

• Applicable to other path-based algorithms

Subsurface

Friday, August 10, 2012

Page 44: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Outline

• Prior work: VPL and Bidirectional review• New weighting strategy• Integration with Multidimensional Lightcuts• Results

44Friday, August 10, 2012

Page 45: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Multidimensional Lightcuts

• Millions of sensor/light pairs per pixel– Brute force → expensive

• Multidimensional Lightcuts– Evaluate small subset of pairs

45

Grand Central [Walter et al. 05]0.03% of sensor/light pairs evaluated

Friday, August 10, 2012

Page 46: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Multidimensional Lightcuts

• Cluster points into hierarchies

• Adaptive select cut (partition)– Bound max error per cluster– Refine until below perceptual threshold

• Sublinear cost per point– Used in Autodesk® 360 Rendering‣A million images this year 46

Cluster Tree

Cut

Tim

e

Number of Points

NaiveLightcut

Friday, August 10, 2012

Page 47: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

47

Lightcuts Integration

• Lightcut extensions– New material types – Added weighting terms to bounding and evaluation– Quad-tree cubemaps representation for bounds

Cubemap Unfolded quad-tree cubemap

Friday, August 10, 2012

Page 48: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Outline

• Prior work: VPL and Bidirectional review• New weighting strategy• Integration with Multidimensional Lightcuts• Results

48Friday, August 10, 2012

Page 49: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Results: Accurate Materials

49

Standard VPL Our Method

Glossy

Friday, August 10, 2012

Page 50: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Results: Accurate Materials

50

Standard VPL Our Method

Glossy

Subsurface

Friday, August 10, 2012

Page 51: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Results: Accurate Materials

51

Standard VPL Our Method

Glossy

Subsurface

Volumetric

Anisotropic volumetric fiber model (giga-voxel resolution) Friday, August 10, 2012

Page 52: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Lightcuts

52

Standard VPL

Friday, August 10, 2012

Page 53: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Lightcuts

53

Standard VPL

+

Bidirectional Estimators

Friday, August 10, 2012

Page 54: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Bidirectional Lightcuts

54

Standard VPL

=

• Accurate rendering of complex materials- e.g., glossy counter, subsurface milk, volumetric cloth

Our Method

+

Bidirectional Estimators

Friday, August 10, 2012

Page 55: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Timing Results

55Images 512x512, 1 million VPLs, 64 eye rays per pixel, 4 cores at 3.4GHz

Standard VPL

Bidirectional Lightcuts

Ball

Friday, August 10, 2012

Page 56: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Timing Results

56Images 512x512, 1 million VPLs, 64 eye rays per pixel, 4 cores at 3.4GHz

Standard VPL

Bidirectional Lightcuts

Ball Dragon

Friday, August 10, 2012

Page 57: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Timing Results

57Images 512x512, 1 million VPLs, 64 eye rays per pixel, 4 cores at 3.4GHz

Standard VPL

Bidirectional Lightcuts

Ball Dragon SanMiguel

Friday, August 10, 2012

Page 58: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Timing Results

58Images 512x512, 1 million VPLs, 64 eye rays per pixel, 4 cores at 3.4GHz

Standard VPL

Bidirectional Lightcuts

Ball Dragon SanMiguel Kitchen

Friday, August 10, 2012

Page 59: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Timing Results

59

Lightcuts (standard) 346s 359s 434s 1076sBidirectional 479s (+38%) 745s (+107%) 618s (+42%) 1803s (+67%)

Images 512x512, 1 million VPLs, 64 eye rays per pixel, 4 cores at 3.4GHzFriday, August 10, 2012

Page 60: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Limitations and Future Work

• Noise control relies on heuristics– Effective in our tests but without guarantees

• Cannot handle some phenomena (e.g., caustics)– VPL methods are ill-suited to such paths– Combine with specialized algorithms

60Friday, August 10, 2012

Page 61: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Conclusion

• VPL-based rendering has many advantages– Low noise– Scalable performance– Limited in materials and effects

• Bidirectional extension– Wider range of materials– Enable new applications

61Friday, August 10, 2012

Page 62: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

The End

• Acknowledgements– Models and assistance:

‣ Edgar Velazquez-Armendariz, Shuang Zhao, Adam Arbree, John Hutchinson, Jaroslav Krivanek, Guillermo M. Leal Llaguno, Stanford Graphics Lab

– Funded by:‣ National Science Foundation‣ Autodesk‣ Intel Science and Technology Center -

Visual Computing62

Friday, August 10, 2012

Page 63: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

Summary

• Bidirectional VPL algorithm– Recursive sensor generation– Novel weighting scheme‣Control bias vs. noise tradeoff

– Scalable and low noise‣ Integrated with Lightcuts

• General techniques– New BSSRDF sampling– Model independent diffuse classifier

63Friday, August 10, 2012

Page 64: Bruce Walter Pramook Khungurn Kavita Bala Cornell University

64

Equal Time Comparison

Progressive Photon Map Our Method Bidirectional Path Trace

Enlarged

Friday, August 10, 2012


Top Related