sponsored by depth-aware coherent line drawings marc spicker 1, julian kratt 1, diana arellano 2,...

22
Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1 , Julian Kratt 1 , Diana Arellano 2 , Oliver Deussen 1 1 University of Konstanz, Germany 2 Filmakademie Baden-Württemberg, Germany

Upload: brendan-stewart

Post on 21-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by

Depth-Aware Coherent Line Drawings

Marc Spicker1, Julian Kratt1,

Diana Arellano2, Oliver Deussen1

1 University of Konstanz, Germany2 Filmakademie Baden-Württemberg, Germany

Page 2: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Line drawing to depict form and structureWell suited but sometimes problematic:

Information about spatial arrangement is lost!

Motivation

Page 3: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Line drawing to depict form and structureWe propose:

Improved depth perception and object differentiation!

Motivation

Page 4: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Related Work

Image space line drawings:

[Canny 1986] [Kang et al. 2007]

[Winnemöller et al. 2006]

[Winnemöller et al. 2012]

[Rosin and Lai 2010]

Page 5: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Related Work

Depth information in NPR:

[Deussen and Strothotte 2000]

[Everts et al. 2009]

[Luft et al. 2006]

[Tan et al. 2005][Saito and Takahashi 1990]

Page 6: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Contributions

More control over line drawings

Line width:Small

Details:Few

Line width:Large

Details:Many

Focus:Weak

Focus:Strong

Page 7: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Our Method

Input [Kang et al. 2007]

Ours (Style 2)

Ours (Style 1)

Page 8: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Overview

Input ColorAdaptive Edge Tangent Flow

Gaussian Smoothing

Flow-basedDoG

Line Drawing

Noise Suppression

Line Parameters

Smooth Radius

𝜎

Input Depth

Page 9: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Flow-based Difference-of-Gaussians

Input (1) (2) (3)

Algorithm from [Kang et al. 2007]:

1. Edge tangent flow (ETF)

2. Difference-of-Gaussians

3. Gaussian weighting along flow (FDoG)

Page 10: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Adaptive Edge Tangent Flow

Extension to ETF construction:

𝑟 ′ (𝑥 )= 12𝑟 ∑

𝑦∈𝜔( 𝑥)¿𝑡 (𝑥 )∗𝑡(𝑦 )∨¿¿ Average angular deviation

Input Original Ours

Page 11: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Flow-based Difference-of-Gaussians

Filter response forms an area:

Gradient ascend orthogonal to ETF for finding maximum response.

Page 12: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Line Drawing

Input Depth

Distance to Maximum

Line Width

Noise Suppression

Details

Page 13: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Line Drawing Styles

Line Parameters Thick lines in close regions.

Thin line in close regions; Thick and faded out at the back.

Reasoning Focus user attention to close objects.

Details in front.Analogue to painterly rendering.

Line Parameters Thick lines in close regions.

Reasoning Focus user attention to close objects.

Style 1 Style 2

Page 14: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Line Drawing Styles - Applications

Importance map (inst. of depth) for highlighting.

Focus on eyes and mouth regions with our line drawing styles.

Page 15: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Line Drawing Styles - Future Work

Application: Individuals with Autism Spectrum Disorder

Focus on facial regions that convey emotions

Abstract other details of the face

Page 16: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

User study

Claim Our line drawings improve depth perception.

Task Order objects from front to back.

Results • Improved orderings (~0.88) vs. uniform lines (~0.55)

• Not as strong as shadows (~0.95)

Page 17: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

User study

Claim Our line drawings allow to set the focus.

Task Mark the area in focus.

Results • All subjects able to determine focal area with depth-of-field

• 76% of subjects in our line drawing

Page 18: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Results

Input [Kang et al. 2007]

Ours (Style 2)

Ours (Style 1)

Page 19: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Results

Input [Kang et al. 2007]

Ours (Style 2)

Ours (Style 1)

Page 20: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Limitations

ETF vector-based representation:Problems as described in [Zhang et al. 2007]

Parameters (e.g. kernel size) scale dependent

Coherence limited

Page 21: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Conclusion

Improved Edge Tangent Flow construction method

Flow-based morphological filter

Two line drawing styles for betterdepth perception and object differentiation

Page 22: Sponsored by Depth-Aware Coherent Line Drawings Marc Spicker 1, Julian Kratt 1, Diana Arellano 2, Oliver Deussen 1 1 University of Konstanz, Germany 2

Sponsored by SA2015.SIGGRAPH.ORG

Thank you!

Contact:[email protected]