1 sd models: super-deformed character models sheng-jie luo liang-tsen shen bing-yu chen chiun-kai...

40
1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

Upload: marybeth-morgan

Post on 18-Dec-2015

221 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

1

SD Models:Super-Deformed Character ModelsSheng-Jie LuoLiang-Tsen Shen Bing-Yu ChenChiun-Kai

HuangNational Taiwan University

Page 2: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

2

SD

1

7

1

2.5

© Crypton Future Media, INC.

Page 3: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

3

Applications

Ahmed lumei

© Rilakkuma

Page 4: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

4

Challenges

Page 5: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

5

Goal

Input model

Output model

- +Head Proportion

- +Body-to-feet Proportion

- +Body-to-head Width Proportion

Body Proportions

- +Enlarge Scale

- +Stretch Scale

Signature Characteristics

optimization

Page 6: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

6

Related Work

Page 7: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

7

Mesh Deformation

Surface-based deformation techniques Alexa et al. 2003 Lipman et al. 2004 Sorkine et al. 2004 Zhou et al. 2005 Huang et al. 2006

Page 8: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

8

Mesh Deformation

Skeleton-based deformation techniques Linear-Blend Skinning (LBS)

Magenat-Thalmann et al. 1988 Lewis et al. 2000

Page 9: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

9

Geometry Processing

Mesh simplification Cigmoni et al. 1997 Garland et al. 1997 Lindstrom et al. 2000 Luebke et al. 2002

Page 10: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

10

Geometry Processing

Mesh smoothing Field et al. 1988 Shontz et al. 2003 Baker et al. 2004 Eigensatz et al. 2008

Page 11: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

11

Artistic Stylization

Deussen et al. 2000 Qu et al.

2008

Gal et al. 2007Rivers et al.

2010

Page 12: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

12

Our Method

Page 13: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

13

User Input: Body Proportion

Head proportion Body-to-feet proportion Body-to-head width proportion

- +- +- +

- +- +- +

- +- +- +

- +- +- +

Input model

Page 14: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

14

User Input: Signature Characteristics

Marking signature characteristics

- +Enlarge Scale

- +Enlarge Scale

Input model

- +Stretch Scale

- +Stretch Scale

Input model

Page 15: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

15

Skeleton

TemplateBaran et al. SIGGRAPH2007

Page 16: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

16

Overview

Optimization-based approach

Input model & skeleton Deformed skeleton

SkeletonDeformation

MeshDeformation

Output model

Page 17: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

17

Skeleton Deformation

Page 18: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

18

Skeleton Deformation

Page 19: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

19

Mesh Deformation

Body proportion constraint Signature characteristic constraint Primitive fitting constraint Detail smoothing constraint

Total energy and optimization

Page 20: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

20

Body Proportion

Page 21: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

21

Signature Characteristic

Emphasizing along Skeleton Axes

Page 22: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

22

Signature Characteristic

Emphasizing along Skeleton Orthogonal Directions

Page 23: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

23

Primitive Fitting

Fitting head to a sphere

Page 24: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

24

Primitive Fitting

Fitting limbs to a capsule shape

Page 25: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

25

Detail Smoothing

Page 26: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

26

Total Energy and Optimization

Page 27: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

27

Result

Input model

Different body proportion parameters

Page 28: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

28

Result

Input model

Different body proportion parameters

Page 29: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

29

Result

25273 vertices, 16.287 seconds

Page 30: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

30

Result

4712 vertices, 2.48 seconds

Page 31: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

31

Result

1480 vertices, 0.749 seconds

Page 32: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

32

Result

5000 vertices, 2.527 seconds

Page 33: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

33

Comparison

Input model Body-part uniformly scaling

Our methodArtist hand crafted

Page 34: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

34

User Study

47 users 12 input models

Page 35: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

35

User Study

How cute? 1(Negative) 5(Positive) Are the SD counterparts cuter than the

original model? Which head proportion is cuter?

Input model3.55423

Page 36: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

36

Limitation

Correctly embedded skeleton Self-intersections and vertex sampling density Texture

Page 37: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

37

Conclusion

Optimization-based technique Semi-automatically create a character model

with the SD style Customization

Parameters with body proportion Signature

Page 38: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

38

Future Work

Solving texture distortion Texture stylization

Page 39: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

39

Acknowledgments

We thank the anonymous reviewers for their thoughtful suggestions, and also thank Digimax and SolidWorks for providing high quality character models. We also thank Sei Imai for designing The cartoon character Hatsune Miku’s SD version. This research was supported in part by the National Science Council of Taiwan under grant NSC101-2221-E-002-200-MY2.

Page 40: 1 SD Models: Super-Deformed Character Models Sheng-Jie Luo Liang-Tsen Shen Bing-Yu Chen Chiun-Kai Huang National Taiwan University

40

SD Models: Super-Deformed Character ModelsLiang-Tsen Shen, Sheng-Jie Luo, Chun-Kai Huang, and Bing-Yu Chen

Thank you!Additional materials: http://www.cmlab.csie.ntu.edu.tw/~forestking/research/PG12-SDModel/