![Page 1: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/1.jpg)
The Art and Science of Depiction
Fredo DurandMIT- Lab for Computer Science
Photorealism vs. Non-Photorealism in Computer Graphics
![Page 2: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/2.jpg)
Photorealism vs. NPR 2
Global illumination• How to take into account all light inter-reflections
![Page 3: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/3.jpg)
Photorealism vs. NPR 3
The Rendering equation• Light leaving one point in one direction
– Integral of incoming light from every direction
– Multiplied by BRDF (reflectance)
![Page 4: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/4.jpg)
Photorealism vs. NPR 4
Radiosity• E.g. Lightscape
• Assume surfaces diffuse (independent of direction)
![Page 5: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/5.jpg)
Photorealism vs. NPR 5
Radiosity• Subdivide the scene into discrete elements
![Page 6: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/6.jpg)
Photorealism vs. NPR 6
Radiosity• Subdivide the scene into discrete elements
• Each element is assumed to have constant radiosity
![Page 7: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/7.jpg)
Photorealism vs. NPR 7
Radiosity• Form-factor between 2 elements: ratio of light
leaving one element that reaches the other
![Page 8: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/8.jpg)
Photorealism vs. NPR 8
Radiosity• Form-factor between 2 elements: ratio of light
leaving one element that reaches the other– Taking visibility into account
![Page 9: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/9.jpg)
Photorealism vs. NPR 9
Radiosity• Iterative solution
• Shoot light from the most luminous source
![Page 10: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/10.jpg)
Photorealism vs. NPR 10
Radiosity• Iterative solution
• Shoot from element with the most unshot radiosity
![Page 11: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/11.jpg)
Photorealism vs. NPR 11
Radiosity• Iterative solution
• Shoot from element with the most unshot radiosity
![Page 12: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/12.jpg)
Photorealism vs. NPR 12
Radiosity• Smoothing and other gimmicks
![Page 13: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/13.jpg)
Photorealism vs. NPR 13
Radiosity• Pros
– View independent
• Cons– Meshing is costly
• Memory• Mostly limited to polyhedra
– Aliasing (jagged shadow boundary)– Diffuse assumption (can be sort of alleviated)
![Page 14: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/14.jpg)
Photorealism vs. NPR 14
Discontinuity meshing• Subdivide along shadow boundary
• But costly and complex (not in commercial soft)
![Page 15: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/15.jpg)
Photorealism vs. NPR 15
Discontinuity meshing• Limits of umbra and penumbra
penumbrapenumbraumbraumbra
source
![Page 16: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/16.jpg)
Photorealism vs. NPR 16
Discontinuity meshing
![Page 17: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/17.jpg)
Photorealism vs. NPR 17
Comparison
[Gibson 96]With skeleton10 minutes 23 seconds 1 hour 57 minutes
![Page 18: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/18.jpg)
Photorealism vs. NPR 18
Hierarchical approach• Group elements when the light exchange is not
important– Control non trivial
![Page 19: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/19.jpg)
Photorealism vs. NPR 19
Lightscape
![Page 20: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/20.jpg)
Photorealism vs. NPR 20
Lightscape
![Page 21: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/21.jpg)
Photorealism vs. NPR 21
Lightscape
![Page 22: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/22.jpg)
Photorealism vs. NPR 22
Lightscape
![Page 23: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/23.jpg)
Photorealism vs. NPR 23
Lightscape
![Page 24: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/24.jpg)
Photorealism vs. NPR 24
Lightscape
![Page 25: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/25.jpg)
Photorealism vs. NPR 25
Lightscape
![Page 26: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/26.jpg)
Photorealism vs. NPR 26
Lightscape
![Page 27: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/27.jpg)
Photorealism vs. NPR 27
Lightscape
![Page 28: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/28.jpg)
Photorealism vs. NPR 28
Monte-Carlo ray-tracing• E.g. Radiance (by Greg Ward-Larson),
Mental Ray
• Probabilistic sampling approach
![Page 29: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/29.jpg)
Photorealism vs. NPR 29
Monte-Carlo computation of π• Take a square
• Take a random point (x,y) in the square• Test if it is inside the ¼ disc (x2+y2 < 1)
• The probability is π /4
x
y
![Page 30: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/30.jpg)
Photorealism vs. NPR 30
Monte-Carlo computation of π• The probability is π /4 • Count the inside ratio n = # inside / total # trials
• π ≈ n * 4• The error depends on the number or trials
![Page 31: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/31.jpg)
Photorealism vs. NPR 31
Monte-Carlo• Cast a ray from the eye through each pixel
![Page 32: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/32.jpg)
Photorealism vs. NPR 32
Monte-Carlo• Cast a ray from the eye through each pixel
• Cast random rays from the visible point
![Page 33: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/33.jpg)
Photorealism vs. NPR 33
Monte-Carlo• Cast a ray from the eye through each pixel
• Cast random rays from the visible point • Recurse
![Page 34: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/34.jpg)
Photorealism vs. NPR 34
Monte-Carlo• Cast a ray from the eye through each pixel
• Cast random rays from the visible point • Recurse
![Page 35: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/35.jpg)
Photorealism vs. NPR 35
Monte-Carlo• Systematically sample primary light
![Page 36: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/36.jpg)
Photorealism vs. NPR 36
Monte-Carlo• Take BRD into account
– Multiply incoming light
– Sampling density
![Page 37: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/37.jpg)
Photorealism vs. NPR 37
Monte-Carlo• Bi-directional
• Cast rays from the eye and from light
![Page 38: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/38.jpg)
Photorealism vs. NPR 38
Monte-Carlo• Bi-directional
• Cast rays from the eye and from light• Join
![Page 39: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/39.jpg)
Photorealism vs. NPR 39
Radiance cache• Store the indirect illumination
![Page 40: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/40.jpg)
Photorealism vs. NPR 40
Radiance cache• Store the indirect illumination
![Page 41: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/41.jpg)
Photorealism vs. NPR 41
Radiance cache• Store the indirect illumination
• Interpolate existing cached values• Always sample direct lighting
![Page 42: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/42.jpg)
Photorealism vs. NPR 42
Monte-Carlo & Radiance• Pros
– Can treat any scene and any BRDF
– The Radiance system is free!
• Cons– View-dependent – Costly– Can be noisy (because of sampling)
![Page 43: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/43.jpg)
Photorealism vs. NPR 43
Radiance
![Page 44: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/44.jpg)
Photorealism vs. NPR 44
Radiance
![Page 45: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/45.jpg)
Photorealism vs. NPR 45
Radiance
![Page 46: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/46.jpg)
Photorealism vs. NPR 46
Radiance
![Page 47: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/47.jpg)
Photorealism vs. NPR 47
Radiance
![Page 48: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/48.jpg)
Photorealism vs. NPR 48
Radiance
![Page 49: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/49.jpg)
Photorealism vs. NPR 49
Monte-Carlo ray-tracing
![Page 50: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/50.jpg)
Photorealism vs. NPR 50
Non Photorealistic Rendering• Stanislaw Ulam
– The study of non-linear physics is like the study of non-elephant biology
– (quoted by Craig Reynolds)
![Page 51: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/51.jpg)
Photorealism vs. NPR 51
Painting with numbers• [Haeberli 1990]
• Reference photo for color • Interactive painting with brushes
![Page 52: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/52.jpg)
Photorealism vs. NPR 52
Painting with numbers• [Haeberli 1990]
• Reference photo for color • Interactive painting with brushes
![Page 53: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/53.jpg)
Photorealism vs. NPR 53
Painting with numbers• Direction control
![Page 54: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/54.jpg)
Photorealism vs. NPR 54
Painting with numbers• Direction control using gradient
![Page 55: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/55.jpg)
Photorealism vs. NPR 55
Painting with numbers• From 3D geometry
![Page 56: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/56.jpg)
Photorealism vs. NPR 56
Painting with number • Automatic optimization of brush placement
![Page 57: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/57.jpg)
Photorealism vs. NPR 57
Line drawing• [Markosian et al. 97]
![Page 58: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/58.jpg)
Photorealism vs. NPR 58
Line drawing• [Hertzman and Zorin 2000]
![Page 59: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/59.jpg)
Photorealism vs. NPR 59
Line drawing• [Hertzman and Zorin 2000]
![Page 60: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/60.jpg)
Photorealism vs. NPR 60
Watercolor• [Curtis et al. 1997]
• Physical simulation of watercolor-paper interaction
![Page 61: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/61.jpg)
Photorealism vs. NPR 61
Watercolor• [Curtis et al. 1997]
• Physical simulation of watercolor-paper interaction
• Very costly (not interactive)
![Page 62: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/62.jpg)
Photorealism vs. NPR 62
Watercolor
![Page 63: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/63.jpg)
Photorealism vs. NPR 63
Watercolor
![Page 64: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/64.jpg)
Photorealism vs. NPR 64
Painterly animation• [Meier 1996]
![Page 65: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/65.jpg)
Photorealism vs. NPR 65
Painterly animation
![Page 66: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/66.jpg)
Photorealism vs. NPR 66
Painterly animation• Different styles
![Page 67: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/67.jpg)
Photorealism vs. NPR 67
Painterly animation• Use of different layers
![Page 68: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/68.jpg)
Photorealism vs. NPR 68
Brushes of multiple sizes• [Hertzman 1998]
![Page 69: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/69.jpg)
Photorealism vs. NPR 69
Brushes of multiple sizes• Different styles depending on parameters
“Expressionist”
“Impressionist”
![Page 70: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/70.jpg)
Photorealism vs. NPR 70
Brushes of multiple sizes• Different styles depending on parameters
“Expressionist”
“Impressionist”
![Page 71: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/71.jpg)
Photorealism vs. NPR 71
Style and soul• Icon painting, Expressionism
![Page 72: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/72.jpg)
Photorealism vs. NPR 72
Interactive assisted drawing• [Durand, Ostromoukhov et al.]
![Page 73: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/73.jpg)
Photorealism vs. NPR 73
Interactive assisted drawing• Thresholding
![Page 74: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/74.jpg)
Photorealism vs. NPR 74
Interactive assisted drawing• Smudging
![Page 75: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/75.jpg)
Photorealism vs. NPR 75
Interactive assisted drawing
![Page 76: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/76.jpg)
Photorealism vs. NPR 76
Interactive assisted drawing
![Page 77: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/77.jpg)
Photorealism vs. NPR 77
Interactive assisted drawing
![Page 78: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/78.jpg)
Photorealism vs. NPR 78
NPR: fuzzy issues• No systematic classification of techniques
– Mainly by medium and interactive/full 3D
• No clear issues– What are we trying to solve?
• No inter-operability of techniques– No clear input and output
• Mainly out-of-the-blue full systems with overlap
![Page 79: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/79.jpg)
Photorealism vs. NPR 79
Some issues in NPR• Medium simulation
• Animation and coherence• Line drawing, hatcing
• Shading
• Style• Perspective
• User interface
![Page 80: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/80.jpg)
Photorealism vs. NPR 80
Can visual art and psychology help?• Understand underlying and “universal” pictorial issues
– Limitations and compensation– Different modes
• Texture, color, shape
– Composition, color harmony
• Coarse-grain classification of issues in picture-making– Drawing
– Denotation– Tone and Color
– Physical realization through marks
![Page 81: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/81.jpg)
Photorealism vs. NPR 81
A one-way pipeline• Mechanical and deterministic projection from 3D
to 2D
• Input is purely 3D (world space)
3D geometry
Material attributes
Light sources Image
viewpoint
Light simulation
Projection
Rasterization, etc.
![Page 82: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/82.jpg)
Photorealism vs. NPR 82
A one-way pipeline• Mechanical and deterministic projection from 3D
to 2D
• Input is purely 3D (world space)
3D geometry
Material attributes
Light sources Image
viewpoint
Light simulation
Projection
Rasterization, etc.
Human feedback
![Page 83: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/83.jpg)
Photorealism vs. NPR 83
Mixed 2D/3D specification• We should be able to specify “properties” and
constraints directly in 2D– E.g. color harmony, composition, style
• Still edit the image after rendering– E.g. shadows, lighting, colors, compensations
![Page 84: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/84.jpg)
Photorealism vs. NPR 84
Pictures for dummy• Help non-artists produce nice images
• The “gorgeous image” button in your CAD software
• The “digital photo beautifier”
• Realistic or Non-Photorealistic
• Digital assistant that finds problems
![Page 85: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/85.jpg)
Photorealism vs. NPR 85
Style• Coarse-grain style
– Different categories of drawing, denotation, tone
• Finer-grain
• Local style
• Parameterization
• Capture– Automatically deduce style from 3D renderings– (semi)-Automatically capture style from image(s)
![Page 86: The Art and Science of Depiction Photorealism vs. Non …people.csail.mit.edu/fredo/Depiction/19_NPR/npr.pdf · 2001. 5. 9. · Painting with numbers • [Haeberli 1990] • Reference](https://reader033.vdocuments.net/reader033/viewer/2022051908/5ffb92a7e763453e49717ae6/html5/thumbnails/86.jpg)
Photorealism vs. NPR 86
Convergence of games and movies• Game industry is now as big as movie industry
• Graphics accelerator permit stunning 3D graphics• Cinema quality is not far
• However, games are interactive, “unpredictable”
• How can we transform the art and craft of cinema into algorithmic games
• E.g. Lighting, camera control, editing