graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster...

39
Graphical systems, visualization and multimedia

Upload: others

Post on 04-Jun-2020

13 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Graphical systems,

visualization and

multimedia

Page 2: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Who is who: Part 1 – Me

• Matej Novotný, I-4

• To: [email protected]

• Subject: GSVM blah blah blah

• More:– Web graphics 1-INF-550

– Information visualization 2-AIN-262

2

Page 3: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Who is who: Part 2 – You

• Future developers, analysts, researchers,

visionaries, authors, consultants, experts

3

Steve Jobs, Apple Bill Gates, Microsoft

Page 4: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

FMFI UK @ CG

• trueSpace (ex-Caligari, now Microsoft)

4

Page 5: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

FMFI UK @ CG

• Computer games:

– Conan (Cauldron), Elveon (10tacle), Neverend

(Mayhem), Killzone (Guerrilla Games), ...

5

Page 6: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

FMFI UK @ CG

• Virtual Bratislava, Multimedia Historic Bratislava

• MUVIS

6

Page 7: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

The name of the game

• Graphical systems

– rendering, interaction, 3D objects, animation,

– APIs, CG reference model, rendering pipeline

• Visualization

– Scientific, medical, illustrative visualization,

infovis, augmented reality

• Multimedia

– Audio/video formats

– New media: virtual reality & real virtuality

7

Page 8: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Development of CG

Page 9: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

... in movies

• Star Wars (1977)

– first 3D animation

• Tron (1982)

– 15 minutes of CGI

• Wrath of Khan (1982)

– Particles, fractals

• Luxo Jr. (1986)

– Shadows

– Emotions

9

Page 10: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

... in movies

• Tin Toy (1988)

– animated Oscar

• Abyss (1989)

– water rendering

• Total Recall (1990)

– motion capture

• Toy Story (1995)

– fully CG movie

10

Page 11: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

... in movies (today)

• Lord of The Rings (2001)

- mass scenes

- facial motion capture

• Beowulf (2007)

- digital copies of actors

• Avatar (2009)

- 3D

11

Page 12: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

... in games

• Tennis For Two (1958)

– oscilloscope

• Spacewar! (1961)

• Space Invaders (1978)

– raster graphics

• Lunar Lander,

Asteroids (1979)

– vector graphics

– vector displays

12

Page 13: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

... in games

• Battlezone (1980)

– First 3D vector game

• 3D Monster Maze (1981)

– First 3D raster game

• Hovertank3D (1981)

– Raycasting

• Ultima Underworld (1982)

– Texture mapping

13

Page 14: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

... in games

• Quake

(1996)

– real 3D (vertical axis look), Gouraud shading

– Lightmaps

14

Page 15: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

... in games (today)

• Dynamic lights, soft shadows, shader effects,

normal maps, tesselation, parallax mapping,

environment mapping,...

15

Page 16: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Games now vs. Movies then

16

Heavy Rain (2010), PS3 Final Fantasy (2001)

50 frames per second 90 minutes per frame

Page 17: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

GSVM course outline:

Graphic systems

Page 18: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

CG basics

• Computer graphics

reference model

• Graphics pipeline

18

A small section of the pipework on a Pratt and Whitney

J58 turbojet engine. © Fragments of Eternity

Page 19: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Necessary geometry

• Coordinate systems

• Vectors, matrices

• Affine spaces

• Transformations,

projections

19

Page 20: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Elementary graphics

• Color models

• Rasterization

• Cropping

• Alpha blending

• Anti-aliasing

20

Page 21: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Object representation

• Points

• Curves

• Surfaces

• Solids

– Boundary representation

• Polygons, NURBS

– Volumetric representation

– Functional representation

21

Page 22: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Projection, rendering

• Geometric projections – perspective, ortho

• Visibility algorithms

• Lights and shadows

22

Page 23: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Real-time CG APIs

• OpenGL, DirectX

23

Page 24: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Advanced rendering

• Texture mapping

– Texture filtering, anti-aliasing

anisotropic filtering

• Materials

• Bump mapping

• Environment mapping

24

Page 25: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Towards photorealism

• Rendering equation

• Global

illumination

• Radiosity

• Raytracing

• Photon

mapping

25

Page 26: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Modeling

• Polygonal modeling

• Procedural modeling

• Constructive solid geometry

• ...

26

Page 27: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Animation

• Rigid body animation

• Deformations

• Keyframes

• Direct / inverse kinematics

• Compositing, keying

27

Page 28: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

GSVM course outline:

Visualization

Page 29: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

For visions: observe movies

29

Page 30: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Visualization

• Medical visualization

• Scientific visualization

• Information visualization

30

Åsmund Birkeland

Ivan Viola

Kevin McDonnell

Page 31: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

GSVM course outline:

Multimedia

Page 32: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Creating and storing media

• 2d formats, 3d formats

• Audio/video/animation formats

• Vector graphics / bitmap graphics

• Compression, streaming

• Data manipulation

32

Page 33: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Organizing multimedia

• Web design

• Navigation

• User experience

33

Page 34: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

New and emerging media

• Virtual spaces (WoW, Second life, Wii) and

virtual cities, CAVE

• Force feedback, haptic inferfaces

• Real virtuality

34

Page 35: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

GSVM rules

Page 36: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Course requirements

• Basic experience in computer graphics

– Gaming is enough

• Programming

– No specific language

• Mathematics

– Linear algebra, vector calculus

36

Page 37: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Evaluation

• Test 50 points

– 25 < required to pass

• Labs / Project 50 points

– 25 < required to pass

37

Page 38: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Questions and requests

• Tell me what you wish to know more about

• Write to: [email protected]

• Subject: GSVM ...

• More questions?

38

Page 39: Graphical systems, visualization and multimediasccg.sk/~ferko/gsvm_2013_01motiv.pdf–raster graphics •Lunar Lander, Asteroids (1979) –vector graphics –vector displays 12

Readings

• Ružický, Ferko – Počítačová

grafika a spracovanie obrazu

• Žára a kol. – Moderní počítačová

grafika

• http://pg.netgraphics.sk/

39