4. video and animation contents - rwth aachen university...4. video and animation multimedia...

48
4. Video and Animation Multimedia Kommunikation SS‘99 1 / 48 Contents 4.1 Basic Concepts Video Signal Representation Computer Video Format 4.2 Television Conventional Systems Enhanced Definition Systems High Definition Systems – Transmission 4.3 Computer-based Animation Basic Concepts Animation Languages Controlling of Animation Display of Animation Transmission of Animation

Upload: others

Post on 18-Mar-2020

24 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

1 / 4

8C

onte

nts

4.1

Bas

ic C

once

pts

–V

ideo

Sig

nal R

epre

sent

atio

n–

Com

pute

r V

ideo

For

mat

4.2

Tel

evis

ion

–C

onve

ntio

nal S

yste

ms

–E

nhan

ced

Def

initi

on S

yste

ms

–H

igh

Def

initi

on S

yste

ms

–T

ran

smis

sio

n

4.3

Com

pute

r-ba

sed

Ani

mat

ion

–B

asic

Con

cept

s–

Ani

mat

ion

Lang

uage

s–

Con

trol

ling

of A

nim

atio

n–

Dis

play

of A

nim

atio

n–

Tra

nsm

issi

on o

f Ani

mat

ion

Page 2: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

2 / 4

8O

verv

iew

4.1

Bas

ic C

once

pts

In th

is p

art t

he b

asic

fea

ture

s of

vid

eo s

igna

l rep

rese

ntat

ion

are

cove

red.

The

se a

redi

gitiz

atio

n, tr

ansm

issi

on (

diff

eren

t enc

odin

g sc

hem

es)

and

visu

al r

epre

sent

atio

n(f

ram

e ra

te, s

ize,

etc

.). F

urth

erm

ore

an o

verv

iew

of

com

pute

r vi

deo

form

ats

is g

iven

.

4.2

Tel

evis

ion

In th

is s

ectio

n cu

rren

t int

erna

tiona

l tel

evis

ion

stan

dard

s (P

AL

, NT

SC, S

EC

AM

) ar

epr

esen

ted.

The

evo

lutio

n fr

om e

xist

ing

tele

visi

on s

tand

ards

to f

utur

e hi

gh d

efin

ition

syst

ems

is h

ighl

ight

ed. E

spec

ially

the

prob

lem

of

data

rat

e re

duct

ion

for

tran

smis

sion

isad

dres

sed.

4.3

Com

pute

r-ba

sed

Ani

mat

ion

The

bas

ic p

rinc

iple

s of

mot

ion

vide

o ar

e po

inte

d ou

t. D

iffe

rent

tech

niqu

es f

orde

scri

bing

, con

trol

ling,

tran

smitt

ing

and

disp

layi

ng o

f an

imat

ions

are

pre

sent

ed.

Page 3: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

3 / 4

84.

1 B

asic

Con

cept

s: V

ideo

Sig

nal R

epre

sent

atio

n

Vid

eo s

igna

l rep

rese

ntat

ion

incl

udes

:–

visu

al r

epre

sent

atio

n–

tran

smis

sion

– di

gitiz

atio

n

Impo

rtan

t mea

sure

s fo

r th

e vi

sual

rep

rese

ntat

ion:

1. V

erti

cal D

etai

l and

Vie

win

g D

ista

nce

Sm

alle

st d

etai

l tha

t can

be

repr

oduc

ed is

a p

ixel

.

– Id

eally

: One

pix

el f

or e

very

det

ail o

f a

scen

e.

– In

pra

ctic

s: S

ome

deta

ils fa

ll be

twee

n sc

anni

ng li

nes.

Kel

l fac

tor:

onl

y 70

% o

f the

ver

tical

det

ails

are

rep

rese

nted

, due

to th

e fa

ct th

at s

ome

ofth

e de

tails

of t

he s

cene

fall

betw

een

the

scan

ning

line

s. (

Det

erm

ined

by

expe

rienc

e,m

easu

rem

ents

).

Page 4: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

4 / 4

8

Scan

line

s

A “

deta

il” w

here

onl

y 2

out o

f 3co

mpo

nent

s ca

n be

rep

rese

nted

The

Kel

l fac

tor

of ≈

0.7

is in

depe

nden

t of:

– w

ay o

f sca

nnin

g, i.

e. w

heth

er th

e sc

anni

ng is

pr

ogre

ssiv

e (s

eque

ntia

l sca

nnin

g of

lines

)–

or w

heth

er th

e sc

anni

ng is

inte

rlace

d(a

ltern

ate

scan

ning

, lin

e 1,

line

3, .

.. lin

e n-

1, li

ne 2

, lin

e 4,

...)

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 5: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

5 / 4

8

Geo

met

ry o

f th

e te

levi

sion

imag

e is

bas

ed o

n th

e as

pect

rati

o, w

hich

is th

e ra

tio o

f th

e pi

ctur

e w

idth

W to

the

heig

ht H

(W

:H).

The

con

vent

iona

l asp

ect r

atio

is 4

/3 =

1.3

3 (W

/H =

4/3

)

Mod

ern

syst

ems

use

16/9

= 1

.77

The

vie

win

g di

stan

ce D

det

erm

ines

the

angl

e α

subt

ende

dby

the

pict

ure

heig

ht H

.

Thi

s an

gle

is m

easu

red

by th

e ra

tio o

f th

e pi

ctur

e he

ight

tovi

ewin

g di

stan

ce: t

an(α

) =

H/D

.

700:

525

= 4

:3(N

TSC

sta

ndar

d)52

5

700 D

H

α

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 6: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

6 / 4

8

2. H

oriz

onta

l Det

ail a

nd P

ictu

re W

idth

Pic

ture

wid

th fo

r co

nven

tiona

l tel

evis

ion

serv

ice

is 4

/3 ·

pic

ture

hei

ght.(

see

prev

ious

slid

e)

3. T

otal

Det

ail C

onte

nt o

f th

e Im

age

tota

l num

ber

of p

ictu

re e

lem

ents

= n

umbe

r of

ver

tical

ele

m. ·

num

ber

of h

oriz

onta

l ele

m.

= v

ertic

al r

esol

utio

n2 ·

asp

ect

ra

tio

= 5

252

· 4/

3 (f

or N

TS

C)

4. P

erce

ptio

n of

Dep

th (

3D im

pres

sion

)In

nat

ural

vis

ion:

ang

ular

sep

arat

ion

of th

e im

ages

rec

eive

d by

the

two

eyes

.

Tel

evis

ion

imag

e: p

ersp

ectiv

e ap

pear

ance

of o

bjec

ts, c

hoic

e of

foca

l len

gth

of c

amer

a le

ns(h

owev

er: u

sual

ly n

ot r

eal),

cha

nges

in d

epth

of c

amer

a fo

cus.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 7: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

7 / 4

8

5. L

umin

ance

and

Chr

omin

ance

Col

or p

erce

ptio

n by

the

hum

an b

rain

thro

ugh

the

addi

tive

com

posi

tion

of

Red

, Gre

en a

nd B

lue

light

(R

GB

).

In c

ontr

ast t

o th

e su

bstr

actin

g co

mpo

sitio

n of

pai

ntin

g co

lors

,w

here

rat

her

“filt

ers”

(re

d pa

intin

g co

lor

refle

cts

red

light

and

filte

rs o

ut th

e re

st)

than

ligh

t are

mix

ed.

The

thre

e R

, G, B

sig

nals

cou

ld b

e tr

ansm

itted

sep

arat

ely.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 8: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

8 / 4

8

Col

or e

ncod

ing

duri

ng tr

ansm

issi

on u

ses:

one

lum

inan

ce (

brig

htne

ss)

sign

al Y

(fr

om 0

/dar

k to

1/w

hite

), w

here

Y =

0.3

0 ·

R +

0.5

9 ·G

+ 0

.11

· B

(R

= G

= B

= 1

, i.e

. ful

l red

, gre

en, b

lue

Í Y

= 1

)

due

to th

e co

lor

sens

itivi

ty o

f the

hum

an e

ye a

nd tw

o ch

rom

inan

ce (

colo

r) s

igna

ls.

U =

c1 ·

(B-Y

); V

= c

2 ·(

R-Y

);

c 1 , c

2 =

con

stan

ts r

efle

ctin

g pe

rcep

tion

aspe

cts

of th

e hu

man

eye

and

the

hum

an b

rain

!)

Col

or im

pres

sion

due

to:

– re

lativ

e in

tens

ities

of “

Red

”, “

Gre

en”,

“B

lue”

.

– co

mbi

natio

ns o

f the

se in

tens

ities

.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 9: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

9 / 4

8

6. T

empo

ral A

spec

ts o

f Il

lum

inat

ion

Mot

ion

is r

epre

sent

ed b

y a

rapi

d su

cces

sion

of

slig

htly

dif

fere

nt s

till p

ictu

res

(fra

mes

). A

disc

rete

seq

uenc

e of

pic

ture

s is

per

ceiv

ed a

s a

cont

inuo

us s

eque

nce

of p

ictu

re (

due

to “

Luck

yw

eakn

ess”

of t

he h

uman

bra

in).

Bet

wee

n fr

ames

, the

ligh

t is

cut o

ff br

iefly

.

For

a r

ealis

tic p

rese

ntat

ion,

two

cond

ition

s ar

e re

quire

d:

– re

petit

ion

rate

mus

t be

high

eno

ugh

to g

uara

ntee

sm

ooth

mot

ion

– th

e pe

rsis

tenc

e of

vis

ion

mus

t ext

end

over

the

inte

rval

bet

wee

n fla

shes

.

7. C

ontin

uity

of

Mot

ion

To

perc

eive

con

tinuo

us m

otio

n th

e fr

ame

rate

mus

t be

high

er th

an 1

5 fr

ames

/sec

.

For

sm

ooth

mot

ion

the

fram

e ra

te s

houl

d be

24

- 30

fram

es/s

ec.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 10: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

10 /

48

8. F

licke

ring

Thr

ough

slo

w m

otio

n a

peri

odic

flu

ctua

tion

of b

righ

tnes

s, a

flic

ker

effe

ct, a

rise

s.

How

to a

void

this

dis

turb

ing

effe

ct?

– A

firs

t tric

k: d

ispl

ay e

ach

pict

ure

seve

ral t

imes

.

E

.g.:

16 p

ictu

res

per

seco

nd: v

ery

inco

nven

ient

.

Í d

ispl

ay e

very

pic

ture

3 ti

mes

Í

3 ·

16

= 4

8 H

z.

– T

o av

oid

flick

er a

ref

resh

rat

e of

at l

east

50

cycl

es/s

ec is

nee

ded.

– C

ompu

ter

disp

lay

achi

eves

70

Hz

of r

efre

sh r

ate

by th

e us

e of

a r

efre

sh b

uffe

r.

– T

V p

ictu

re is

div

ided

into

two

half-

pict

ures

by

line

inte

rleav

ing

– R

efre

sh r

ate

of 2

5 H

z (P

AL)

for

the

full

TV

pic

ture

req

uire

s a

scan

rat

e of

2

· 25

Hz

= 5

0 H

z.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 11: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

11 /

48

9. T

empo

ral A

spec

t of

Vid

eo B

andw

idth

The

eye

req

uire

s a

vide

o fr

ame

to b

e sc

anne

d ev

ery

1/25

sec

ond.

Scan

rat

e an

d re

solu

tion

dete

rmin

es th

e vi

deo

band

wid

th n

eede

d fo

r tr

ansm

issi

on.

Dur

ing

one

cycl

e of

vid

eo f

requ

ency

(i.e

. 1 H

z) a

t mos

t tw

o ho

rizo

ntal

ly a

djac

ent p

ixel

s ca

n be

scan

ned.

Ver

tical

res

olut

ion

and

fram

e ra

te r

elat

es to

hor

izon

tal (

line)

sca

n fr

eque

ncy:

vert

ical

line

s (b

) ·

fram

e ra

te (

c) =

hor

izon

tal s

can

freq

uenc

y

Hor

izon

tal r

esol

utio

n an

d sc

an fr

eque

ncy

rela

te to

vid

eo b

andw

idth

:

horiz

onta

l lin

es (

a) ·

sca

n fr

eque

ncy

/ 2 =

vid

eo b

andw

idth

Í v

ideo

ban

dwid

th =

a ·

b ·

c/2

(sin

ce 2

hor

izon

tally

adj

acen

t pix

els

can

be r

epre

sent

ed s

imul

tane

ousl

y)

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 12: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

12 /

48

A c

ompu

ter

syst

em w

ith a

res

olut

ion

of a

= 1

312

and

b =

800

pix

els

out o

f whi

ch 1

024

· 78

6 ar

evi

sibl

e an

d a

fram

e ra

te c

= 1

00 H

z ne

eds:

a ho

rizon

tal s

can

freq

uenc

y of

800

· 10

0 H

z =

80

kHz

and

a vi

deo

band

wid

th o

f 13

12 ·

80

kHz

/ 2 =

52.

48 M

Hz

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

1312

· 8

00 ·

100

/2

Page 13: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

13 /

48

Enc

odin

g of

the

thre

e co

lor

sign

als

R(e

d), B

(lue

), G

(ree

n)

As

the

hum

an e

ye is

mor

e se

nsiti

ve to

bri

ghtn

ess

than

to c

hrom

inan

ce:

Sepa

ratio

n of

bri

ghtn

ess

info

rmat

ion

(lum

inan

ce Y

) fr

om th

e co

lor

info

rmat

ion

(two

chro

min

ance

cha

nnel

s U

and

V).

Thi

s m

eans

:

– R

GB

= S

epar

atio

n of

Red

, Gre

en, B

lue

– Y

UV

= S

epar

atio

n of

Brig

htne

ss

Y, a

nd o

f tw

o ch

rom

inan

ce c

hann

els

U a

nd V

.

The

thre

e pa

ram

eter

s co

rres

pond

to th

e th

ree

basi

c co

lor

valu

es.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 14: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

14 /

48

Poss

ible

Cod

ing:

YU

V s

igna

l (us

ed b

y C

D-I

nter

activ

e an

d D

igita

l Vid

eo I

nter

activ

e)

Y =

0.3

0 R

+ 0

.59

G +

0.1

1 B

U =

(B

-Y)

· 0.

493

= -

0.1

48 ·

R -

0.2

9 ·

G +

0.4

39 ·

B

V =

(R

-Y)

· 0.

877

= 0

.614

· R

- 0

.517

· G

- 0

.096

· B

The

res

olut

ion

of Y

is m

ore

impo

rtan

t tha

n th

e re

solu

tion

of U

and

V.

Í m

ore

bits

for

Y th

an fo

r U

and

V. (

Y :

U :

V =

4 :

2 : 2

)

Sys

tem

of 3

equ

atio

ns fo

r: d

eter

min

ing

Y, U

, V fr

om R

, G, B

or

reca

lcul

atin

g R

, G, B

from

Y,

U, V

The

wei

ghtin

g fa

ctor

s in

the

calc

ulat

ion

of th

e Y

-Sig

nal c

ompe

nsat

e th

e co

lor

perc

eptio

nm

isba

lanc

e o

f the

hum

an e

ye.

Cod

ing

Rat

io

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 15: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

15 /

484.

1 B

asic

Con

cept

s: V

ideo

Sig

nal R

epre

sent

atio

n

Tra

nsm

issi

onw

hite

gree

nre

dbl

uebl

ack

Dif

fere

nt“c

olo

urs”

and

thei

rre

spec

tive

real

isat

ion

by:

R, G

, B

or b

y: Y,

U, V

Page 16: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

16 /

48

YIQ

sig

nal (

basi

s fo

r th

e N

atio

nal T

elev

isio

n Sy

stem

s C

omm

ittee

-Sys

tem

, NT

SC)

YIQ

: in

prin

cipl

e no

thin

g bu

t a s

light

var

iatio

n of

YU

V s

chem

e.

NT

SC: T

V s

tand

ard

in th

e U

SA.

Com

posi

te s

igna

l:

– In

divi

dual

com

pone

nts

(RG

B, Y

UV

or

YIQ

) ar

e co

mpo

sed

into

one

sig

nal.

– B

asic

info

rmat

ion

cons

ists

of l

umin

ance

info

rmat

ion

and

chro

min

ance

diff

eren

ce s

igna

ls.

– U

se a

ppro

pria

te m

odul

atio

n m

etho

ds to

elim

inat

e in

terf

eren

ce b

etw

een

lum

inan

ce a

ndch

rom

inan

ce s

igna

ls.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

BG

RQ

BG

RI

BG

RY

⋅+

⋅+

⋅=

⋅+

⋅−

⋅=

⋅+

⋅+

⋅=

31.052.0

21.0

32.028.0

60.0

11.059.0

30.0

Page 17: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

17 /

484.

1 B

asic

Con

cept

s: V

ideo

Sig

nal R

epre

sent

atio

n

A T

ypic

al N

TSC

Enc

oder

Y M

atri

x

I M

atri

x

Q M

atri

x

Add

er

1.3

MH

z lo

w p

ass

filte

r

0.6

MH

z lo

w p

ass

filte

r

Qua

drat

ure

Mod

ulat

ion

4.2

MH

zlo

w p

ass

filte

rC

ompo

site

NT

SC o

ut

R G B

Subc

arri

er

Page 18: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

18 /

48

Req

uire

d ba

ndw

idth

to tr

ansm

it N

TSC

sig

nals

is 4

.2 M

Hz,

6 M

Hz

incl

udin

g so

und.

The

lum

inan

ce (

Y)

or “

mon

ochr

ome”

sig

nal u

ses

3.2

MH

z of

the

avai

labl

e ba

ndw

idth

.

The

I-si

gnal

has

1.5

MH

z of

max

imal

ban

dwid

th, t

he Q

-sig

nal 0

.5 M

Hz.

The

I-s

igna

l is I

n-ph

ase

with

the

3.5

8 M

Hz

carr

ier

wav

e, t

he Q

-sig

nal i

s in

Q

uadr

atur

e (9

0de

gree

s ou

t of p

hase

) w

ith th

e 3.

58 M

Hz

carr

ier

wav

e.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

-10

12

34

5

Lum

inan

ce

Pic

ture

Car

rier

Soun

dC

arri

er

Chr

omin

ance

Chr

om.

Subc

arri

er

6 M

Hz

Page 19: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

19 /

48

Dig

itiza

tion

For

imag

e pr

oces

sing

or

tran

smis

sion

the

anal

og p

ictu

re o

r vi

deo

mus

t be

conv

erte

d to

adi

gita

l rep

rese

ntat

ion.

Dig

itiza

tion

cons

ists

of:

Sam

plin

g, w

here

the

colo

r/gr

ey le

vel i

n th

e pi

ctur

e is

mea

sure

d at

a M

xN a

rray

of

pixe

ls.

Qua

ntiz

ing,

whe

re th

e va

lues

in a

con

tinuo

us r

ange

are

div

ided

into

k in

terv

als.

For

a sa

tisfi

able

rec

onst

ruct

ion

of a

pic

ture

fro

m q

uant

ized

sam

ples

– 10

0 or

mor

e qu

antiz

ing

leve

ls m

ight

be

need

ed.

– V

ery

ofte

n 25

6 le

vels

are

use

d, w

hich

are

rep

rese

ntab

le w

ithin

8 B

its.

A d

igita

l pic

ture

con

sist

s of

an

arra

y of

inte

ger

valu

es r

epre

sent

ing

pixe

ls.

4.1

Bas

ic C

once

pts:

Vid

eo S

igna

l Rep

rese

ntat

ion

Page 20: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

20 /

48

Mos

t oft

en u

sed

disp

lays

are

ras

ter

disp

lays

.

Col

ors

are

disp

laye

d by

the

use

of a

Col

or L

ook

Up

Tab

le (

CL

UT

or

lut)

, whe

re a

limite

d nu

mbe

r of

n c

olor

s ou

t of

a co

lor

spac

e of

m c

olor

s ar

e ch

osen

(n <

< m

).

(Onl

y a

subs

et o

f th

e gl

obal

set

of

colo

rs is

use

d fo

r an

y ac

tual

pic

ture

.)

Vid

eo D

igit

izer

s / R

aste

r D

ispl

ays

4.1

Bas

ic C

once

pts:

Com

pute

r V

ideo

For

mat

Vid

eo D

igit

izer

s

Cha

ract

eris

tics

IRIS

VIN

OSu

n V

ideo

Fram

e R

esol

utio

n64

0 x

480

320

x 24

0

8 B

its/p

ixel

8 B

its/p

ixel

Qua

ntiz

atio

n

30 F

ram

es/s

ec4

Fram

es/s

ecFr

ame

Rat

e

Page 21: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

21 /

48

Mon

itor

Ras

ter

Dis

play

s Sy

stem

Arc

hite

ctur

e

Vid

eo c

ontr

olle

r di

spla

ys th

e im

age

whi

ch is

sto

red

in th

e fr

ame

buff

er b

y cy

clin

gth

roug

h th

e di

spla

y bu

ffer

at a

ref

resh

rat

e of

typi

cally

> 6

0 H

z (i

n or

der

to a

void

flic

keri

ng e

ffec

ts).4.

1 B

asic

Con

cept

s: C

ompu

ter

Vid

eo F

orm

at

CPU

Vid

eo

Con

trol

ler

Peri

pher

al D

evic

es

Syst

em B

us

Mem

ory

Fram

e B

uffe

r

Page 22: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

22 /

48

Vid

eo C

ontr

olle

r St

anda

rds

4.1

Bas

ic C

once

pts:

Com

pute

r V

ideo

For

mat

Vid

eo C

ontr

olle

r St

anda

rds

Res

olut

ion

320

x 20

0

640

x 35

0

640

x 48

0

1024

x 7

68

1024

x 7

6864

0 x

480

1024

x 7

6824

Bits

/pix

el23

59.3

KB

ytes

8 B

its/p

ixel

16 B

its/p

ixel

8 bi

ts/p

ixel

8 B

its/p

ixel

(256

col

ours

)

4 B

its/p

ixel

(i.e

. 1

6 co

lour

s ar

e po

ssib

le)

2 B

its/p

ixel

Col

our

pres

enta

tion

Stor

age

capa

city

16 K

Byt

es

112

KB

ytes

307.

2 K

Byt

es

786.

4 K

Byt

es

786.

4 K

byte

s61

4.4

KB

ytes

Col

our

Gra

phic

s A

dapt

er (

CG

A)

Enh

ance

d G

raph

ics

Ada

pter

(E

GA

)

Vid

eo G

raph

ics

Arr

ay (

VG

A)

8514

/A D

ispl

ay A

dapt

er M

ode

Ext

ende

d G

raph

ics

Arr

ay (

XG

A)

Supe

r V

GA

(SV

GA

)

AB

C =

A ·

B

Page 23: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

23 /

484.

2 T

elev

isio

n: C

onve

ntio

nal S

yste

ms

Vid

eo f

orm

at s

tand

ards

for

con

vent

iona

l tel

evis

ion

syst

ems:

NT

SC (

Nat

iona

l Tel

evis

ion

Syst

ems

Com

mitt

ee)

– E

xact

fram

e ra

te o

f 29.

97 H

z to

mai

ntai

n 4.

5 M

Hz

betw

een

the

visu

al a

nd a

udio

carr

iers

.

– D

elay

bet

wee

n fr

ames

: 100

0 m

s / a

ppro

x. 3

0 fr

ames

per

sec

. = 3

3.3

ms.

– T

he c

hrom

inan

ce s

igna

l C fo

r N

TS

C tr

ansm

issi

on c

an b

e re

pres

ente

d as

:

()

() t

YR

tY

BC

cc

ωω

cos

14.1si

n03.2

−+

−= 0.4

93·(

B-Y

)0

.877

·(R

-Y)

For

tran

smis

sion

the

sign

al is

shi

fted

up

to 3

.58

MH

z.

Page 24: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

24 /

48

PAL

(Ph

ase

Alte

rnat

ing

Lin

e, in

vent

ed b

y W

. Bru

ch/T

elef

unke

n 19

63)

– F

ram

e ra

te o

f 25

Hz,

del

ay b

etw

een

fram

es: 1

000

ms

/ 25

fram

es p

er s

ec. =

40

ms.

– Q

uadr

atur

e am

plitu

de m

odul

atio

n si

mila

r to

NT

SC

, but

col

or c

arrie

r is

not

sup

pres

sed.

Pha

se o

f the

R-Y

(V

) si

gnal

is r

ever

sed

by 1

80 d

egre

es fr

om li

ne to

line

, to

redu

ce c

olor

err

ors

that

occ

ur fr

om a

mpl

itude

and

pha

se d

isto

rtio

n du

ring

tran

smis

sion

.

The

chr

omin

ance

sig

nal C

for

PA

L tr

ansm

issi

on, w

ith U

= B

- Y

, can

be

repr

esen

ted

as:

4.2

Tel

evis

ion:

Con

vent

iona

l Sys

tem

s

()

()

()

()

()

()

R-Y

Vt

YR

tY

B

B-Y

Ut

Vt

UC

cc

cc

=⋅

−⋅

±⋅

−=

=

cos

877

.0si

n49

3.0

co

s14.1

sin

03.2ω

ω

ωω

SE

CA

M (

Seq

uent

ial C

oule

ur A

vec

Mem

oire

)

– B

ased

on

freq

uenc

y m

odul

atio

n, fr

ame

rate

of 2

5 H

z.

Page 25: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

25 /

484.

2 T

elev

isio

n: E

nhan

ced

Def

initi

on S

yste

ms

(ED

TV

)

-i in

terl

aced

, -p

prog

ress

ive

(non

-int

erla

ced)

Syst

em

NT

SC -

i

NT

SC -

p

Pal

-i

PA

L -

p

SEC

AM

-i

SEC

AM

-p

Tot

alL

ines 52

5

525

625

625

Vis

ible

Lin

es 484

484

575

Ver

tica

lR

esol

utio

n

242

340

290

400

290

400

Hor

izon

tal

Res

olut

ion

330

330

425

425

465

465

Vid

eoB

andw

idth

4.2

MH

z

4.2

MH

z

5.5

MH

z

5.5

MH

z

6 M

Hz

6 M

Hz

Asp

ect

Rat

io 4/3

Opt

imal

Vie

win

gD

ista

nce

7 m

5 m

6 m

4.3

m

6 m

4.3

m

625

625

575

575

575

4/3

4/3

4/3

4/3

4/3

Page 26: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

26 /

484.

2 T

elev

isio

n: E

nhan

ced

Def

initi

on S

yste

ms

(ED

TV

)

ED

TV

sys

tem

s ar

e co

nven

tiona

l sys

tem

s w

hich

off

er im

prov

ed v

ertic

al a

nd/o

rho

rizon

tal r

esol

utio

n by

som

e “t

ricks

”.

Com

b fil

ters

impr

ove

horiz

onta

l res

olu

tion

by m

ore

than

30%

acc

ordi

ng to

lite

ratu

re.

Sep

arat

e bl

ack

and

whi

te fr

om c

olor

info

rmat

ion

to e

limin

ate

rain

bow

effe

cts

whi

leex

tend

ing

reso

lutio

n.

Pro

gres

sive

(no

n-in

terla

ced)

sca

nnin

g im

prov

es v

ertic

al r

esol

utio

n.

Inse

rtio

n of

“bl

ank

lines

” in

bet

wee

n “a

ctiv

e lin

es”,

whi

ch a

re fi

lled

with

info

rmat

ion

fro

m: –

abov

e lin

e

– be

low

line

– sa

me

line

in p

revi

ous

pict

ure

Impr

oved

Def

init

ion

TV

(ID

TV

)

Page 27: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

27 /

48

Oth

er E

DT

V d

evel

opm

ents

are

:

IDT

V (

Impr

oved

-Def

init

ion

Tel

evis

ion)

– In

term

edia

te le

vel b

etw

een

NT

SC

and

HD

TV

(H

igh-

Def

initi

on

Tel

evis

ion)

in th

e U

.S.

– Im

prov

e N

TS

C im

age

by u

sing

dig

ital m

emor

y to

dou

ble

scan

ning

line

s

from

525

to 1

050.

– O

ne 1

050-

line

imag

e is

dis

play

ed in

1/6

0 se

c (6

0 fr

ames

/sec

).

– D

igita

l sep

arat

ion

of c

hrom

inan

ce a

nd lu

min

ance

sig

nals

pre

vent

s

cros

s-in

terf

eren

ce

4.2

Tel

evis

ion:

Enh

ance

d D

efin

ition

Sys

tem

s (E

DT

V)

Page 28: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

28 /

484.

2 T

elev

isio

n: E

nhan

ced

Def

initi

on S

yste

ms

(ED

TV

)D

2-M

AC

(D

uobi

nary

Mul

tiple

xed

Ana

logu

e C

ompo

nent

s)

– In

term

edia

te le

vel b

etw

een

curr

ent t

elev

isio

n an

d H

DT

V in

Eur

ope.

– U

ses

time-

mul

tiple

xing

for

com

pone

nt tr

ansm

issi

on. 6

4 m

icro

sec.

tim

e sl

ot is

div

ided

into

:

34.

4 m

sec

lum

inan

ce s

igna

l, 17

.2 m

sec

chro

min

ance

sig

nal a

nd 1

0.3

mse

c vo

ice

+ d

ata

– 62

5 lin

es (

574

visi

ble)

, asp

ect r

atio

s 4/

3 an

d 16

/9 a

re s

uppo

rted

– A

udio

/dat

a ar

e tr

ansm

itted

in d

uobi

nary

cod

ing

with

a r

ate

of10

5 B

its /

64 m

sec

= 1

.64

MB

its/s

– 2

high

qua

lity

ster

eo c

hann

els

or u

p to

8 c

hann

els

of lo

wer

aud

io q

ualit

y

105

Bit

Chr

omin

ance

U/V

Lum

inan

ce(m

ore

impo

rtan

t tha

n ch

rom

inan

ce,

i.e. m

ore

time,

mor

e bi

ts)

Dat

a +

Sou

nd

10.3

mic

rose

c.17

.2 m

icro

sec.

34.4

mic

rose

c.

64 m

icro

sec.

Page 29: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

29 /

484.

2 T

elev

isio

n: H

igh

Def

initi

on S

yste

ms

(HD

TV

)

Com

posi

te C

odin

g

HD

TV

is c

hara

cter

ized

by:

Hig

her

Res

olut

ion,

app

rox.

twic

e as

man

y ho

rizo

ntal

and

ver

tical

pix

els

asco

nven

tiona

l sys

tem

s, (

lines

tran

smitt

ed >

100

0), t

otal

ban

dwid

th 5

- 8

tim

es la

rger

than

toda

y.

Asp

ect R

atio

: 16/

9 =

1.7

77.

Pref

erre

d V

iew

ing

Dis

tanc

e: b

etw

een

2.4

and

3.3

met

ers.

Page 30: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

30 /

484.

2 T

elev

isio

n: H

igh

Def

initi

on S

yste

ms

(HD

TV

)

Dig

ital C

odin

g is

ess

entia

l in

the

desi

gn a

nd im

plem

enta

tion

of H

DT

V:

1. C

ompo

site

Cod

ing

(sam

plin

g of

the

com

posi

te a

nalo

g vi

deo

sign

al i.

e. a

llsi

gnal

com

pone

nts

are

conv

erte

d to

geth

er in

to a

dig

ital f

orm

) is

the

stra

ight

forw

ard

and

easi

est a

ltern

ativ

e, b

ut:

– c

ross

-tal

k be

twee

n lu

min

ance

and

chr

omin

ance

in th

e co

mpo

site

sig

nal,

– c

ompo

site

cod

ing

depe

nds

on th

e te

levi

sion

sta

ndar

d,

– s

ampl

ing

freq

uenc

y ca

nnot

be

adop

ted

to th

e ba

ndw

idth

req

uire

men

ts o

fco

mp

onen

ts,

– s

ampl

ing

freq

uenc

y is

not

cou

pled

with

col

or c

arrie

r fr

eque

ncy.

Page 31: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

31 /

48

Alte

rnat

ive:

2. C

ompo

nent

Cod

ing

(sep

arat

e di

gitiz

atio

n of

var

ious

imag

e co

mpo

nent

s):

– th

e m

ore

impo

rtan

t lum

inan

ce s

igna

l is

sam

pled

with

13.

5 M

Hz,

– th

e ch

rom

inan

ce s

igna

ls (

R-Y

, B-Y

) ar

e sa

mpl

ed w

ith 6

.75

MH

z.

Í G

loba

l ban

dwid

th: 1

3 M

hz +

6.7

5 M

Hz

> 1

9 M

Hz

– Lu

min

ance

and

chr

omin

ance

sig

nals

are

qua

ntiz

ed u

nifo

rmly

with

8 B

its.

Due

to h

igh

data

rat

es (

1050

line

s ·

600

pixe

ls/li

ne ·

30

fram

es/s

ec)

band

wid

th is

appr

ox.

19 M

Hz

and

ther

efor

e su

bsta

ndar

ds (

syst

ems

whi

ch n

eed

a lo

wer

dat

a ra

te)

for

tran

smis

sion

hav

e be

en d

efin

ed (

see

the

sect

ion

on T

rans

mis

sion

).

4.2

Tel

evis

ion:

Hig

h D

efin

ition

Sys

tem

s (H

DT

V)

Page 32: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

32 /

484.

2 T

elev

isio

n: H

igh

Def

initi

on S

yste

ms

(HD

TV

)

Wor

ldw

ide

3 di

ffer

ent H

DT

V s

yste

ms

are

bein

g de

velo

ped:

Uni

ted

Stat

es–

Ful

l-dig

ital s

olut

ion

with

105

0 lin

es (

960

visi

ble)

and

a s

can

rate

of 5

9.94

Hz.

– C

ompa

tible

with

NT

SC

thro

ugh

IDT

V.

Eur

ope

– H

D-M

AC

(H

igh

Def

initi

on M

ultip

lexe

d A

nalo

g C

ompo

nent

s), d

evel

oped

by

EU

RE

KA

.–

1250

line

s (1

000

visi

ble)

and

a s

can

rate

of 5

0 H

z.–

Hal

ving

of l

ines

(62

5 of

125

0) a

nd o

f ful

l-pic

ture

mot

ion

allo

ws

sim

ple

conv

ersi

on to

PA

Lor

D2-

MA

C.

– H

D-M

AC

rec

eive

r us

es d

igita

l im

age

stor

age

to s

how

full

reso

lutio

n an

d m

otio

n.

Japa

n – M

US

E is

a m

odifi

catio

n of

the

first

NH

K (

Japa

n B

road

cast

ing

Com

pany

) H

DT

V

Sta

ndar

d.–

MU

SE

is a

Dire

ct-B

road

cast

-fro

m-S

atel

lite

(DB

S)

Sys

tem

, whe

re th

e 20

MH

z ba

ndw

idth

is r

educ

ed b

y co

mpr

essi

on to

the

8.15

MH

z av

aila

ble

on th

e sa

telli

te c

hann

el.

– F

ull d

etai

l of t

he 1

125

line

imag

e is

ret

aine

d fo

r st

atio

nary

sce

nes,

with

mot

ion

the

defin

ition

is r

educ

ed b

y ap

prox

. 50%

.

Page 33: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

33 /

484.

2 T

elev

isio

n: H

igh

Def

initi

on S

yste

ms

(HD

TV

)

-i in

terl

aced

, -p

prog

ress

ive

(non

-int

erla

ced)

Syst

em

HD

TV

USA

HD

-MA

C

MU

SE

NT

SC i

PA

L i

SEC

AM

-i

Tot

alL

ines 10

50

1250

1125 525

Vis

ible

Lin

es 960

1000

1080

Ver

tica

lR

esol

utio

n

675

700

540

242

290

290

Hor

izon

tal

Res

olut

ion

600

700

600

330

425

465

Tot

alB

andw

idth

9.0

MH

z

12.0

MH

z

30.0

MH

z

6 M

Hz

8 M

Hz

8 M

Hz

Scan

Rat

e (H

z)C

amer

a

59.9

4 p

Scan

Rat

e (H

z)D

ispl

ay

59.9

4 p

100

p

60 i

59.9

4 i

50 i

50 i

625

625

484

575

575

50 p

60 i

59.9

4 i

50 i

50 i

Page 34: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

34 /

484.

2 T

elev

isio

n: T

rans

mis

sion

(Su

bsta

ndar

ds)

HD

TV

dat

a ra

tes

for

tran

smis

sion

tota

l pic

ture

ele

men

ts =

hor

izon

tal r

esol

utio

n ·

vert

ical

res

olut

ion

USA

: 720

,000

pix

els

· 24

Bits

/pix

el ·

60

fram

es/s

ec. =

103

6.8

MB

its/s

ec

Eur

ope:

870

,000

pix

el ·

24

Bits

/pix

el ·

50

fram

es/s

ec =

104

4 M

Bits

/sec

Red

uctio

n of

dat

a ra

te is

una

void

able

, sin

ce r

equi

red

rate

s do

not

fit t

o “s

tand

ard

capa

citie

s”pr

ovid

ed b

y br

oadb

and

netw

orks

(e.

g. 1

55 o

r 34

MB

its/s

ec).

Diff

eren

t sub

stan

dard

s fo

r da

ta r

educ

tion

are

defin

ed:

Subs

tand

ards

Sam

plin

g R

ates

(M

Hz)

Lum

inan

ceC

hrom

inan

ce

Dat

a ra

te(M

bits

/sec

)

Sub

stan

dard

1

Sub

stan

dard

2

Sub

stan

dard

3

11.2

5 =

5/6

· 1

3.5

10.1

25 =

3/4

· 1

3.5

9.0

= 2

/3 ·

13.

52.

25 =

1/3

· 6

.75

108

3.37

5 =

1/2

· 6

.75

5.62

5 =

5/6

· 6

.75

180

125

fits

into

a

140

Mbi

t/se

cch

anne

l

Page 35: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

35 /

484.

2 T

elev

isio

n: T

rans

mis

sion

Furt

her

redu

ctio

n of

dat

a ra

tes

is r

equi

red

for

pict

ure

tran

smis

sion

Sam

plin

g ga

ps a

re le

ft o

ut (

only

vis

ible

are

as a

re c

oded

):

– Lu

min

ance

has

648

sam

ple

valu

es p

er li

ne, b

ut o

nly

540

of th

em a

re v

isib

le.

– C

hrom

inan

ce h

as 2

16 s

ampl

e va

lues

per

line

, but

onl

y 18

0 ar

e vi

sibl

e.

– 57

5 vi

sibl

e lin

es: (

540

+ 1

80 +

180

) sa

mpl

es/li

ne

· 57

5 lin

es/f

ram

e =

517

,500

sam

ples

/fra

me

– 51

7,50

0 sa

mpl

es/fr

ame · 8

Bit

s/sa

mpl

e ·

25 f

ram

es/s

ec =

103

.5 M

Bits

/sec

Red

uctio

n of

ver

tical

chr

omin

ance

res

olut

ion:

– O

nly

the

chro

min

ance

sig

nals

of e

ach

seco

nd li

ne a

re tr

ansm

itted

.

– 57

5 vi

sibl

e lin

es: (

540

+ 9

0 +

90)

sam

ples

/line

·

575

lines

/fra

me

= 4

14,0

00 s

ampl

es/f

ram

e

– 41

4,00

0 sa

mpl

es/fr

ame · 8

Bit

s/sa

mpl

e ·

25 f

ram

es/s

ec =

82.

8 M

Bits

/sec

Dif

fere

nt s

ourc

e co

ding

:

– U

sing

an

intr

a-fr

ame

wor

king

AD

PC

M w

ith 3

inst

ead

of 8

Bits

/sam

ple

– 41

4,00

0 sa

mpl

es/fr

ame · 3

Bit

s/sa

mpl

e ·

25 f

ram

es/s

ec =

31.

05 M

Bits

/sec

Page 36: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

36 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: B

asic

Con

cept

s

to a

nim

ate

= “

to b

ring

to li

fe”

Ani

mat

ion

cove

rs c

hang

es in

:

time-

vary

ing

posi

tions

(m

otio

n dy

nam

ics)

,

shap

e, c

olor

, tra

nspa

renc

y, s

truc

ture

and

text

ure

of a

n ob

ject

(up

date

dyn

amic

s) a

s w

ell

as li

ghtn

ing,

cam

era

posi

tion,

cam

era

orie

ntat

ion

and

focu

s.

Bas

ic C

once

pts

of a

nim

atio

n ar

e:

Inpu

t Pro

cess

–K

ey

fram

es,

wh

ere

an

ima

ted

ob

ject

s a

re a

t ext

rem

e o

r ch

ara

cte

rist

ic p

osi

tion

s m

ust b

edi

gitiz

ed f

rom

dra

win

gs.

–O

ften

a po

st-p

roce

ssin

g by

a c

ompu

ter

is r

equi

red.

Page 37: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

37 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: B

asic

Con

cept

s

Com

posi

tion

Sta

ge

Fore

grou

nd a

nd b

ackg

roun

d fi

gure

s ar

e co

mbi

ned

to g

ener

ate

an in

divi

dual

fra

me.

Plac

ing

of s

ever

al lo

w-r

esol

utio

n fr

ames

of

an a

nim

atio

n in

an

arra

y le

ads

to a

trai

l fil

m(p

enci

l tes

t), b

y th

e us

e of

the

pan-

zoom

fea

ture

(T

his

feat

ure

is a

vaila

ble

for

som

efr

ame

buff

ers)

.

The

fra

me

buff

er c

an ta

ke a

par

t of

an im

age

(pan

) an

d en

larg

e it

to f

ull s

cree

n (z

oom

).

Con

tinui

ty is

ach

ieve

d by

rep

eatin

g th

e pa

n-zo

om p

roce

ss f

ast e

noug

h.

Page 38: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

38 /

48

In-b

etw

een

Proc

ess

Com

posi

tion

of in

term

edia

te f

ram

es b

etw

een

key

fram

es.

Perf

orm

ed b

y lin

ear

inte

rpol

atio

n (l

erpi

ng)

betw

een

star

t- a

nd e

nd-p

ositi

ons.

To

achi

eve

mor

e re

alis

tic r

esul

ts, c

ubic

spl

ine-

inte

rpol

atio

n ca

n be

use

d.

4.3

Com

pute

r-ba

sed

Ani

mat

ion:

Bas

ic C

once

pts

Key

fra

mes

Inte

rpol

ated

fram

es

Rat

her

unre

alis

tic

mot

ion

(in

mos

tca

ses)

Page 39: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

39 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: B

asic

Con

cept

s

A f

unct

ion

s: i

s ca

lled

cubi

c in

terp

olat

ing

splin

e to

the

poin

ts a

= X

0 <

X1

< ..

. < X

n+1

= b

, if

1. s

is tw

ice

cont

inuo

us d

iffe

rent

iabl

e

2. i

= 0

, ...,

n w

hich

mea

ns i

s a

poly

nom

ial o

f de

gree

3

Thi

s lin

e is

sm

ooth

, bec

ause

the

poly

nom

ials

hav

e eq

ual p

rim

ary

and

seco

ndar

y de

riva

tions

at

the

poin

ts X

0 , X

1 ,..

. ,X

n+1

Spli

ne 1

Spli

ne 2

x 0x 1

x 2

mor

e re

alis

tic

mot

ion

achi

eved

by tw

o cu

bic

spli

nes

Page 40: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

40 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: B

asic

Con

cept

s

Cal

cula

tion

of s

ucce

ssiv

e cu

bic

splin

es:

S 0(x)

S 1(x)

S 2(x)

S 3(x)

f(x 0)

f(x 1)

f(x 2)

f(x 3)

x 0x 1

x 2x 3

x 4

s i(x)

are

poly

nom

ials

of

degr

ee 3

.L

et s

0(x)

be

give

n.T

hen

s 1(x)

= a

3·x3

+ a

2·x2

+ a

1·x

+ a

0 is

con

stru

cted

as

follo

ws:

()

()

()

()

()

()

()

()

10

21

31

1

10

11

22 1

31

1

20

21

2 22

3 23

21

10

11

2 12

3 13

11

ˆ2

6

ˆ2

3

ˆˆ

xs

ax

ax

s

xs

ax

ax

ax

s

xf

ax

ax

ax

ax

s

xf

ax

ax

ax

ax

s

″=

+⋅

=″

′=

+⋅

+⋅

=′

=+

⋅+

⋅+

⋅=

=+

⋅+

⋅+

⋅=

4 eq

uatio

ns f

or a

3, a

2, a

1, a

0

Page 41: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

41 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: B

asic

Con

cept

s

Cha

ngin

g C

olor

s (t

wo

tech

niqu

es):

1. C

LU

T a

nim

atio

n: c

hang

ing

of th

e C

olor

Loo

k U

p T

able

(C

LU

T)

of th

e fr

ame

buff

er.

Thi

s ch

ange

s th

e co

lour

s of

the

imag

e.

2. N

ew c

olou

r in

form

atio

n fo

r ea

ch f

ram

e:

Fram

e bu

ffer

: 640

x 5

12 p

ixel

· 8

Bits

/pix

el ·

30 f

ram

es p

er s

ec. =

78.

6 M

Bits

/sec

dat

ara

te f

or c

ompl

ete

upda

te.

1. is

muc

h fa

ster

than

2. s

ince

cha

ngin

g th

e C

LU

T r

equi

res

the

tran

smis

sion

of

only

0.3

- 3

Kby

tes

(her

e 2.

is m

ore

than

300

tim

es f

aste

r th

an 1

.).

Page 42: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

42 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: A

nim

atio

n L

angu

ages

Cat

egor

ies

for

Ani

mat

ion

lang

uage

s:

Lin

ear-

list

Not

atio

ns

– E

vent

s ar

e de

scrib

ed b

y st

artin

g an

d en

ding

fram

e nu

mbe

r an

d an

act

ion

(eve

nt).

– 17

, 31,

C, R

OT

AT

E “

HO

US

E”,

1, 4

5 m

eans

:

betw

een

fram

es 1

7 an

d 31

rot

ate

the

obje

ct H

OU

SE

aro

und

axis

1 b

y 45

deg

rees

,de

term

inin

g th

e am

ount

of r

otat

ion

at e

ach

fram

e fr

om ta

ble

C.

Gen

eral

-pur

pose

Lan

guag

es

– E

mbe

d an

imat

ion

capa

bilit

y w

ithin

pro

gram

min

g la

ngua

ges.

– V

alue

s of

var

iabl

es a

s pa

ram

eter

s to

the

rout

ines

that

per

form

ani

mat

ion.

– e.

g. A

SA

S, w

hich

is b

uilt

on to

p of

LIS

P:

(gra

sp m

y-cu

be):

cub

e be

com

es c

urre

nt o

bjec

t

(cw

0.0

5): s

pin

it cl

ockw

ise,

by

a sm

all a

mou

nt

Page 43: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

43 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: A

nim

atio

n L

angu

ages

Gra

phic

al L

angu

ages

(Mot

ivat

ion:

Tex

tual

lang

uage

s ca

nnot

vis

ualiz

e th

e ac

tions

by

look

ing

at th

epr

ogra

mm

e co

de.)

– D

escr

ibe

anim

atio

n in

a m

ore

visu

al w

ay th

an te

xtua

l lan

guag

es.

– E

xpre

ss, e

dit a

nd c

ompr

ehen

d th

e ch

ange

s in

an

anim

atio

n.

– E

xplic

it de

scrip

tions

of a

ctio

ns a

re r

epla

ced

by a

pic

ture

of t

he a

ctio

n.

– E

xam

ples

are

: GE

NE

SY

S, D

IAL

and

S-D

ynam

ic S

yste

m.

Page 44: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

44 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: C

ontr

ollin

g of

Ani

mat

ion

Tec

hniq

ues

for

cont

roll

ing

anim

atio

ns (

inde

pend

ent o

f th

e la

ngua

ge w

hich

des

crib

es th

ean

imat

ion)

:

Full

Exp

licit

Con

trol

:

– C

ompl

ete

way

of c

ontr

ol, b

ecau

se a

ll as

pect

s ar

e de

fined

:

sim

ple

chan

ges

(sca

ling,

tran

slat

ion,

rot

atio

n) a

re s

peci

fied

or k

ey fr

ames

and

inte

rpol

atio

n m

etho

ds (

eith

er e

xplic

it or

by

dire

ct m

anip

ulat

ions

by

mou

se, j

oyst

ick,

data

glo

ve)

are

prov

ided

.

Proc

edur

al C

ontr

ol:

– C

omm

unic

atio

n be

twee

n ob

ject

s to

det

erm

ine

prop

ertie

s.

– P

hysi

cally

-bas

ed s

yste

ms:

pos

ition

of o

ne o

bjec

t may

influ

ence

mot

ion

of a

noth

er (

ball

ca

nnot

pas

s a

wal

l).

– A

ctor

-bas

ed s

yste

ms:

act

ors

pass

thei

r po

sitio

n to

oth

er a

ctor

s to

affe

ct th

eir

beha

vior

(ac

tor

A s

tays

beh

ind

acto

r B

).

Page 45: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

45 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: C

ontr

ollin

g of

Ani

mat

ion

Con

stra

int-

base

d Sy

stem

s

– “N

atur

al”

way

of m

ovin

g fr

om A

to B

is v

ia a

str

aigh

t lin

e, i.

e. li

near

ly. H

owev

er, v

ery

of

ten

the

mot

ion

is m

ore

com

plic

ated

.

– M

ovem

ent o

f obj

ects

is d

eter

min

ed b

y ot

her

obje

cts,

they

are

in c

onta

ct w

ith.

– C

ompo

und

mot

ion

may

not

be

linea

r an

d is

mod

eled

by

cons

trai

nts

(bal

l fol

low

s a

pat

hway

).

Tra

ckin

g Li

ve A

ctio

n

– T

raje

ctor

ies

of a

nim

ated

obj

ects

are

gen

erat

ed b

y tr

acki

ng li

ve a

ctio

n.

– R

otos

copi

ng: F

ilm w

ith r

eal a

ctor

s as

tem

plat

e, d

esig

ners

dra

w o

ver

the

film

, cha

nge

ba

ckgr

ound

and

rep

lace

hum

an a

ctor

s w

ith a

nim

ated

cou

nter

part

s.

– A

ttach

indi

cato

rs to

key

poi

nts

of a

ctor

’s b

ody.

Tra

ckin

g of

indi

cato

r po

sitio

ns p

rovi

des

ke

y po

ints

in th

e an

imat

ion

mod

el.

– A

noth

er e

xam

ple:

Dat

a gl

ove

mea

sure

s:

– po

sitio

n an

d or

ient

atio

n of

the

hand

– fle

xion

and

ext

ensi

on o

f fin

gers

and

fing

erpa

rts

Fro

m th

ese

info

rmat

ions

we

can

calc

ulat

e ac

tions

, e.g

. mov

emen

ts

Page 46: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

46 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: C

ontr

ollin

g of

Ani

mat

ion

Kin

emat

ics:

– D

escr

iptio

n us

ing

the

posi

tion

and

velo

city

of o

bjec

ts.

– e.

g. A

t tim

e t =

0 th

e C

UB

E is

at t

he o

rigin

. It m

oves

with

the

cons

tant

acc

eler

atio

n of

0.5

m/s2

for

2 se

c. in

the

dire

ctio

n of

(1,

1,4)

.

Dyn

amic

s:

– T

akes

into

con

side

ratio

n th

e ph

ysic

al la

ws

th

at d

efin

e th

e ki

nem

atic

s.

– e.

g. A

t tim

e t =

0 th

e C

UB

E is

in p

ositi

on (

0 m

eter

s, 1

00 m

eter

s, 0

met

ers)

and

has

a m

ass

of 5

Kg.

The

forc

e of

gra

vity

(g)

act

s o

n th

e cu

be (

Res

ult i

n th

is c

ase:

the

ball

will

fall

dow

n).(0

, 0, 0

) → (

1, 1

, 4)

2 se

cond

sb

= 0

.5m

/s2

kine

mat

ic d

escr

iptio

n of

a

mot

ion

of a

cub

e

y

z

x

(0, 1

00, 0

)

Page 47: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

47 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: D

ispl

ay o

f A

nim

atio

nFo

r th

e di

spla

y of

ani

mat

ions

with

ras

ter

syst

ems

the

anim

ated

obj

ects

hav

e to

be

scan

-con

vert

edto

thei

r pi

xmap

in th

e fr

ame

buff

er.

Thi

s pr

oced

ure

has

to b

e do

ne a

t lea

st 1

0 (b

ette

r: 2

0) ti

mes

per

sec

ond

in o

rder

to g

ive

are

ason

ably

sm

ooth

eff

ect.

Prob

lem

:

Fram

e ra

te o

f 20

pic

ture

s/se

c. r

equi

res

man

ipul

atio

n, s

can-

conv

ersi

on a

nd d

ispl

ay o

f an

obj

ect i

non

ly 5

0 m

sec.

Scan

con

vers

ion

shou

ld o

nly

use

a sm

all f

ract

ion

of th

ese

50 m

sec

sinc

e ot

her

oper

atio

ns(e

rasi

ng, r

edra

win

g, ..

. etc

) ha

ve to

be

done

too.

Solu

tion:

Dou

ble-

buff

erin

g: f

ram

e bu

ffer

is d

ivid

ed in

to tw

o im

ages

, eac

h w

ithha

lf of

the

bits

of t

he o

vera

ll fr

ame

buffe

r (“

pipe

line”

).

Whi

le th

e op

erat

ion

(like

rot

atin

g) a

nd s

can-

conv

ersi

on is

pro

cess

edfo

r th

e se

cond

hal

f of t

he p

ixm

ap, t

he fi

rst h

alf i

s di

spla

yed

and

vice

vers

a.

Pic

1Pi

c 0

Pic

2Pi

c 1

Pic

3Pi

c 2

Tim

e

Prep

arat

ion

Dis

play

Page 48: 4. Video and Animation Contents - RWTH Aachen University...4. Video and Animation Multimedia Kommunikation SS‘99 2 / 48 Overview 4.1 Basic Concepts In this part the basic features

4. V

ideo

and

Ani

mat

ion

Multimedia Kommunikation SS‘99

48 /

484.

3 C

ompu

ter-

base

d A

nim

atio

n: T

rans

mis

sion

of

Ani

mat

ion

Sym

boli

c R

epre

sent

atio

nG

raph

ical

des

crip

tions

(ci

rcle

) of

an

anim

ated

obj

ect (

ball)

+ o

pera

tions

(ro

ll)

Ani

mat

ion

is d

ispl

ayed

at t

he r

ecei

ver

by s

can-

conv

ersi

on o

f ob

ject

s to

pix

map

Tra

nsm

issi

on r

ate

depe

nds

on (

tran

smis

sion

rat

e is

con

text

dep

ende

nt):

– si

ze o

f the

sym

bolic

rep

rese

ntat

ion

stru

ctur

e, s

ize

of o

pera

tion

stru

ctur

e,

– nu

mbe

r of

ani

mat

ed o

bjec

ts a

nd o

f com

man

ds.

(Tra

nsm

issi

on ti

me

is s

hort

er s

ince

sym

bolic

rep

rese

ntat

ion

is s

mal

ler

than

pix

map

repr

esen

tatio

n, b

ut d

ispl

ay ti

me

is lo

nger

sin

ce s

can

conv

ertin

g ha

s to

be

done

)

Pixm

ap R

epre

sent

atio

nLo

nger

tim

es fo

r da

ta tr

ansm

issi

on th

an w

ith s

ymbo

lic r

epre

sent

atio

n, b

ecau

se o

f the

larg

e da

tasi

ze o

f pix

map

.

Sho

rter

dis

play

tim

es, b

ecau

se n

o sc

an-c

onve

rsio

n is

nec

essa

ry a

t rec

eive

r si

de.

Tra

nsm

issi

on r

ate

= s

ize

of p

ixm

ap

· fr

ame

rate

(fi

xed

tran

smis

sion

rat

e).