6.375 Final Project Spring 2013John DonnalNamir JawdatSumit Dutta

OutlineProject OverviewEVM Design

FIR FilterLaplacian Decomposition

Thermal ImagingDemonstration

Eulerian Video Magnification (EVM)

Spatial decompositionTemporal filteringSpatial reconstruction

Input video

Output video

EVM Implementation

1-Level Pyramid

FIR Series ↓ 2Downsampler

]]]

FIFO

↑ 2Upsampler

FIR Series

Subtract (y − x)

BA

Shift Register

Delay xy

]]]FIFO

]]]

FIFOE

1-Level Reconstruction

↑ 2 FIR SeriesUpsampler

]]]

FIFOAddC

Shift Register

DelayF

K

FIR FilterR0 R1 R2

* * **C0 C1 C2 C3 C4

in out

+sum

FIR Series

in

FIR Filte

r

Shift Regist

ersum sum

+

out

FIR Filte

r

Shift Regist

er

FIR Filte

r

Shift Regist

ersum

]]] FIFO

FIFO

]]]

ConvolutionAlthough 3x3 is shown here,We actually do 5x5

Downsampler and Upsampler

Original

Downsampled

Downsampled and upsampled

EVM for the System on the FPGA

1-Level Pyramid

1-Level Reconstruction

Temporal Filter

(Bandpass Filter)

A

K

E

B

F

C

1-Level Pyramid

1-Level Reconstruction

Temporal Filter

Expand as feasible(future)

Expand as feasible(future)

1-Level Pyramid

1-Level Reconstruction

Temporal Filter

…

…

Chunker(Int.Fixed Pt.)

Splitter(Fixed Pt.Int.)

Input Image BRAM

Output Image BRAM

FIR Series ↓ 2

Downsampler

]]]

FIFO

↑ 2Upsampler

FIR Series

Subtract (y − x)

BA

Shift Register

Delay xy

]]]FIFO

]]]

FIFO

E

Thermal Imaging

Thermal Imaging1.) Calculate Ambient Temperature

2.) Calculate Offset Compensation ( x 64)

3.) Calculate Pixel Temperature ( x 64)

Need Floating Point

Thermal Imaging32° 100°

Demonstration