6.375 final project spring 2013 john donnal namir jawdat sumit dutta

6.375 Final Project Spring 2013John DonnalNamir JawdatSumit Dutta

OutlineProject Overview

EVM DesignFIR FilterLaplacian Decomposition

Thermal Imaging

Demonstration

Eulerian Video Magnification (EVM)

Spatial decomposition

Temporal filtering

Spatial reconstruction

Input video

Output video

EVM Implementation

1-Level Pyramid

FIR Series ↓ 2

Downsampler

]]]

FIFO

↑ 2Upsampler

FIR Series

Subtract (y − x)

BA

Shift Register

Delay xy

]]]FIFO

]]]

FIFO

E

1-Level Reconstruction

↑ 2 FIR Series

Upsampler

]]]

FIFOAdd

C

Shift Register

Delay

F

K

FIR Filter

R0 R1 R2

* * **C0 C1 C2 C3 C4

in out

+

sum

FIR Series

in

FIR Filte

r

Shift Regist

ersum sum

+

out

FIR Filte

r

Shift Regist

er

FIR Filte

r

Shift Regist

ersum

]]]

FIFO

FIFO

]]]

Convolution

Although 3x3 is shown here,We actually do 5x5

Downsampler and Upsampler

Original

Downsampled

Downsampled and upsampled

EVM for the System on the FPGA

1-Level Pyramid

1-Level Reconstruction

Temporal Filter

(Bandpass Filter)

A

K

E

B

F

C

1-Level Pyramid

1-Level Reconstruction

Temporal Filter

Expand as feasible(future)

Expand as feasible(future)

1-Level Pyramid

1-Level Reconstruction

Temporal Filter

…

…

Chunker(Int.Fixed Pt.)

Splitter(Fixed Pt.Int.)

Input Image BRAM

Output Image BRAM

FIR Series ↓ 2

Downsampler

]]]

FIFO

↑ 2Upsampler

FIR Series

Subtract (y − x)

BA

Shift Register

Delay xy

]]]FIFO

]]]

FIFO

E

Thermal Imaging

Thermal Imaging1.) Calculate Ambient Temperature

2.) Calculate Offset Compensation ( x 64)

3.) Calculate Pixel Temperature ( x 64)

Need Floating Point

Thermal Imaging32° 100°

Demonstration