presentation: reviews and talks on icme 2016disp.ee.ntu.edu.tw/class/main.pdfpresentation: reviews...

Post on 18-Mar-2020

3 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Presentation:

Reviews and talks on ICME 2016

Cho-Ying Wu

Disp Lab

Graduate Institute of Communication Engineering National Taiwan University

December 07, 2016

Cho-Ying Wu Disp Lab 1 / 70

ICME is a high-class conference on Multimedia.

Cho-Ying Wu Disp Lab

Introduction

2 / 70

Multimedia ?

Graphics

Speech

Vision

Display

Data Mining

Video

Top conference on multimedia and related

Cho-Ying Wu Disp Lab

Introduction

3 / 70

CVPR / ICCV, ECCV, ACM MM

Generally, ICME is suitable for MS(30%), PhD(65%) students to

challenge. Recruitments from industrial are also a lot.

Topics this year : ( Video and Vision are the most popular in the trend)

Cho-Ying Wu Disp Lab

Introduction

4 / 70

Roadmap

1 Impressive Talks (1) Fei-Fei Li, Associate Professor, “A Quest for Visual Intelligence.”Computer

Science Dept. Director, Stanford Artificial Intelligence Lab.

(2) Mathias Wien, “High Efficiency Video Coding – Coding Tools and Specification: HEVC V3 and Coming Developments”

Interesting Works

(1) Gene Cheung, Xian Ming Liu “Graph Signal Processing for Image Compression

and Restoration,” Nii.

(2) Xian Ming Liu, “Random Walk Graph Laplacian based Smoothness Prior for

Soft Decoding of JPEG Images,” HIT.

Cho-Ying Wu Disp Lab 5 / 70

2

Cho-Ying Wu Disp Lab 6 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 7 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 8 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 9 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 10 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 11 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 12 / 70 Cho-Ying Wu Disp Lab

Semantic Segmentation

Sparsity Model

Cho-Ying Wu Disp Lab 13 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 14 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 15 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 16 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 17 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 18 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 19 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 20 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 21 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 22 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 23 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 24 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 25 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 26 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 27 / 70 Cho-Ying Wu Disp Lab

Fei-Fei Li

Sparsity Model

Cho-Ying Wu Disp Lab 28 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 29 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 30 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 31 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 32 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 33 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 34 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 35 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 36 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 37 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 38 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 39 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 40 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 41 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 42 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 43 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 44 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 45 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 46 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 47 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 48 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 49 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Sparsity Model

Cho-Ying Wu Disp Lab 50 / 70 Cho-Ying Wu Disp Lab

Mathias Wien

Gene Cheung (1) Gene Cheung, Xian Ming Liu “Graph Signal Processing for Image Compression

and Restoration,” Nii.

1

Cho-Ying Wu Disp Lab 51 / 70 Cho-Ying Wu Disp Lab

Traditional signal property:

1. Discrete

2. Smooth

3. Band-limited frequency

Ex. DCT ( Approx. of KLT )

1

0

1cos

2

N

k n

n

X x n kN

Dictionary representation inducing sparse coding

a x

Gene Cheung

Graph Signal : Signal live on graph

Ex. Images: 2D – grid

Research interest:

1. Sampling : how to efficiently acquire signal from graph

2. Representation : Given the graph signal, how to compactly

represent it.

3. Signal Restoration : given the partial or noisy signal, how to

recover the structure.

1

Cho-Ying Wu Disp Lab 52 / 70 Cho-Ying Wu Disp Lab

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 53 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 54 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 55 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 56 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 57 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 58 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 59 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 60 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 61 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 62 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

D: distortion R: bit-rate

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 63 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 64 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

Graph Laplacian :

1. Adjancency Matrix

1

Cho-Ying Wu Disp Lab 65 / 70 Cho-Ying Wu Disp Lab

Remark: Sometimes the original problem is hard to solve, we can

change the original problem (primal problem) into dual problem

Gene Cheung

1

Cho-Ying Wu Disp Lab 66 / 70 Cho-Ying Wu Disp Lab

Wei Hu, Gene Cheung, Antonio Ortega, Oscar Au, "Multiresolution Graph Fourier Transform for Compression of Piecewise Smooth Images," IEEE Transactions on Image Processing, vol.24, no.1, pp.419-433, January 2015.

Gene Cheung

1

Cho-Ying Wu Disp Lab 67 / 70 Cho-Ying Wu Disp Lab

Skipped part 1. PWS image coding : Generalized GFT with intra-coding of H.264 2. Lifting implementation : lowering complexity from O(N2) to O(Nlog(N)) 3. Image denoising with sparsity and smoothness prior

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 68 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 69 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 70 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 71 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 72 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 73 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 74 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 75 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 76 / 70 Cho-Ying Wu Disp Lab

Ln:Normalized Laplacian See p.56

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 77 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 78 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 79 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 80 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 81 / 70 Cho-Ying Wu Disp Lab

Xianming Liu : Soft decoding of JPEG images

1

Cho-Ying Wu Disp Lab 82 / 70 Cho-Ying Wu Disp Lab

top related