removing depth map coding distortion by using post filter set

Min filtered Max filtered Input signal Kernel Nearest value output Comparing difference max min 3. output 1. Input 2. max/min #Limitation: Only one edge in a Kernel window Removing Depth Map Coding Distortion by Using Post Filter Set Norishige Fukushima*, Tomohiko Inoue, Yutaka Ishibashi Graduate School of Engineering, Nagoya Institute of Technology Introduction and Overview Experimental Results Proposed Method Various codec, JPEG, JPEG2000, JPEG-LS, H.264/AVC, can encode depth map and these codecs have coding distortion. Objective of this paper is removing distortions by using post filter set. Problem and Overview Background Median Filter R-D curve of various image codecs 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 0 0 1 1 0 0 0 Box Filter Binary Weighted Range Filter (BWRF) Box Filter BWRF Input Profile curve position Min-max Blur Remove Filter Binary Weighted Range Filter 3D scene 2cm 8cm Source view Virtual views RAW Image RAW depth map RAW Image Coded/filtered depth map compare compare Experimental Setup Depth map and image captured from Kinect. Depth maps are coded by various codecs. #Image is not compressed. [1]K. Lai, L .Bo, X. Ren, and D. Fox, “A large-scale hierarchical multi-view rgb-d object dataset.,” in Proc. ICRA, pp. 1817–1824, May 2011. [2] K.-J. Oh, A. Vetro, and Y.-S. Ho, “Depth coding using a boundary reconstruction filter for 3-d video systems,” IEEE Trans. CSVT, vol. 21, no. 3, pp. 350 –359, Mar. 2011. Trans mission Encode Decode Post filtering View synthesis Depth M ap Image Median Filter Min-Max BlurRemove Filter Weighted Range Filter Overquantization isrecovered Boundaryblur isrem oved Spike noise isrem oved Gaussian Filter Gaussian noise isrem oved Project site/Source code: http://nma.web.nitech.ac.jp/fukushima/research/depthmap_postfilter.html Reference Computational Time 15 ms Intel Core i7 2.93GHz (4core Parallelization: SSE4, Intel Language:C++ IEEE International Conference on Multimedia & Expo (ICME), July 2013

Upload: norishige-fukushima

Post on 25-Jun-2015

2.141 views

Category:

Technology

2 download

Report

Download

Tags:

Embed Size (px):

DESCRIPTION

Project page: http://nma.web.nitech.ac.jp/fukushima/research/depthmap_postfilter.html Poster file of ICME2013. N. Fukushima, T. Inoue, and Y. Ishibashi, "Removing depth map coding distortion by using post filter set," in Proc. IEEE International Conference on Multimedia and Expo (ICME), July 2013.

TRANSCRIPT

Page 1: Removing depth map coding distortion by using post filter set

Min filtered

Max filtered

Input signalKernel

Nearest value outputComparingdifference max

min

3. output

1. Input

2. max/min

#Limitation: Only one edge in a Kernel window

Removing Depth Map Coding Distortion by Using Post Filter Set

Norishige Fukushima*, Tomohiko Inoue, Yutaka IshibashiGraduate School of Engineering, Nagoya Institute of Technology

Introduction and Overview Experimental Results

Proposed Method

Various codec, JPEG, JPEG2000, JPEG-LS, H.264/AVC, can encode depth map and these codecs have coding distortion. Objective of this paper is removing distortions by using post filter set.

Problem and OverviewBackground

Median Filter

R-D curve of various image codecs

1 1 1 1 1

1 1 1 1 0

1 1 1 0 0

1 1 0 0 0

Box Filter

Binary Weighted Range Filter (BWRF)

Box Filter

BWRFInput

Profile curve position

Min-max Blur Remove Filter

Binary Weighted Range Filter

3D scene

2cm 8cm

Source view

Virtual views

RAW ImageRAW depth map

RAW ImageCoded/filtered depth map

comparecompare

Experimental Setup

Depth map and image captured from Kinect. Depth maps are coded by various codecs.#Image is not compressed.

[1]K. Lai, L .Bo, X. Ren, and D. Fox, “A large-scale hierarchical multi-view rgb-d object dataset.,” in Proc. ICRA, pp. 1817–1824, May 2011.[2] K.-J. Oh, A. Vetro, and Y.-S. Ho, “Depth coding using a boundary reconstruction filter for 3-d video systems,” IEEE Trans. CSVT, vol. 21, no. 3, pp. 350 –359, Mar. 2011.

TransmissionEncode Decode Post

filteringView

synthesisDepth Map

Image

MedianFilter

Min-MaxBlur Remove

Filter

Weighted Range Filter

Over quantizationis recovered

Boundary bluris removed

Spike noiseis removed

GaussianFilter