Min filtered
Max filtered
Input signalKernel
Nearest value outputComparingdifference max
min
3. output
1. Input
2. max/min
#Limitation: Only one edge in a Kernel window
Removing Depth Map Coding Distortion by Using Post Filter Set
Norishige Fukushima*, Tomohiko Inoue, Yutaka IshibashiGraduate School of Engineering, Nagoya Institute of Technology
Introduction and Overview Experimental Results
Proposed Method
Various codec, JPEG, JPEG2000, JPEG-LS, H.264/AVC, can encode depth map and these codecs have coding distortion. Objective of this paper is removing distortions by using post filter set.
Problem and OverviewBackground
Median Filter
R-D curve of various image codecs
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 1
1 1 1 1 0
1 1 1 0 0
1 1 0 0 0
Box Filter
Binary Weighted Range Filter (BWRF)
Box Filter
BWRFInput
Profile curve position
Min-max Blur Remove Filter
Binary Weighted Range Filter
3D scene
2cm 8cm
Source view
Virtual views
RAW ImageRAW depth map
RAW ImageCoded/filtered depth map
comparecompare
Experimental Setup
Depth map and image captured from Kinect. Depth maps are coded by various codecs.#Image is not compressed.
[1]K. Lai, L .Bo, X. Ren, and D. Fox, “A large-scale hierarchical multi-view rgb-d object dataset.,” in Proc. ICRA, pp. 1817–1824, May 2011.[2] K.-J. Oh, A. Vetro, and Y.-S. Ho, “Depth coding using a boundary reconstruction filter for 3-d video systems,” IEEE Trans. CSVT, vol. 21, no. 3, pp. 350 –359, Mar. 2011.
TransmissionEncode Decode Post
filteringView
synthesisDepth Map
Image
MedianFilter
Min-MaxBlur Remove
Filter
Weighted Range Filter
Over quantizationis recovered
Boundary bluris removed
Spike noiseis removed
GaussianFilter
Gaussian noiseis removed
Project site/Source code: http://nma.web.nitech.ac.jp/fukushima/research/depthmap_postfilter.html
Reference
Computational Time 15 ms
Intel Core i7 2.93GHz (4core HT)Parallelization: SSE4, Intel TBBLanguage:C++
IEEE International Conference on Multimedia & Expo (ICME), July 2013
