wavelet based embedded coding for images
TRANSCRIPT
-
8/8/2019 Wavelet Based Embedded Coding for Images
1/59
12/29/2010
Wavelet Based Embedded Coding for Images(A novel extension of SPIHT and SPECK)
by
Abhishek Kr Singh
(07ET6001)
Under the guidance of
Prof. A. K. Ray (CET)
Dr. S. Mahapatra (ECE)
-
8/8/2019 Wavelet Based Embedded Coding for Images
2/59
12/29/2010
Agenda/Topics to Be Covered
Objective
Why wavelet based coding
Why SPIHT
SPIHT and arithmetic coding
Context model
SPIHT and resolution scalability
Conclusion
References
-
8/8/2019 Wavelet Based Embedded Coding for Images
3/59
12/29/2010
Objective of the project
Modifying SPIHT algorithm to improve the
PSNR performance and facilitate resolutionscalable decoding.
-
8/8/2019 Wavelet Based Embedded Coding for Images
4/59
12/29/2010
Wish List for the proposed scheme
Better PSNR performance
Rate scalability
Resolution scalability
Fast, simple encoding and decoding.
-
8/8/2019 Wavelet Based Embedded Coding for Images
5/59
12/29/2010
Motivation for the present work
Presence of blocking artifacts at low bit encoded JPEG images
Block splitting
DCT Quantization
Complex structure of JPEG2000 coding schemes
R D optimization step
Fractional Bit plane coding
-
8/8/2019 Wavelet Based Embedded Coding for Images
6/59
12/29/2010
JPEG coding Scheme
Block-splitting of image
DCT
Quantization
Entropy-coding
Blocking artifacts appears atmedium to low bit rate encoding
-
8/8/2019 Wavelet Based Embedded Coding for Images
7/59
12/29/2010
Blocking artifacts in DCT based coding
-
8/8/2019 Wavelet Based Embedded Coding for Images
8/59
12/29/2010
Transition towards Wavelet based coding schemes
Whole image is transformed withoutsplitting into artificial blocks of smallsize
Blocking artifacts are completelyremoved
Better compression results
Fast implementation by sub banddecomposition method
Excellent methods to code DWTcoefficients
-
8/8/2019 Wavelet Based Embedded Coding for Images
9/59
12/29/2010
Sub band decomposition of image
-
8/8/2019 Wavelet Based Embedded Coding for Images
10/59
12/29/2010
Sub band decomposition of image
-
8/8/2019 Wavelet Based Embedded Coding for Images
11/59
12/29/2010
Sub band decomposition of image
-
8/8/2019 Wavelet Based Embedded Coding for Images
12/59
12/29/2010
Sub band decomposition of image
-
8/8/2019 Wavelet Based Embedded Coding for Images
13/59
12/29/2010
Bit plane coding of DWT coefficients
More significant bits are coded first
Coding process is progressive in nature
Bit stream generated is embedded in nature
SNR scalable bit stream Fine bit rate scalability
But the compression ratio can be
improved further if..?
-
8/8/2019 Wavelet Based Embedded Coding for Images
14/59
12/29/2010
significance and refinement information
-
8/8/2019 Wavelet Based Embedded Coding for Images
15/59
12/29/2010
significance and refinement information
Still enough redundancy in the significanceinformation
Redundancy in significance information can be
exploited within subband and across subband No redundancy in refinement information
Separately coding significance and refinementinformation
-
8/8/2019 Wavelet Based Embedded Coding for Images
16/59
12/29/2010
Exploiting redundancy in thesignificance information
Tree based approach (across the band) EZW (Zero tree)
SPIHT (Spatial orientation tree)
-- performs well for natural images
Block Based approach (within a subband)
SPECK
EBCOT
--performs well even for images with high details
-
8/8/2019 Wavelet Based Embedded Coding for Images
17/59
12/29/2010
Tree based approach (hypothesis)
-
8/8/2019 Wavelet Based Embedded Coding for Images
18/59
-
8/8/2019 Wavelet Based Embedded Coding for Images
19/59
12/29/2010
Tree based approach (hypothesis)
-
8/8/2019 Wavelet Based Embedded Coding for Images
20/59
12/29/2010
Tree based approach (hypothesis)
-
8/8/2019 Wavelet Based Embedded Coding for Images
21/59
12/29/2010
All the schemes code a bit plane in two passes
Significance and subordinate pass (in EZW)
Sorting and Refinement pass (in SPIHT)
Redundancy in the insignificance information acrossthe subband is exploited
Use of different data structure to group the
insignificant information Zero tree (in EZW)
LIS (in SPIHT)
Tree based approach(similarities and differences )
-
8/8/2019 Wavelet Based Embedded Coding for Images
22/59
12/29/2010
Why SPIHT .. ?
Uses a data structure (LIS) which is more powerfulthan Zero tree in grouping the insignificanceinformation
LIS works at many places where Zero tree conceptfails to group the insignificance information.
The coder is simple and fast
--- thus we explore SPIHT
-
8/8/2019 Wavelet Based Embedded Coding for Images
23/59
12/29/2010
Exploring SPIHT
Effect of decomposition level on PSNR
PSNR performance of SPIHT at differentbit rate
Plots
Picture decoded at different bit rate SPIHT and Arithmetic coder
PSNR gain at different bit rate (plot)
-
8/8/2019 Wavelet Based Embedded Coding for Images
24/59
12/29/2010
Number of decomposition level in SPIHT
-
8/8/2019 Wavelet Based Embedded Coding for Images
25/59
12/29/2010
Number of decomposition level and PSNR
-
8/8/2019 Wavelet Based Embedded Coding for Images
26/59
12/29/2010
PSNR at different bit rate in SPIHT
-
8/8/2019 Wavelet Based Embedded Coding for Images
27/59
12/29/2010
Lena image decoded at 0.1 bpp PSNR: 26.72dB
-
8/8/2019 Wavelet Based Embedded Coding for Images
28/59
12/29/2010
Lena image decoded at 0.25 bpp PSNR: 32.14dB
-
8/8/2019 Wavelet Based Embedded Coding for Images
29/59
12/29/2010
Lena image decoded at 0. 5 bpp PSNR: 35.95dB
-
8/8/2019 Wavelet Based Embedded Coding for Images
30/59
12/29/2010
Lena image decoded at 1 bpp PSNR: 39.84dB
-
8/8/2019 Wavelet Based Embedded Coding for Images
31/59
12/29/2010
Lena image decoded at 2 bpp PSNR: 44.90 dB
-
8/8/2019 Wavelet Based Embedded Coding for Images
32/59
12/29/2010
Original Lena image
-
8/8/2019 Wavelet Based Embedded Coding for Images
33/59
12/29/2010
SPIHT with Arithmetic Coding
-
8/8/2019 Wavelet Based Embedded Coding for Images
34/59
-
8/8/2019 Wavelet Based Embedded Coding for Images
35/59
12/29/2010
Finding alternative for arithmetic coder
Where does the redundancy lies..?
Recall the separate coding of significance andrefinement information
All the redundancy in significance information No redundancy in refinement bits
thus we should investigate the bitscorresponding to the coded significance
information.
-
8/8/2019 Wavelet Based Embedded Coding for Images
36/59
12/29/2010
Significance information generation in SPIHT
LIP processing
LIS processing
remaining redundancy is generated while LIS
processing. Why?
correlation in the significance information of the
offspring.
different context shows some trend
-
8/8/2019 Wavelet Based Embedded Coding for Images
37/59
12/29/2010
Probability distribution of different contexts
-
8/8/2019 Wavelet Based Embedded Coding for Images
38/59
12/29/2010
Test image of Pami
-
8/8/2019 Wavelet Based Embedded Coding for Images
39/59
12/29/2010
Probability distribution of different contexts
-
8/8/2019 Wavelet Based Embedded Coding for Images
40/59
12/29/2010
Test image of Pami
-
8/8/2019 Wavelet Based Embedded Coding for Images
41/59
12/29/2010
Probability distribution of different contexts
-
8/8/2019 Wavelet Based Embedded Coding for Images
42/59
12/29/2010
Huffman code for different contexts
Probability distribution is almost same
Average of these probability distributions isused to find the Huffman code for each context
These codes are used to represent the contextsin the output bit stream
the PSNR gain obtained using these
Huffman codes is about 0.2-0.3 dB
No loss in the speed of the encoder
PSNR performance of Fixed context model with SPIHT
-
8/8/2019 Wavelet Based Embedded Coding for Images
43/59
12/29/2010
PSNR performance of Fixed context model with SPIHT
PSNR performance: Context model vs Arithmetic coder
-
8/8/2019 Wavelet Based Embedded Coding for Images
44/59
12/29/2010
PSNR performance: Context model vs Arithmetic coder
-
8/8/2019 Wavelet Based Embedded Coding for Images
45/59
-
8/8/2019 Wavelet Based Embedded Coding for Images
46/59
12/29/2010
Resolution scalability and SPIHT
-
8/8/2019 Wavelet Based Embedded Coding for Images
47/59
12/29/2010
In each bit plane
Significance pass for resolution level 1
Refinement pass for resolution level 1
Significance pass for resolution level 2
Refinement pass for resolution level 2
Resolution scalability and SPIHT
-
8/8/2019 Wavelet Based Embedded Coding for Images
48/59
12/29/2010
Resolution scalability and SPIHT
-
8/8/2019 Wavelet Based Embedded Coding for Images
49/59
12/29/2010
Decoded image at resolution [128,128] bit rate:0.1
-
8/8/2019 Wavelet Based Embedded Coding for Images
50/59
-
8/8/2019 Wavelet Based Embedded Coding for Images
51/59
12/29/2010
Decoded image at resolution [128,128] bit rate:0. 5
-
8/8/2019 Wavelet Based Embedded Coding for Images
52/59
12/29/2010
Decoded image at resolution [128,128] bit rate: 1
-
8/8/2019 Wavelet Based Embedded Coding for Images
53/59
12/29/2010
Decoded image at resolution [256,256] bit rate: 0.1
-
8/8/2019 Wavelet Based Embedded Coding for Images
54/59
12/29/2010
Decoded image at resolution [256,256] bit rate: 0.25
-
8/8/2019 Wavelet Based Embedded Coding for Images
55/59
12/29/2010
Decoded image at resolution [256,256] bit rate: 0.5
-
8/8/2019 Wavelet Based Embedded Coding for Images
56/59
12/29/2010
Decoded image at resolution [256,256] bit rate: 1
-
8/8/2019 Wavelet Based Embedded Coding for Images
57/59
R f
-
8/8/2019 Wavelet Based Embedded Coding for Images
58/59
12/29/2010
References
A. Islam and W. A. Pearlman, An Embedded and Efficient Low- Complexity
Hierarchical Image Coder, Visual Communication and Image processing '99,Proceeding of SPIE Vol. 3653, pp. 294-305, Jan. 1999.
Khalid Sayood. Introduction to Data Compression,3/e.Morgan KaufmannPublishers,2006.
J. M. Shapiro, "Embedded image coding using zero trees of wavelet coefficients," IEEETrans. on Signal Processing, vol. 41, 1993, pp. 3445-3462.
A. Said and W.A. Pearlman, "A New Fast and Efficient Image Codec Based on SetPartitioning in Hierarchical Trees, "IEEE Trans. on Circuits and Systems for Video
Technology, vol. 6., pp. 243--250, June 1996.
D. Taubman, High performance scalable image compression with EBCOT, IEEETrans. Image Proc., vol. 9, pp. 11581170, July 2000.
D.S.Taubman and M. W. Marcellin. JPEG2000: Image Compression Fundamentals,Standards, and Practice. Boston: Kluwer,2002
C. Chrysafis, A. Said, A. Drukarev, A. Islam, and W. A. Pearlman, "SBHP- A LowComplexity Wavelet Coder," IEEE Int. Conf. on Acoustics, Speech and Signal
Processing (ICASSP 2000), Istanbul, Turkey, June 5-9, 2000.
-
8/8/2019 Wavelet Based Embedded Coding for Images
59/59
Thank You