37
Presenter : r98942058 余余余 1 EE lab.530

Presenter : r98942058 余芝融 1 EE lab.530. Overview Introduction to image compression Wavelet…

Embed Size (px)

DESCRIPTION

Introduction to image compression  Why image compression?  Ex: 3504X2336 (full color) image : 3504X2336 x24/8 = 24,556,032 Byte = Mbyte  Objective Reduce the redundancy of the image data in order to be able to store or transmit data in an efficient form. 3 EE lab.530

Citation preview

Page 1: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Presenter : r98942058 余芝融

1EE lab.530

Page 2: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Overview

Introduction to image compression

Wavelet transform concepts Subband Coding Haar Wavelet Embedded Zerotree Coder References

2EE lab.530

Page 3: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Introduction to image compression Why image compression? Ex: 3504X2336 (full color) image : 3504X2336 x24/8 = 24,556,032

Byte = 23.418

Mbyte Objective Reduce the redundancy of the

image data in order to be able to store or transmit data in an efficient form.

3EE lab.530

Page 4: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Introduction to image compression For human eyes, the image will still

seems to be the same even when the Compression ratio is equal 10

Human eyes are less sensitive to those high frequency signals

Our eyes will average fine details within the small area and record only the overall intensity of the area, which is regarded as a lowpass filter.

EE lab.530 4

Page 5: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Quick Review Fourier Transform

Does not give access to the signal’s spectral variations

To circumvent the lack of locality in time → STFT

dtetfF tj

)()(

5EE lab.530

Page 6: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Quick Review The time-frequency plane for STFT is

uniform

Constant resolution at

all frequencies

6EE lab.530

Page 7: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Continuous Wavelet Transform FT &STFT use “wave” to analyze

signal WT use “wavelet of finite energy”

to analyze signal Signal to be analyzed is multiplied to

a wavelet function, the transform is computed for each segment.

The width changes with each spectral component

7EE lab.530

Page 8: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Continuous Wavelet Transform Wavelet: finite interval function with zero mean(suited to analysis transient signals)

Utilize the combination of wavelets(basis func.) to analyze arbitrary function

Mother wavelet Ψ(t):by scaling and translating the mother wavelet, we can obtain the rest of the function for the transformation(child wavelet, Ψa,b(t)))(1)(, a

bta

tba

8EE lab.530

Page 9: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Continuous Wavelet Transform Performing the inner product of the

child wavelet and f(t), we can attain the wavelet coefficient

We can reconstruct f(t) with the wavelet coefficient by

dttftfw bababa )()(, ,,,

2,, )(1)(

adadbtw

Ctf baba

9EE lab.530

Page 10: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Continuous Wavelet Transform

Adaptive signal analysis -At higher frequency , the window is narrow,

value of a must be small The time-frequency plane for WT(Heisenberg)

multi-resolution

diff. freq. analyze

with diff. resolution

10EE lab.530

Page 11: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

window a Low freq. large High freq. small

EE lab.530 11

Page 12: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Gaussian Window for S-Transform

EE lab.530 12

High Frequency

Low Frequency

Time Shifted

SKC-2009

Page 13: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Discrete Wavelet Transform Advantage over CWT: reduce the

computational complexity(separate into H & L freq.)

Inner product of f(t)and discrete parameters a & b

If a0=2,b0=1, the set of the wavelet

Znm, , 000 mm anbbaa

n)-t2(2)(

Znm, )n-t()(2/

,

002/

0,

mmnm

mmnm

t

baat

13EE lab.530

Page 14: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Discrete Wavelet Transform

The DWT coefficient

We can reconstruct f(t) with the wavelet coefficient by

dtnbtatfattfw mmnmnm ))(()()(),( 00

2/0,,

)()( ,, twtf nmm n

nm

14EE lab.530

Page 15: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Subband Coding

15EE lab.530

Page 16: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

16EE lab.530

WT compression

Page 17: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

2-point Haar Wavelet(oldest & simplest)

h[0] = 1/2, h[−1] = −1/2,h[n] = 0 otherwise

g[n] = 1/2 for n = −1, 0 g[n] = 0 otherwise

n

g[n]-3 -2 -1 0 1 2 3

½ ½

n

h[n]

-3 -2 -1 0 1 2 3

½

-½ then

1,

2 2 12L

x n x nx n

1,

2 2 12H

x n x nx n

(Average of 2-point)

(difference of 2-point) 17EE lab.530

Page 18: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Haar Transform

2-steps 1.Separate Horizontally 2. Separate Vertically

18EE lab.530

Page 19: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

2-Dimension(analysis)

EE lab.530 19

Diagonal

Horizontal

Edge

VerticalEdge

Approximation

Page 20: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Haar Transform

A B C D A+B

C+D A-B C-D

L H

(0,0)

(0,1)

(0,2)

(0,3)

(0,0)

(0,1)

(0,2)

(0,3)

(1,0)

(1,1)

(1,2)

(1,3)

(1,0)

(1,1)

(1,2)

(1,3)

(2,0)

(2,1)

(2,2)

(2,3)

(2,0)

(2,1)

(2,2)

(2,3)

(3,0)

(3,1)

(3,2)

(3,3)

(3,0)

(3,1)

(3,2)

(3,3)

Step 1:

20EE lab.530

Page 21: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Haar TransformStep 2:A C A+

BC+D

B D LL HL

L HA-B C-D

LH HH

(0,0)

(0,1)

(0,2)

(0,3)

(0,0)

(0,1)

(0,2)

(0,3)

(1,0)

(1,1)

(1,2)

(1,3)

(1,0)

(1,1)

(1,2)

(1,3)

(2,0)

(2,1)

(2,2)

(2,3)

(2,0)

(2,1)

(2,2)

(2,3)

(3,0)

(3,1)

(3,2)

(3,3)

(3,0)

(3,1)

(3,2)

(3,3)

L H LH HH

LL HL

21EE lab.530

Page 22: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

LL1 HL1 LL2 HL2 HL1LH2 HH2

LH1 HH1 LH1 HH1

LL3 HL3HL2

HL1LH3 HH3

LH2 HH2

LH1 HH1

First level

Second level

Third level

Most important part of the image

22EE lab.530

Page 23: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Example:

68 103 6 19 326 -38 6 1976 79 -4 -7 16 -32 2 -72 -3 4 1 2 -3 4 1

-10 5 -2 -9 -10 5 -2 -9

20 15 30 20 35 50 5 1017 16 31 22 33 53 1 915 18 17 25 33 42 -3 -821 22 19 18 43 37 -1 1

Original image O

1st horizontal separation

1st vertical separation

2nd level DWT result

23EE lab.530

Page 24: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

EE lab.530 24

OriginalImage

LH

HL

HH

LL

Page 25: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

EE lab.530 25

LL2 HL2

LH2 HH2

LH

HL

HH

LH

HL

HH

HL2

LH2 HH2

LL3 HL3

HH3LH3

Page 26: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Embedded Zerotree Wavelet Coder

EE lab.530 26

Page 27: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Structure of EZW

Root: a Descendants: a1, a2, a3

EE lab.530 27

Page 28: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

3-level Quantizer(Dominant)

EE lab.530 28

sp

sn

Page 29: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

EZW Scanning Order

EE lab.530 29

LL3 HL3HL2

HL1LH3 HH3

LH2HH2

LH1 HH1

scan order of the transmission band

Page 30: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

EZW Scanning Order

EE lab.530 30scan order of the transmission

coefficient

Page 31: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Scanning Order

EE lab.530 31

sp: significant positivesn: significant negativezr: zerotree rootis: isolated zero

Page 32: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Example: Get the maximum coefficient=26 Initial threshold :

1. 26>16 →sp 2. 6<16 & 13,10,6, 4 all less than 16→zr 3. -7<16 & 4,-4, 2,-2 all less than

16→zr 4. 7<16 & 4,-3, 2, 0 all less than

16→zrEE lab.530 32

16 226

2log0 T

Page 33: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Each symbol needs 2-bit: 8 bits The significant coefficient is 26, thus put it into the refinement label : Ls= {26}

To reconstruct the coefficient: 1.5T0=24

Difference:26-24=2 Threshold for the 2-level quantizer: The new reconstructed value: 24+4=28

EE lab.530 33

44/0 T

Page 34: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

2-level Quantizer(For Refinement)

EE lab.530 34

Page 35: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

New Threshold: T1=8

iz zr zr sp sp iz iz→ 14-bit

EE lab.530 35

Page 36: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

Important feature of EZW It’s possible to stop the compression

algorithm at any time and obtain an approximate of the original image

The compression is a series of decision, the same algorithm can be run at the decoder to reconstruct the coefficients, but according to the incoming but stream.

EE lab.530 36

Page 37: Presenter : r98942058 余芝融 1 EE lab.530. Overview  Introduction to image compression  Wavelet…

References[1] C.Gargour,M.Gabrea,V.Ramachandran,J.M.Lina, ”A short

introduction to wavelets and their applications,” Circuits and Systems Magazine, IEEE, Vol. 9, No. 2. (05 June 2009), pp. 57-68.

[2] R. C. Gonzales and R. E. Woods, Digital Image Processing. Reading, MA, Addison-Wesley, 1992.

[3] NancyA. Breaux and Chee-Hung Henry Chu,” Wavelet methods for compression, rendering, and descreening in digital halftoning,” SPIE proceedings series,  vol. 3078, pp. 656-667, 1997 .

[4] M. Barlaud et al., "Image Coding Using Wavelet Transform" IEEE Trans. on Image Processing 1, No. 2, 205-220 (April, 1992).

[5] J. M. Shapiro, “Embedded image coding using zerotrees of wavelet coefficients,” IEEE Trans. Acous., Speech, Signal Processing, vol. 41, no. 12, pp. 3445-3462, Dec. 1993.

EE lab.530 37