A Hybrid Color and Frequency Features Method

for Face Recognition

程式開發：賴博文報告者：邱威智 ISMP 郭淑美老師實驗室

成員：賴博文鄭鈺勳邱威智

2

Outline

• Introduction

• Algorithms and procedures

• Result

• Conclusion

3

Introduction

Face Recognition Grand Challenge (FRGC)

• New face recognition techniques Face Recognition Vendor Test (FRVT) 2002 results ? FRGC

P. Jonathon Phillips, et al. 2005

4

Introduction

Face Recognition Grand Challenge (FRGC)

• 6 experiments: – still images :

• controlled lighting and background

• uncontrolled lighting and background

– 3D imagery– multi-still imagery– between 3D and still images

P. Jonathon Phillips, et al. 2005

5

Introduction

P. Jonathon Phillips, et al. 2005

controlled still images

uncontrolled still images3D scans

6

Introduction

• FRGC uncontrolled illumination conditions

• Eigenfaces and Fisherfaces method X

7

Introduction

• RIQ : R of the RGB + IQ of the YIQ

• YIQ NTSC color TV system

• Y: luminance

Hybrid Color and Frequency Features (CFF) method

I

Q

8

Introduction

• R is more effective than the luminance……Peichung Shih and Chengjun Liu, 2005

9

Algorithms and procedures

10

Algorithms and procedures

Initial image

R, I, Q

Real part

Discrete Fourier transform of a face image

Imaginary part

Magnitude Mask

11

Algorithms and procedures

12

Algorithms and procedures

13

Algorithms and procedures

14

Algorithms and procedures

• EFM method:– PCA reduce dimensionality– FLD separated pattern classes

• PCA:X :a random vector representing a frequency pattern vector.

: are the eigenvectors largest eigenvalues of X

Y: reduced pattern vector

15

Algorithms and procedures

16

Algorithms and procedures

17

Algorithms and procedures

• FLD:

S(w) : within-class scatter matrixS(b) : between-class scatter matrix,

)( )(

)(

w

b

SStrJ

18

Algorithms and procedures

0.9 0.55 0.95

19

Result

20

Our Result

Training Test

11

21

Our Result method:

RIQ 　 　 　 　 R 　 　 　 　 I 　 　 　 　 Q 　 　 　 　

1 　 8 8 8 1 　 8 8 8 1 　 8 8 8 1 　 8 8 8 1

2 　 2 2 2 2 　 2 2 2 2 　 2 2 2 2 　 2 2 2 2

3 　 3 3 3 3 　 3 3 3 3 　 3 3 3 3 　 3 3 3 3

4 　 4 4 4 4 　 4 4 4 4 　 4 4 4 4 　 4 4 4 4

5 　 5 5 3 5 　 5 5 3 5 　 5 5 3 5 　 5 5 3 5

6 　 6 6 6 6 　 6 6 6 6 　 6 6 6 6 　 6 6 6 6

7 　 1 1 7 10 　 1 1 7 10 　 1 1 7 10 　 1 1 7 10

8 　 8 8 8 8 　 8 8 9 8 　 8 8 9 8 　 8 8 9 8

9 　 9 9 9 9 　 8 1 9 9 　 8 1 9 9 　 8 1 9 9

10 　 10 7 10 10 　 10 7 10 10 　 10 7 10 10 　 10 7 10 10

11 　 11 11 11 11 　 11 11 11 11 　 11 11 11 11 　 11 11 11 11

　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　 　

22

Our Result

• mRIQ: 84%

• mR,mI,mQ:79%

better

worst

23

Conclusion

• This correspondence presents a novel hybrid Color and Frequency Features (CFF) method for face recognition

• The hybrid color space improves face recognition performance

Thanks for your attention.