基於臉部辨識的電影中⼈人物分析Yu-Chen-Lin

Wang-Hsin-Shih

Outline

• Motivation

• Purpose

• Method

• Flow Chart

• Face Detection

• Face Recognition

• Experiment

Motivation

• 要找出特定演員在影⽚片中出現的時間往往曠⽇日費時，需要看完整部影⽚片。︒

• 想要知道特定角⾊色在影⾯面中出現的時間和比重。︒

• 想看特定演員之間的對⼿手戲。︒

Methods

• 臉部辨識，從已知的演員清單中，取得演員的照⽚片事先訓練好Model，再從input影⽚片中找出所有演員出現的地⽅方。︒

• 將記錄出的時間點視覺畫呈現。︒

• 藉由偵測出不同演員的組合，將影⽚片區分出不同的⽚片段。︒

Flow Chart

Input

Face Pre-process

Feature Extraction

Training data

Face Pre-

processFeature

Extraction

!Classifier Output

Tag

Train

Test

Yes

No

Face Detection

• 偵測每個frame中是否找得到⼈人臉，並找出位置。︒

• Robust Real-Time Face Detection (P Viola, MJ Jones - International journal of computer vision, 2004 - Springer)

• Active Shape Models-Their Training and Application (TF Cootes, CJ Taylor, DH Cooper, J Graham - 1995)

Face Recognition

• Eigenfaces “Application of the Karhunen-Loeve procedure for the characterization of human faces”

• Fisherfaces “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection”

• Local Binary Patterns Histograms “Performance evaluation of texture measures with classification based on Kullback discrimination of distributions”

Experiment

• Face Recognition in Movie Trailers via Mean Sequence Sparse Representation-based Classification (Enrique G. Ortiz, Alan Wright, and Mubarak Shah CVPR 2013)

• Movie Trailer Face Dataset

Output

0

2

4

6

8

Time

0 17.5 35 52.5 70

演員A 演員B 演員C演員D

Thank you

END