階層的領域分割法に基づく 木構造条件付確率場による一般物体認識

  • Upload
    nile

  • View
    163

  • Download
    5

Embed Size (px)

DESCRIPTION

階層的領域分割法に基づく 木構造条件付確率場による一般物体認識. 神戸大学大学院工学研究科 奥村 健志 [email protected] 神戸大学自然科学系先端融合研究環 滝口 哲也 , 有木 康雄 {takigu, ariki}@kobe-u.ac.jp. 研究背景と動機 (1/4). ロボット産業の発展 仮想現実感,拡張現実感の進歩. 社会的状況とその問題点 HDD の大容量化 携帯電話やデジタルカメラの普及. 大量のタグなし動画像が存在 → 人手による分類・検索が困難. 計算機による画像の「理解」 - PowerPoint PPT Presentation

Citation preview

  • [email protected]

    , {takigu, ariki}@kobe-u.ac.jp

    www.***.com

    (1/4)

    HDD

    *wallcomputerbookdeskchairhuman

    www.***.com

    CRF: Conditional Random Field (2/4)*

    www.***.com

    (3/4)

    *

    www.***.com

    (4/4)

    5finecoarse

    www.***.com

    (1/2)SegmentationbyWeighted AggregationSWAGentle Adaboost6

    www.***.com

    (2/2)TCRF: Tree Conditional Random Field7: : : :

    www.***.com

    (2/2)TCRF: Tree Conditional Random FieldBP: Belief Propagation7:

    www.***.com

    Segmentation by Weighted Aggregation SWA [Sharon, 2000]

    8[Sharon, 2000] Eitan Sharon, Achi Brandt, and Ronen Basri. Fast multiscale image segmentation. In CVPR, pp. 70-77, 2000

    www.***.com

    9: :

    www.***.com

    9Csnowrhinocatwatersky

    www.***.com

    9rhinocatwaterrhinocatwater

    www.***.com

    Corel dataset 7100: 180120

    CV

    (1/3)88.0%93.6%: rhino/hippo: polar bear: water: snow: vegetation: ground: sky10

    www.***.com

    (2/3)

    Logistic Regression (LR) : Conditional Random Field (CRF) : CRF

    2.2%11

    rhinobearwatersnowvegetationgroundskyAverageLR73.5%65.1%70.3%68.2%75.3%71.0%56.6%68.6%CRF71.8%71.0%82.6%70.6%78.9%74.7%41.7%70.2%TCRF75.7%72.7%78.9%73.8%79.4%76.5%49.6%72.4%

    BoF6150500

    www.***.com

    (3/3)LRCRFTCRF: sky12

    www.***.com

    2.2%

    sky water

    23

    : etc.

    3

    13

    www.***.com

    www.***.com

    33structure form motion3 13Automatic Photo Popup3

    www.***.com

    3

    HOGSVM

    www.***.com

    31

    www.***.com

    www.***.com

    [He, 2004] Xuming He, Richard S. Zemel, and Miguel A. Carreira-Perpinan. Multiscale conditional random fields for image labeling. In CVPR, pp. 695-702, 2004[Kumar, 2005] Sanjiv Kumar and Martial Hebert. A hierarchical field framework for unified context-based calassification. In ICCV, pp. 1284-1291, 2005[Awasthi, 2007] Pranjal Awasthi, Aakanksha Gagrani, and Balaraman Ravindran. Image modeling using tree structured conditional random fields. In IJCAI, pp. 2060-2065, 2007

    [He, 2004]31[Kumar, 2005]21[Awasthi, 2007]1(

    www.***.com

    Segmentation by Weighted Aggregation SWA [Sharon, 2000]

    Recursive Coarsening

    Weighted Aggregation[Sharon, 2000] Eitan Sharon, Achi Brandt, and Ronen Basri. Fast multiscale image segmentation. In CVPR, pp. 70-77, 2000aggregate kaggregate l

    www.***.com

    RGB, HSV, YCrCb, Lab

    Gabor Filter, LoG Filter

    Bag of Features [Csurka, 2004]Gentle Ababoost

    www.***.com

    P y*

    Belief Propagation

    www.***.com

    P

    TODO

    Segmentation by Weighted Aggregation20

    www.***.com

    u

    Segmentation by Weighted Aggregation21

    www.***.com

    Bag of Features: SIFT(128)k-means(W)WVisual Word()Codebook(Visual Word)22128SIFTBag of FeaturesVisual Word

    www.***.com

    MAP: Maximum a Posteriori

    L-BFGS

    23

    www.***.com

    BP: Belief Propagation

    TODO

    24

    *CRFCRF*super-pixelsuper-pixle.************W.**