58

Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

  • Upload
    others

  • View
    15

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲
Page 2: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Machine Learning in

Bioinformatics

b00901028 謝伊妍

b00901146 朱柏憲

b00901155 吳京達

Group 2

Page 3: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Google: Calico

IBM: Watson

Page 4: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Outline • Machine Learning Basics

• Machine Learning and Bioinformatics

• Example 1

• Example 2

• Conclusion

Page 5: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

• Machine Learning Basics

• Machine Learning and Bioinformatics

• Example 1:

• Example 2:

• Conclusion

Outline

Page 6: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

0

100

200

300

400

500

0 500 1000 1500 2000 2500 3000

Page 7: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲
Page 8: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

0

100

200

300

400

500

0 1000 2000 3000

x: area

: Parameters

Page 9: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

0

100

200

300

400

500

0 1000 2000 3000

𝜃0 = 300 𝜃1 = 0

Page 10: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

0

100

200

300

400

500

0 1000 2000 3000

𝜃0 = 100 𝜃1 = 0.1

Page 11: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

0

100

200

300

400

500

0 1000 2000 3000

𝜃0 = 0 𝜃1 = 0.2

Page 12: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Cost Function:

Goal:

Page 13: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Cost Function

Page 14: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Gradient Descent

Page 15: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 16: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 17: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 18: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 19: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 20: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 21: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 22: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 23: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

(for fixed , this is a function of x) (function of the parameters )

Page 24: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Why don’t we use Normal Equation?

Ans: Computation Time

Page 25: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Some common Machine Learning Algorithms

• K-neighbor

• Gradient Descent

• Neural Network

• etc.

Page 26: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Suggesting Course on Coursera:

1. Machine Learning

2. Neural Networks for Machine Learning

Page 27: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

• Machine Learning Basics

• Machine Learning and Bioinformatics

• Example 1:

• Example 2:

• Conclusion

Outline

Page 28: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Figure from: Pedro Larranaga et al., “Machine learning in bioinformatics”

2005, BRIEFINGS IN BIOINFORMATICS Mag

Page 29: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

1.Gene finding

2.Tumor detecting

3.Emotion recognition

4.…

Page 30: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲
Page 31: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

• Machine Learning Basics

• Machine Learning and Bioinformatics

• Example 1:

• Example 2:

• Conclusion

Outline

Page 32: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Prediction of Individual Brain Maturity

Using fMRI

Page 33: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

What is fMRI?

Page 34: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

In This Research

• Algorithm: MVPA(multivariate pattern analysis) voxels based on GLM SVMs(support vector machines)

• Data: fcMRI data from 238 rs-fcMRI scans

Page 35: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

SVM

• For a set Rd , trying to find a hyper-plane classify data as two groups

Page 36: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

SVM

• H1 H2 : support hyper-planes

• Hyper-plane: WTX = - b (WTX + b = 0)

H1: wTx +b = +1

H2: wTx +b = −1

• H1 to plane: |1-b|/|w|

H2 to plane: |-1-b|/|w|

H1 to H2 : 2/|w|

Page 37: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

SVM

• (wTxi) +b≧1 if yi=1 (wTxi) +b≧-1 if yi=-1

→ yi ((wTxi)+b)≧1

• min 1/2(wTw)

Page 38: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲
Page 39: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

• cingulo-opercular 前扣帶迴

• fronto-parietal 額葉

• Sensorimotor 感覺神經

• Occipital 枕葉

• Cerebellum 小腦

Page 40: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Result and Future Work

• Prediction of Alzheimer ’ s disease

• Diagnosis & prognosis disordered brain function

Page 41: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Prediction of Individual Brain Maturity

Using fMRI

Page 42: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

What is fMRI?

Page 43: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

In This Research

• Algorithm: MVPA(multivariate pattern analysis) voxels based on GLM SVMs(support vector machines)

• Data: fcMRI data from 238 rs-fcMRI scans

Page 44: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

SVM

• For a set Rd , trying to find a hyper-plane classify data as two groups

Page 45: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

SVM

• H1 H2 : support hyper-planes

• Hyper-plane: WTX = - b

H1: wTx +b = +1

H2: wTx +b = −1

• H1 to plane: |1-b| /|w|

H2 to plane: |-1-b| /|w|

H1 to H2 : 2/|w|

Page 46: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

SVM

• (wTxi) +b≧1 if yi=1 (wTxi) +b≦-1 if yi=-1

→ yi ((wTxi)+b)≧1

• min:1/2 * (wTw)

Page 47: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲
Page 48: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

• cingulo-opercular 前扣帶迴

• fronto-parietal 額葉

• Sensorimotor 感覺神經

• Occipital 枕葉

• Cerebellum 小腦

Page 49: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Result and Future Work

• Prediction of Alzheimer ’ s disease

• Diagnosis & prognosis disordered brain function

Page 50: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

• Machine Learning Basics

• Machine Learning and Bioinformatics

• Example 1:

• Example 2:

• Conclusion

Outline

Page 51: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Emotion Recognition

Page 52: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Physiological Signals

• Communication channels

• Verbal and Non-verbal

• Heterogeneity

• Pattern recognition

• Feature extraction

Page 53: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Physiological Signals

• Electrocardiogram (ECG):heart rate

(R-R interval, heart rate variability)

• Electromyogram (EMG):correlation between cognitive emotion and physiological reactions

• Skin conductivity (SC):robust and well studied, affected by general mood and immediate emotional response.

• Respiration changes (RSP):breathing depth, rate of respiration

Page 54: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Emotional Model

Page 55: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Classification

Page 56: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Hilbert Huang Transform (HHT)

Page 57: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

Classification Results

Page 58: Machine Learning in Bioinformaticscc.ee.ntu.edu.tw/~ultrasound/belab/midterm_oral_files/2013_102_1/102-1... · Machine Learning in Bioinformatics b00901028 謝伊妍 b00901146 朱柏憲

• Machine Learning Basics

• Machine Learning and Bioinformatics

• Example 1:

• Example 2:

• Conclusion

Outline