Ahoo Engineering Group

:

: : 58

www.AhooEG.com

Ahoo Engineering Group

: 1. 2. . . . . . .

www.AhooEG.com

Ahoo Engineering Group

. . .

www.AhooEG.com

Ahoo Engineering Group

. . . .

.

. 11 01 01 . 3-01 ) 01- 01 ( . 1,0 . .4

www.AhooEG.com

Ahoo Engineering Group

. . - . . . . . . .

) ( : 1. 2. 3.

: 1. . 2. ) (. . 3. .

www.AhooEG.com

Ahoo Engineering Group . . 1 1- .

: 0491 Waren Mc Culloch Walter Pitts . : ( . ( . ( W . . ( . ( . 1 .3 2 1

Neuron Activation Function Threshold

www.AhooEG.com

Ahoo Engineering Group

01 _

. . . ) ( ... . 4 5 ) ...( .

Classification Road Following

www.AhooEG.com

Ahoo Engineering Group

:

= )O(x1,x2,,xn

> if w + wx + wx + + wnxn - otherwise :

www.AhooEG.com

Ahoo Engineering Group

> if w + wx + wx + + wnxn - otherwise : W

H .

hyperplane n . 1 1- .

+ + + . hyperplane . AND, OR, NAND, NOR XOR . .

-

www.AhooEG.com

Ahoo Engineering Group

1. 2. . . 3. : 2 4. . . 5. gradient descent . Backpropagation . 6. . E . . gradient descent . .

www.AhooEG.com

Ahoo Engineering Group

)E(W

w

w gradient descent1. . 2. . : .

.

www.AhooEG.com

Ahoo Engineering Group

Output nodes Internal nodes Input nodes

x

x . :

Back propagation1. nin nhidden nout . 2. . 3. ) ( : x : X E . www.AhooEG.com

Ahoo Engineering Group

Output nodes Internal nodes Input nodes Example X

1( k = Okh = Oh (1-Oh) k

1. : )Ok)(tk Ok 2. : Wkh k 3. : Wji = Wji + Wji : Wji = j Xji

BP : . . Overfitting .

: BP gradient descent . www.AhooEG.com

Ahoo Engineering Group : stochastic gradient descent

n . )1-Wji (n) = j Xji + Wji (n 1 =< 0