Tran Thi Thu Hoai_ k54c

Embed Size (px)

Citation preview

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    1/27

    MC LCI: MNG NRON ..................................................................................................................3

    I.1 Gii Thiu Mng Nron ..............................................................................................3I.1.1 Lch s pht trin ..................................................................................................3

    I.1.2 Cn nguyn sinh hc ............................................................................................4I.1.3 n v x l ..........................................................................................................6I.1.4 Hm x l ............................................................................................................7I.1.5 ng dng ...........................................................................................................12

    I.2 Mng Norn Mt Lp ..............................................................................................12I.3 Mng Noron Nhiu Lp (Multi-layer Neural Network) .........................................13

    II: MNG NRON M: ......................................................................................................13III: GII THUT DI TRUYN ............................................................................................16

    1: Cc ton t ca gii tht di truyn .................................................................................171.1 Chn lc ....................................................................................................17

    1.2 Lai ghp ..................................................................................................................18

    1.3 t bin ..........................................................................................................201.4 Hm thch nghi ...............................................................................................212: Xt trong mi quan h gia mng nron v gii thut di truyn .................................22

    2.1 Cross-over (Lai ghp) ..............................................................................................232.2 Mutation (t bin) ................................................................................................242.3 Fitness function (Hm thch nghi) ...........................................................................242.4 Selection (chn lc) ................................................................................................26

    3: Chin lc iu chnh m t ng ................................................................................26IV: KT LUN ......................................................................................................................27

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    2/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    BO CO NGHIN CU KHOA HC

    Tn ti: TI U HO CU TRC CA MNG NRON M BNGGII THUT DI TRUYN

    M U

    L do chn ti: Gn y suy din m c ng dng trong rt nhiu cc

    vn khc nhau nh: iu khin my mc hay trong cc h thng sn xut.

    Mt trong nhng suy din m l mng nron m. C l mng noron

    khng ch hp dn i vi nhng ngi yu thch cng ngh thng tin bi

    kh nng do con ngi hun luyn, m cn bi nhng ng dng thc tintrong cuc sng ca n. Chng ta hon ton c th nhn dng du vt vn

    tay ca ti phm trong hnh s, c th d on th trng chng khon, d

    on thi tit, d ton chi ph cho mt d n ng cao tc, khi phc

    nhng tm nh, hay mt chic xe ln dnh cho ngi khuyt tt c th nhn

    c mnh lnh iu khin bng c ch, hnh ng, thm ch l suy ngh ca

    ngi ngi trn xe v.v nh c mng noron nhn to. Mng nron ban u

    c cu trc th, vn quan trng l chng ta phi lm sao cho cu trc th

    tr thnh cu trc tng i thch hp. Do vn ti u ho cu trc

    ca mng nron l rt cn thit. Mt trong nhng gii thut dng ti u

    ho cu trc ca mng nron l gii thut di truyn v gii thut di truyn

    c xem l thch hp nht.

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 2

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    3/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    I: MNG NRON

    I.1 Gii Thiu Mng Nron

    I.1.1 Lch s pht trin

    S pht trin ca mng nron tri qua c qu trnh a ra cc khi nimmi ln thc thi cc khi nim ny. Di y l cc mc ng ch trong

    lch s pht trin ca mng nron.

    * Cui th k 19, u th k 20, s pht trin ch yu ch l cc cng

    vic c s tham gia ca c ba ngnh Vt l hc, Tm l hc v Thn kinh

    hc, bi cc nh khoa hc nh Hermann von Hemholtz, Ernst Mach, Ivan

    Pavlov. Cc cng trnh nghin cu ca h ch yu i su vo cc l thuyt

    tng qut v HC (learning), NHN (vision) v LP LUN (conditioning),v khng h a ra nhng m hnh ton hc c th m t hot ng ca

    cc nron.

    * Mi chuyn thc s bt u vo nhng nm 1940 vi cng trnh ca

    Warren McCulloch v Walter Pitts. H ch ra rng v nguyn tc, mng ca

    cc nron nhn to c th tnh ton bt k mt hm s hc hay logic no.

    * Tip theo l Donald Hebb, ng pht biu rng vic thuyt lp

    lun c in (classical conditioning) (nh Pavlov a ra) l hin thc bi do

    cc thuc tnh ca tng nron ring bit. ng cng nu ra mt phng php

    hc ca cc nron nhn to.

    * ng dng thc nghim u tin ca cc nron nhn to c c vo

    cui nhng nm 50 cng vi pht minh ca mng nhn thc (perceptron

    network) v lut hc tng ng bi Frank Rosenblatt. Mng ny c kh

    nng nhn dng cc mu. iu ny m ra rt nhiu hy vng cho vic nghin

    cu mng nron. Tuy nhin n c hn ch l ch c th gii quyt mt s lp

    hu hn cc bi ton.* Cng thi gian , Bernard Widrow v Ted Hoff a ra mt thut

    ton hc mi v s dng n hun luyn cho cc mng nron tuyn tnh

    thch nghi, mng c cu trc v chc nng tng t nh mng ca

    Rosenblatt. Lut hc Widrow-Hoff vn cn c s dng cho n nay.

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 3

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    4/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    * Tuy nhin c Rosenblatt v Widrow-Hoff u cng vp phi mt vn

    do Marvin Minsky v Seymour Papert pht hin ra, l cc mng nhn

    thc ch c kh nng gii quyt cc bi ton kh phn tuyn tnh. H c gng

    ci tin lut hc v mng c th vt qua c hn ch ny nhng h

    khng thnh cng trong vic ci tin lut hc c th hun luyn c cc

    mng c cu trc phc tp hn.

    * Do nhng kt qu ca Minsky-Papert nn vic nghin cu v mng

    nron gn nh b nh li trong sut mt thp k do nguyn nhn l khng

    c c cc my tnh mnh c th thc nghim.

    * Mc d vy, cng c vi pht kin quan trng vo nhng nm 70. Nm

    1972 Teuvo Kohonen v James Anderson c lp nhau pht trin mt loi

    mng mi c th hot ng nh mt b nh. Stephen Grossberg cng rttch cc trong vic kho st cc mng t t chc (Self organizing network).

    * Vo nhng nm 80, vic nghin cu mng nron pht trin rt mnh

    m cng vi s ra i ca PC. C hai khi nim mi lin quan ti s hi

    sinh ny, l:

    + Vic s dng cc phng php thng k gii thch hot

    ng ca mt lp cc mng hi quy (recurrent network) c th

    c dng nh b nh lin hp (associative memory) trongcng trnh ca nh vt l hc Johh Hopfield.

    + S ra i ca thut ton lan truyn ngc (back-

    propagation) luyn cc mng nhiu lp c mt vi nh

    nghin cu c lp tm ra nh: David Rumelhart, James

    McCelland, cng l cu tr li cho Minsky-Papert.

    I.1.2 Cn nguyn sinh hcB no con ngi cha khong 1011 cc phn t lin kt cht ch vi

    nhau (khong 104 lin kt i vi mi phn t) gi l cc nron. Di con

    mt ca nhng ngi lm tin hc, mt nron c cu to bi cc thnh

    phn: t bo hnh cy (dendrite), t bo thn (cell body) v si trc thn kinh

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 4

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    5/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    (axon). T bo hnh cy c nhim v mang cc tn hiu in ti t bo thn,

    t bo thn s thc hin gp (sum) v phn ngng (threshold) cc tn hiu

    n. Si trc thn kinh lm nhim v a tn hiu t t bo thn ra ngoi.

    im tip xc gia mt si trc thn kinh ca nron ny v t bo hnh cy

    ca mt nron khc c gi l khp thn kinh (synapse). s sp xp ca

    cc nron v mc mnh yu ca cc khp thn kinh c quyt nh bi

    cc qu trnh ho hc phc tp, s thit lp chc nng ca mng nron.

    Mt vi nron c sn t khi sinh ra, cc phn khc c pht trin thng qua

    vic hc, c s thit lp cc lin kt mi v loi b cc lin kt c.

    Cu trc ca mng nron lun lun pht trin v thay i. Cc thay i sau

    ny c khuynh hng bao gm ch yu l vic lm tng hay gim mnh

    ca cc mi lin kt thng qua cc khp thn kinh.

    Mng nron nhn to khng tip cn n s phc tp ca b no. Mc d

    vy c hai s tng quan c bn gia mng nron nhn to v sinh hc. Th

    nht, cu trc khi to thnh chng u l cc thit b tnh ton n gin(mng nron nhn to n gin hn nhiu) c lin kt cht ch vi nhau.

    Th hai, cc lin kt gia cc nron quyt nh chc nng ca mng.

    Cn ch rng mc d mng nron sinh hc hot ng rt chm so vi cc

    linh kin in t (10-3 so vi 10-9 giy) nhng b no c kh nng thc hin

    nhiu cng vic nhanh hn nhiu so vi cc my tnh thng thng. mt

    phn l do cu trc song song ca mng nron sinh hc: ton b cc nron

    hot ng mt cch ng thi ti mt thi im. Mng nron nhn to cng

    chia s c im ny. Mc d hin nay, cc mng nron ch yu c thc

    nghim trn cc my tnh s, nhng cu trc song song ca chng khin

    chng ta c th thy cu trc ph hp nht l thc nghim chng trn cc vi

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 5

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    6/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    mch tch hp ln (VLSI: very large scale integrated circuit), cc thit b

    quang v cc b x l song song.

    Mng nron i khi c xem nh l cc m hnh lin kt (connectionist

    models), l cc m hnh phn b song song (parallel-distributed models) c

    cc c trng phn bit sau:

    * Tp cc n v x l;

    * Trng thi kch hot hay l u ra ca n v x l;

    * Lin kt gia cc n v. Xt tng qut, mi lin kt c

    nh ngha bi mt trng s wjk cho ta bit hiu ng m tn

    hiu ca n v j c trn n v k;* Mt lut lan truyn quyt nh cch tnh tn hiu ra ca

    tng n v u vo ca n;

    * Mt hm kch hot, hay hm chuyn (activation function,

    transfer function), xc nh mc kch hot khc da trn

    mc kch hot hin ti;

    * Mt n v iu chnh ( lch) (bias, offset) ca mi n

    v;* Phng php thu thp thng tin (lut hc- learning rule);

    * Mi trng h thng c th hot ng

    I.1.3 n v x lMt n v x l (Hnh 1) cng c gi l mt nron hay mt nt

    (node), thc hin mt cng vic rt n gin: n nhn tn hiu vo t cc

    n v pha trc hay mt ngun bn ngoi v s dng chng tnh tnhiu ra s c lan truyn sang cc n v khc

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 6

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    7/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    Trong :

    xi : cc u vo

    wji : cc trng s tng ng vi cc u vo

    j : lch (bias)aj : u vo mng (net-input)

    zj : u ra ca nron

    g(x) : hm chuyn (hm kch hot).

    Trong mt mng nron c ba kiu n v:

    * Cc n v u vo (input units), nhn tn hiu t bn ngoi;

    * C n v u ra (output units), gi d liu ra bn ngoi;

    * Cc n v n (hidden units), tn hiu vo (input) v ra(output) ca n nm trong mng.

    Mi n v j c th c mt hoc nhiu u vo: x 0, x1, x2,xn, nhng ch c

    mt u ra zj. Mt u vo ti mt n v c th l d liu t bn ngoi

    mng, hoc u ra ca mt n v khc, hoc l u ra ca chnh n.

    I.1.4 Hm x l

    Hm kt hp

    Mi mt n v trong mt mng kt hp cc gi tr a vo n thng

    qua cc lin kt vi cc n v khc, sinh ra mt gi tr gi l net-input.

    Hm thc hin nhim v ny gi l hm kt hp (combination

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 7

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    8/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    function), c nh ngha bi mt lut lan truyn c th. Trong phn

    ln cc mng nron, chng ta gi s rng mi mt n v cung cp mt

    b cng nh l u vo cho n v m n c lin kt. Tng u vo n

    v j n gin ch l tng trng s ca cc u ra ring l t cc n v

    kt ni cng thm ngng hay lch j

    aj = ji1

    wn

    i j

    i

    x =

    +

    Trng hp wji > 0, nron c coi l ang trong trng thi kch

    thch. Tng t, nu nh wji < 0, nron trng thi kim ch. Chng ta

    gi cc n v vi lut lan truyn nh trn l cc sigma units. Trong

    mt vi trng hp ngi ta cng c th s dng cc lut lan truyn

    phc tp hn. Mt trong s l lut sigma-pi, c dng nh sau:

    aj = ji1

    wn

    i

    i

    x=

    1

    m

    ik j

    k

    x =

    +

    Rt nhiu hm kt hp s dng mt lch hay ngng

    tnh net-input ti n v. i vi mt n v u ra tuyn tnh, thng

    thng j c chn l hng s v trong bi ton xp x a thc j =1

    Hm kch hot (hm chuyn)

    Phn ln cc n v trong mng nron chuyn net-input bng cch s

    dng mt hm v hng (scalar-to-scalar function) gi l hm kch

    hot, kt qu ca hm ny l mt gi tr gi l mc kch hot ca

    n v (units activation). Loi tr kh nng n v thuc lp ra, gi

    tr kch hot c a vo mt hay nhiu n v khc. Cc hm kch

    hot thng b p vo mt khong gi tr xc nh, do thng c

    gi l cc hm bp (squashing). Cc hm kch hot hay c s dng

    l:

    + Hm ng nht (Linear function, Identity function)

    g(x) = x

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 8

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    9/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    Nu coi cc u vo l mt n v th chng s s dng hm ny. i

    khi mt hng s c nhn vi net-input to ra mt hm ng nht

    + Hm bc nh phn (binary step function, hard limit function)

    Hm ny cng c bit n vi tn hm ngng. u ra ca hm

    ny c gii hn vo mt trong hai gi tr:

    1 nu (x 0)

    g(x) =

    0 nu (x 0)

    Dng hm ny c s dng trong cc mng ch c mt lp. Trong

    hnh v sau, c chn bng 1.

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 9

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    10/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    + Hm sigmoid (Sigmoid function (logsig))

    1

    ( )1 x

    g xe

    =+

    Hm ny c bit thun li khi s dng cho cc mng c hun luyn

    (trained) bi thut ton lan truyn ngc (back-propagation) bi v n

    d ly o hm, do c th gim ng k tnh ton trong qu trnh

    hun luyn. Hm ny c ng dng trong cc chng trnh ng dng

    m cc u ra mong mun ri vo khong [0,1].

    + Hm sigmoid lng cc (Bipolar sigmoid function (tansig))

    1

    ( )1

    x

    x

    eg x

    e

    =

    +

    Hm ny c cc thuc tnh tng t hm sigmoid. N lm vic tt i

    vi cc ng dng c u ra yu cu trong khong [-1,1].

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 10

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    11/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    Cc hm chuyn ca cc n v n (hidden units) l cn thit biu

    din s phi tuyn vo trong mng. L do l hp thnh ca cc hm

    ng nht l mt hm ng nht. Mc d vy nhng n mang tnh cht

    phi tuyn (ngha l kh nng biu din cc hm phi tuyn) lm cho cc

    mng nhiu tng c kh nng rt tt trong biu din cc nh x phi

    tuyn. Tuy nhin i vi lut hc lan truyn ngc, hm phi kh vi v

    s c ch nu nh hm c gn trong mt khong no . Do vy hm

    sigmoid l la chn thng dng nht.

    i vi cc n v u ra (output units), cc hm chuyn cn c chnsao cho ph hp vi s phn phi ca cc gi tr ch mong mun.

    Chng ta thy rng i vi cc gi tr ra trong khong [0,1], hm

    sigmoid l c ch; i vi cc gi tr ch mong mun l lin tc trong

    khong th hm ny cng vn c ch, n c th cho ta cc gi tr ra

    hay gi tr ch c cn trong mt khong ca hm kch hot u ra.

    Nhng nu cc gi tr ch khng c bit trc khong xc nh th

    hm hay c s dng nht l hm ng nht. Nu gi tr mong munl dng nhng khng bit cn trn th nn s dng mt hm kch hot

    dng m (exponential output activation function).

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 11

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    12/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    I.1.5 ng dngTrong qu trnh pht trin, mng nron c ng dng

    thnh cng trong rt nhiu lnh vc. Di y l mt s lnh vc ng

    dng chnh ca mng nron:

    Aerospace: Phi cng t ng, gi lp ng bay, cc h thng

    iu khin li my bay, b pht hin li.

    Automotive: Cc h thng dn ng t ng cho t, cc b

    phn tch hot ng ca xe.

    Banking: B c sc v cc ti liu, tnh tin ca th tn dng.

    Defense: nh v- pht hin v kh, d mc tiu, pht hin i

    tng, nhn dng nt mt, cc b cm bin th h mi, x l

    nh radar,

    Electronics: D on m tun t, s chip IC, iu khin tin

    trnh, phn tch nguyn nhn hng chip, nhn dng ting ni,

    m hnh phi tuyn.

    Entertaiment: Hot hnh, cc hiu ng c bit, d bo th

    trng.

    Financial: nh gi bt ng sn, cho vay, kim tra ti sn cm

    c, nh gi mc hp tc, phn tch ng tn dng, chngtrnh thng mi qua giy t, phn tch ti chnh lin doanh, d

    bo t l tin t.

    Insurance: nh gi vic p dng chnh sch, ti u ho sn

    phm.

    I.2 Mng Norn Mt Lp

    Mng Perceptron

    Mng Hopfield

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 12

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    13/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    Mng Kiu B Nh Hai Chiu Kt Hp Thch Nghi (Adaptive

    Bidirectional Associative)

    Mng Kohonen

    I.3 Mng Noron Nhiu Lp (Multi-layer Neural Network)Mng nron c t 2 lp tr ln c gi l mng nron nhiu lp. Mng

    nron nhiu lp bao gm mt lp vo, mt lp ra, mt hoc nhiu lp n

    Mng noron nhiu lp lan truyn ngc sai s(Back- propagation

    Neural Network)

    Mng noron nhiu lp ngc hng (Counter propagation Neural

    Network)

    II: MNG NRON M:Vic tch hp k thut mng nron v logic m cho php kt hp u

    im ca c hai. Mt mt, mng nron cung cp cu trc tnh ton da trnlin kt (dung th li v cc tnh cht biu din phn tn) v kh nng hc

    cho cc h logic m. Mt khc, cc h logic m s a vo mng nron c

    ch suy din da trn cc lut ifthen, chnh s kt hp phong ph ny

    cho php xy dng cc h thng tch hp: H m nron, mng nron m v

    cc h lai.

    Trong mng nron m c th l tn hiu vo, tn hiu ra hay trng s l

    nhng s m... Cng c trng hp mng nron m vi tt c cc yu t.

    *Mng nron nh mt cng c suy din

    Ni mng nron nh mt cng c suy din v: mng nron c kh nng

    suy din. Vi mi tn hiu vo th mng nron s cho mt u ra tng ng

    * Suy din m da trn mng nron:

    Biu din lut m:

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 13

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    14/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    Keller (1992) xut m hnh mng nron truyn thng nhiu lp

    biu din cc lut suy din c s:

    If X1 = A1 then Y = B

    Gi s vc t thuc ca Ai l {ai1,, aimi}, I = 1 n. C hai cch

    xc nh trng s:

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 14

    a11

    ' a1m1

    ' an1

    ' anmn

    '

    w11

    w1m1

    wn1

    wnm

    d1

    dn

    1-t

    u1

    uk

    b1

    ' bk

    '

    Lp vo

    Lp kimtra tngmnh

    Kt hp ccmnh

    Lp ra

    Mng noron biu din mt lut m

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    15/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    Cch 1: ijw = 1 - ija . Khi lp n u tin o s bt cp gia

    thng tin vo vi Ai.

    Ta xc nh di nh l di = max{(1- ija

    ) ij'a}

    Hoc di = max{min(1- ija ), ij'a }

    y Ai = {ai1,,aimi}l vc t vo tng ng vi mnh

    X= Ai

    Cch 2 : ij ijw a= . Khi , dj = max{| ija = ij 'a |}

    Cc h s ai xc nh trng s ca mnh X = Ai trong lut (ai

    c th c ngi thit k cung cp hoc c t d liu)Ta thy t = max {aidi}.

    Gi s B tng ng vi tp m c thuc {b1,, bk}. Khi

    trng s ui c xc nh bi ui = 1- bi.

    Cui cng vi b u vo (A1,, An) ta c kt qu:

    ( ), 1,B jy j p = (*)

    T (*) d dng thy t=0 (tc l b u vo (A1,, An) trng

    vi (A1, , An) th bi= bi) vi mi i ngha l Y=B.

    Ngc li, khi tng bt cp gia thng tin vo vi cc mnh

    bng 1 th bi = 1 i vi mi i, ngha l h a ra kt lun:

    Y = khng bit.

    Suy din m:

    M hnh suy din m da trn mng nron do Takagi v

    Hayaki ngh l mt bin th ca c ch suy din m ca

    Takagi-Sugeno-Kang bao gm cc bc nh sau:

    + La chn bin vo ra trong tp mu hc.

    + Chia tp mu hc thnh hai phn: phn hun luyn v

    phn kim tra.

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 15

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    16/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    + Xy dng mng NNmemb biu th hm ph thuc

    cho phn IF ca cc lut. Hun luyn mng NNmemb tng ng

    vi phn IF ca lut m.

    + n gin phn THEN ca cc lut theo phng php

    loi b ngc.

    + Xc nh kt qu ra v din gii m.

    III: GII THUT DI TRUYNGii thut di truyn (Genetic Algorithsm- GA) l k thut gip gii quyt

    bi ton bng cch m phng theo s tin ho ca con ngi hay ca sinh

    vt ni chung (Da trn thuyt tin ho con ngi ca Darwin) trong iukin mi trng sng lun thay i. Thut gii di truyn l mt hng tip

    cn tnh ton gn ng, ngha l mc tiu ca thut gii di truyn khng

    nhm a ra li gii chnh xc ti u m l a ra li gii tng i ti u.

    L thuyt ny do Johm Henry Holland (Gio s ca trng i hc

    Michigan- M) xng vo gia thp nin 70, th k XX.

    Thut gii di truyn v bn cht l thut ton tm kim da theo quy lut

    ca qu trnh tin ho t nhin. Gii thut kt hp s sng st ca cu trckho nht trong s cc cu trc biu din cc nhim sc th vi mt s trao

    i thng tin c la chn ngu nhin to thnh mt thut ton tm

    kim. Gii thut di truyn nm trong lnh vc tnh ton tin ho, s dng cc

    biu din nh phn v cc s m hnh ho s chn lc, lai ghp v t

    bin.

    Gii thut di truyn gii quyt c vn trn my tnh nh vo

    chng trnh tin hc thc hin nhng tng nu trn. Khng ging nh

    phng php gii tch da trn cc cng thc ton hc hay phng php suy

    lun da trn kinh nghim ca cc chuyn gia ch ti mt s c gii hn

    cc li gii. Gii thut di truyn xt n ton b cc li gii, bng cch xt

    trc nht mt s li gii, sau loi b mt s thnh phn khng thch hp

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 16

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    17/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    v chn nhng thnh phn thch nghi hn chn lc v bin ho nhm mc

    ch to ra nhiu li gii mi c h s thch nghi ngy cng cao

    1: Cc ton t ca gii tht di truyn Giithut di truyn s dng ba ton t sau y:

    Chn lc

    Lai ghp

    t bin

    1.1 Chn lcChn lc l qu trnh trong cc c th c sao chp trn c s thch nghi ca n. thch nghi l mt hm gn mt gi tr thc cho

    cc c th trong qun th. Qu trnh ny c m t nh sau:

    * Tnh thch nghi ca tng c th trong qun th hin hnh, lp

    bng cng dn cc gi tr thch nghi (theo s th t gn cho tng c

    th). Gi s qun th c n c th, gi thch nghi ca c th th I l Fi,

    tng dn th i l Fti, tng thch nghi ca ton qun th l Fm.

    * To mt s ngu nhin F trong on t 0 n Fm

    * Chn c th k u tin tho mn Ftk-1 F Ftk a vo qun th ca

    th h mi.

    V d: Gi s qun th ban u l 6 chui nhim sc th. Tng gi tr

    ca hm mc tiu l 50 nh bng sau:

    STT Chui nhim scth

    Hm mctiu

    % ca total total

    1 01110 8 16 82 11000 15 30 233 00100 2 4 254 10010 5 10 30

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 17

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    18/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    5 01100 12 24 426 00010 8 16 50

    Sau ta s to cc s ngu nhin trong khong (0, 50), vi mi s,

    vic chn lc mt nhim sc th u tin vi gi tr hm mc tiu lnhn hay bng s ngu nhin. By s ngu nhin c to cng cc

    chui c chn th hin nh bng sau:

    S ngu nhin 26 2 49 15 40 36 9Chui nhim sc

    th

    4 1 6 2 5 5 2

    V d trn chng t rng chui no c gi tr hm mc tiu cao s

    c nhiu con chu hn trong th h sau. Khi mt chui c chn

    cho qu trnh ti to th s c a vo lai ghp nhm to ra nhng

    chui mi.

    1.2 Lai ghpTon t chn lc nhm tm ra nhng c th tn ti tt nht nhng n

    khng to ra nhng c th mi. Tuy vy, trong t nhin, cc con s tha

    hng nhng c tnh tt t c cha ln m chng. Ton t tc ng trn

    cc c th cha m to ra nhng con lai tt c gi l lai ghp.

    Chng c p dng ln cp cha m c chn la vi xc sut lai

    ghp pcross. Xc sut ny cho ta s lng pcross* popsize (popsize kch

    thc ca qun th c lai to) nhim sc th c lai ghp.

    Vi mi nhim sc th trong qun th:

    Pht sinh mt s ngu nhin r trong min [0;1]

    Nu r < pcross, chn nhim sc th lai ghp

    Sau , ta kt hp cc nhim sc th c chn mt cch ngu nhin

    li. Mi cp nhim sc th, chng ta c th pht sinh mt s ngu

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 18

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    19/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    nhin pos t min [1;L] (L l tng s bt trong nhim sc th). S

    pos ny s cho ta v tr ca im lai ghp.

    V d ta c 2 nhim sc th:

    (a1 a2 aposapos+1aL) v

    (b1 b2 bposbpos+1bL)

    Sau khi c lai ghp, n s c thay th bi cp con chu

    (a1 a2 apos bpos+1bL) v

    (b1 b2 bpos apos+1aL)

    Nh vy ton t ny sau khi c thc hin s cho ra hai chui

    mi, mi chui u c tha hng nhng c tnh ly ra t cha vm ca chng. Chn lc c th v lai ghp cho php gii thut di truyn

    s dng nhng thng tin c tm kim trc tip trn nhng vng

    tt hn.

    Cc v d di y th hin cc hnh thc ca lai ghp:

    V d 1

    Trc khi lai ghp

    1001101

    0000110

    Sau khi lai ghp ti v tr gia s th t 4 v 5, chng ta s c:

    (A) 100| 1101 000| 1101 (B)

    (B) 000| 0110 100| 0110 (A)

    V d 2

    Trc khi lai ghp

    1001101

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 19

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    20/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    0000110

    Sau khi lai ghp ti v tr gia s th t 3 v 4, chng ta s c:

    (A) 1001| 101 0000| 101 (B)

    (B) 0000| 110 1001| 110 (A)

    1.3 t binL vic thay i tr s ca mt s trong dy s, th d 0 thnh 1

    hoc 1 thnh 0, cho trng hp dng dy s theo h nh phn. So vi lai

    ghp, ton t ny rt t xy ra. Theo kt qu nghin cu ca Kenneth De

    Jong th t l lai ghp trung bnh l 0.6 trong khi t l t bin l 0.001,phn cn li 0.399 l chn lc

    Lai ghp dng li nhng tin tc c sn trong cc thnh phn ca

    th h trc v truyn li cho th h sau, trong khi t bin to ra

    nhng tin tc hon ton mi.

    Cc ton t t bin nhm to ra nhng thng tin mi trong qun

    th em lai to ti cc v tr bt (gen) no (qun th m ta xem xt

    y c popsize c th, mi c th c biu th qua L bt/gen). t bin

    c p dng vi xc sut pmu. S lng bt t bin l pmu*L*popsize

    bt. Mi bt c c hi t bin l nh nhau. Ton t ny c th c x

    l nh sau:

    Vi mi nhim sc th trong qun th v mi bt trong nhim sc

    th :

    Pht sinh mt s ngu nhin r trong min [0;1].

    Nu r < pmu, tin hnh t bin ti bt .

    Cc thao tc x l ny c p dng lp li cho ti khi cc c thcon, chu ca chng tng trng ti kch c mong mun ca qun th.

    V d 1:

    100111 s c t bin thnh 100110, trong s 1 hng

    cui (tnh t tri) c i thnh 0.

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 20

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    21/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    V d 2:

    110110 s c bin i thnh 111110, trong s 0 v

    tr th 3 (tnh t tri) c i thnh 1.

    1.4 Hm thch nghiI.4.1 nh x gi tr hm mc tiu sang gi tr thch nghi

    V hm thch nghi phi nhn gi tr khng m, do cn

    phi xy dng nh x hm mc tiu ang xt trong bi ton sang

    hm thch nghi thng qua mt hoc nhiu ln nh x.

    Nu bi ton ti u l cc tiu mt hm nh gi g(x), vicchuyn t hm nh gi sang hm thch nghi s dng vi gii

    thut di truyn nh sau:

    Cmax g(x) khi g(x) < Cmax

    f(x) =

    0 trong cc trng hp khc

    y, Cmax l mt tham s u vo. V d, c th ly Cmax l

    gi tr ln nht ca g(x) trong qun th hin ti hoc c th l gi

    tr ln nht sau k vng lp. Ni chung Cmax khc nhau tu thuc

    vo gi tr cc bin ca qun th

    Nu hm mc tiu gc tng hoc ang xt bi ton cc i

    ho mt hm u(x) no , ta c th chuyn sang hm thch nghi

    nh sau:

    Cmin + u(x) khi u(x) < Cmin

    f(x) =

    0 trong cc trng hp khc

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 21

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    22/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    y, Cmin l tham s u vo, c th l tr tuyt i ca

    u(x) b nht trong qun th hin ti hoc trong k vng lp cui

    cng hoc l mt hm ca bin qun th.

    I.4.2 iu chnh thch nghi

    Mt vn quan trng l iu chnh s con chu. iu ny

    c bit quan trng cho mt vi vng lp u tin, khi mt vi c

    th siu c tim nng chim lnh phn ln qun th v lm cho

    hi t sm. iu chnh thch nghi c th gip gii quyt vn

    ny.

    C nhiu kiu iu chnh khc nhau, tuy nhin iu chnh

    tuyn tnh l hay gp nht. Gi f l thch nghi gc, f l thchnghi c bin i. thch nghi theo iu chnh tuyn tnh

    c xc nh theo quy tc:

    f = a*f + b

    Trong , h s a, b c xc nh sao cho:

    favg = favg

    V fmax = Cmult*favg

    y, Cmult l s cc bn sao cn thit i vi mt thnh vin tt

    nht. Vi lng bin tng i nh (n = 50 n 100)

    2: Xt trong mi quan h gia mng nron v gii thut di truynCc ton t lai ghp, t bin, chn lc v hm thch nghi c p dng mt

    cch c th

    Mt c th bao gm cc thng tin: cc hm thuc hnh tam gic v cc gi trthc.

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 22

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    23/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    2.1 Cross-over (Lai ghp)

    Ton t lai ghp ngha l thay i v tr nh ca hm thnh vin th. Cch

    thc lm vic ca ton t ny th hin trong hnh 4. C hai chui (cha, m)

    trong mt mu c la chn bt k. S dng cc chui la chn ny, im

    lai ghp cng c la chn gia cc gi tr xy dng nn v tr nh ca

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 23

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    24/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    hm thnh vin. Cu trc c thay i gia mi chui da trn im lai,

    cc kt qu, chng phi tri qua ton t lai to ra 4 kiu.

    (1)cc gi tr bn phi ca chui c k tha t mt chui (A) v cc

    gi tr bn cnh c k tha t mt chui khc (B), trong mi gi

    tr l bn sao bi tng cc gi tr ca mt chui.

    (2)Cc gi tr bn phi ca chui c k tha t chui (B) v cc gi

    tr bn cnh c k tha t chui (A), trong mi gi tr l bn sao

    ca tng cc gi tr ca chui.

    (3)Cng ging nh cch thc trn, cc gi tr bn tri ca chui c k

    tha t chui (A).

    (4)cc gi tr bn tri ca chui c k tha t chui (B).

    Nh th hin hnh 4, nh ca hm thnh vin c thay i i vimi kt qu. Kt qu c th k tha thng tin di truyn mc cao hn t hai

    cha m bi ton t lai ghp. Cc gi tr th hai v th ba trong thao tc m

    ho c tha k m khng thay i.

    2.2 Mutation (t bin)Ton t t bin xut hin i vi cc chui, chng tri qua ton t t bin,

    vi xc sut Pm. Ton t t bin trong ny c ngha l hm thnh vin la

    chn c ct bt, c th hin trong hnh 5. Chng ta c th mong rng

    lm gim bt s lut m v thu c cu trc nh nht ca m hnh m bi

    thao tc ny.

    Theo cch ny, mt chui mi c sinh ra bng cc thao tc lai ghp v t

    bin. Cc thao tc ny nhn a ra mt cu trc thch hp ca m hnh m,

    tng ng vi qu trnh iu chnh th.

    2.3 Fitness function (Hm thch nghi)

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 24

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    25/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    Chng ta t hm thch nghi nh gi mi chui liu c mong mun c

    hay khng. Hm thch nghi ny bao gm s cc hm thnh vin v tng bnh

    phng li gia gi tr ra ca m hnh m v gi tr mong mun. Chng ta

    xc nh hm F ny nh sau:

    F(si) = E + A*N

    Trong , si l chui th i, E l tng bnh phng li gia gi tr ra ca m

    hnh m v gi tr mong mun, A l hng s, N l s hm thnh vin. Chngta xc nh c rng chui no c thch nghi nh hn hay ln hn.

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 25

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    26/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    2.4 Selection (chn lc)Da vo gi tr thch nghi, mi chui c la chn hay khng th h k

    tip. Chng ta chp nhn duy tr chin lc l cc chui c thch nghi cao

    tn ti trong th h k tip v chin lc ly mu rng cc chui c la

    chn tn ti mt cch ngu nhin trong th h k tip. Cc chui tri qua cc

    php ton di truyn nhiu c thch nghi cao, hn na chng s tip tc

    tn ti trong th h k tip bng php chn lc. Php chn lc ny, chng

    thay i mu ca cc chui, thc hin s tin ho.

    3: Chin lc iu chnh m t ng

    Thut ton iu chnh thu c m hnh m ti u. Th tc ny c th

    hin hnh 6(1)Th h khi to c mt vi chui trong mi chui bao gm mt

    tham s xy dng m hnh m c sinh ra mt cch ngu nhin

    (2)Cc ton t t bin v lai ghp thc hin vic to cc chui mi.

    Thut ton di truyn xc nh cu trc ca m hnh m th v s lut

    Sinh vin: Trn Th Thu Hoi_K54C_CNTT 26

  • 7/31/2019 Tran Thi Thu Hoai_ k54c

    27/27

    ti: Ti u ho cu trc ca mng nron m bng gii thut di truyn

    m nh nht. Cc ton t ny ph hp vi qu trnh iu chnh th,

    nh cp trc

    (3)S dng cc chui tri qua cc ton t di truyn, cc hm thnh vin

    v cc gi tr thc trong mi chui c n khp vi lut delta [8].

    Lut delta xc nh cu trc m hnh m tt.Thao tc ny ph hp vi

    qu trnh iu chnh th

    (4)Mi chui c nh gi trn c s mt hm thch nghi t c

    bin php nh hng

    (5)Da trn gi tr thch nghi, mi chui tri qua thao tc la chn, chng

    thay i mu ca chui v thc hin s tin ho.

    (6)Nu chng ta thu c chui mc tiu hoc tm kim t n th h

    gii hn, s tm kim l qu rng; ni cch khc l quay tr li ton tdi truyn(2). Chng ta xc nh c chui mc tiu khi thch nghi

    ca chui hi t trong li ch.

    IV: KT LUN ti: Ti u ho cu trc ca mng nron l mt ti kh v ang trongqu trnh tip tc c nghin cu.

    Mong c s ng gp ca thy c v cc bn ti c hon thin