1. CNG TY CNG NGH TIN HC TINH VN Tr S chnh Tng 8, KS Th thao, Lng Sinh vin Hacinco Qun Thanh Xun, H Ni www.tinhvan.com Tel.: +84-4- 5589970, Fax: 5589971 E-mail: info@tinhvan.comVn phng pha Nam 124 Bc Hi, phng 6, Qun Tn Bnh, Tp. HCM Tel.: +84-8-9706066, Fax.: 9706077 E-mail: hcm@tinhvan.com

2. Effective Software Testing11/4/2013H ni, thng 06 nm 2006Cng ty Tinh Vn Lu hnh ni bS trang : 2/78 3. Effective Software Testing11/4/2013MC LCDANH SCH T VIT TT.......................................................................................................5 1.GIAI ON C T YU CU..............................................................................................5 1.1S cn thit ca testers khi d n bt u...............................................................................6 1.2Kim tra cc yu cu...............................................................................................................7 1.3Thit k test Procedures ngay khi c c t yu cu.............................................................11 1.4Cc thay i ca yu cu cn c update...........................................................................13 1.5Developing and Testing da trn mt h thng sn c.........................................................15 2.K HOCH TEST....................................................................................................................17 2.1.Trch nhim v mc tiu test ..............................................................................................18 2.2.Tnh ton cc ri ro..............................................................................................................21 2.3.Xc nh n lc test cn tnh n thi gian b sung cc chc nng ca phn mm............27 2.4.Lu li phn mm trong tr nh...........................................................................................28 2.5.B d liu test hiu qu.......................................................................................................29 2.6.K hoch cho mi trng test..............................................................................................32 2.7.c lng thi gian chun b test v thi gian thc hin test.............................................34 3.TEST PROCEDURE V THIT K TEST..........................................................................42 3.1.S phn chia v thc hin test.............................................................................................43 3.2.S dng Template Test Procedure v cc tiu chun thit k test khc..............................48 3.3.Vic chuyn ho thnh cc test cases t yu cu ca khch hng.......................................51 3.4.SRS l ti liu khng th khng c (nh ti liu sng cn) ca qu trnh test (Living" Documents)................................................................................................................................54 3.5.S dng cc Prototypes........................................................................................................55 3.7.Cc k thut test c s dng khi thit k kch bn test....................................................56 3.8.Trnh s rng buc v chi tit cc yu t d liu trong cc test cases................................59 3.9.p dng Exploratory Testing (test qua ton b chng trnh)............................................60 4.CNG C TEST T NG...................................................................................................62 4.1.Cc loi testing tools............................................................................................................62 Cng ty Tinh Vn Lu hnh ni bS trang : 3/78 4. Effective Software Testing11/4/20134.2.Xy dng 1 tool thay cho vic mua mt tool.......................................................................67 4.3.nh hng ca Automated Tools n n lc test................................................................69 4.4. Tp trung vo nhng g m cng ty cho l cn thit...........................................................73 4.5.Kim tra tool bng cc Prototype.........................................................................................76Cng ty Tinh Vn Lu hnh ni bS trang : 4/78 5. Effective Software Testing11/4/2013DANH SCH T VIT TTSTT 1 2 3 4 5T VIT TT PM PL PQA SQA TLNI DUNG Project Manager Project Leader Process quanlity Asurance Software quanlity Asurance Test Leader1. GIAI ON C T YU CU Chng trnh test s hiu qu nu c bt u ngay khi d n bt u, c ngha khi ny, cc tester phi nghin cu SRS dn dn, v n ko di cho n trc khi vit code.Cng ty Tinh Vn Lu hnh ni bS trang : 5/78 6. Effective Software Testing11/4/2013u tin ti liu c t yu cu s c ph duyt; tip n trong cc giai on sau ca d n, vic test tp trung vo m bo vic coding ca chng trnh l ng. Nh vy, vic sa li chng trnh s c chi ph thp nht do sm loi b c nhng li khng ng vi yu cu khch hng a ra trc khi thit k chi tit hay coding. Mt ti liu c t yu cu cho mt ng dng hay mt h thng phn mm cui cng cng phi m t c cc chc nng chi tit c bn ca ng dng hay h thng phn mm cn phi t c. Mt trong nhng kh khn ln nht pht trin ti liu c t l vic giao tip, tip xc vi ngi a ra cc yu cu lm sao hiu c v nm c cc yu cu h a ra. Tng yu cu phi c bt u mt cch chnh xc, ng v r rng. Nu vy, th ngi c cc yu cu s hiu chng mt cch ng nht, v thng nht. Nu c tnh nht qun trong ti liu c t th ngi i kho st s tp hp c ton b cc yu cu mt cch hiu qu nht. Mt yu cu c a ra cng sm th n s c kim tra v lc bng cch hi khch hng nhng cu hi chi tit. Cc dng cu hi a ra hi khch hng rt a dng m bo rng cc yu cu a ra phi c tnh logic vi nhau v mi ngi hiu chng theo cng mt ngha. 1.1 S cn thit ca testers khi d n bt u. Cc Testers cn phi tham gia t khi d n bt u h c th hiu chnh xc nhng g h phi test v c th lm vic vi cc khch hng khc to ra cc yu cu c th test. Ngn chn li l cch s dng cc k thut v qui trnh gip pht hin ra li v trnh cc li trc khi cc li c nhn rng trong cc giai on pht trin sau . Vic ngn chn li hiu qu nht l khi bt u vit c t ngi dng v nu cc yu cu c c nh, khng thay i th vic pht hin ra li l thp nht: Ch c nhng s thay i yu cu mi c phn nh vo ti liu c t v t s thay i test plan. Nu testers (cng vi cc khch hng khc) c tham gia t u ca 1 d n, h s gip nhn ra s thiu xt, s khng nht qun, s khng r rng v nhng vn khc c th nh hng n cht lng v tnh ng n ca d n. Mt yu cu c th c coi nh thng qua nu nh c th thit k 1 qui trnh trong cc chc nng c th test c, v kt qu mong i l r rng. Testers cn hiu thng nht v mt sn phm t h c th test tt hn v hon thnh test plans, thit k, ti liu, v cc test case. Nu nhm test c tham gia sm th s loi tr c s ln xn v cc chc nng ca phn mm. Thm vo , s tham gia ngay t u s cho php nhm test bit c tng th chng trnh, nhm test s ng vai tr l ngi cui cng ph bnh v hn ch ri ro mt cch ti a. Cc kin thc thu Cng ty Tinh Vn Lu hnh ni bS trang : 6/78 7. Effective Software Testing11/4/2013c s m bo cho cc tester u tin tp trung test cc phn quan trng nht, trnh vic test cc phn khng cn thit nh cc phn rt t khi c s dng. Cc tester cn ng trn vai tr ca c ngi dng, ngi lp trnh v khch hng test. i vi cc d n nh th c th cc tester s tm c ht cc li m khng cn tham gia ngay t u d n. Nhng i vi cc d n ln v phc tp th khng th mong cc tester tm ht ra cc li quan trng nu h ch c tham gia khi phn mm c coding xong. Khng ch cn hiu v u vo v u ra ca chng trnh, cc tester cn phi hiu su hn v nhng g c th xy thng qua qu trnh s dng trong sut qu trnh c t cc chc nng. Vic hiu k c t khng ch lm tng cht lng phn mm v pht trin test Procedure m cn cho php cc tester phn hi li nhng g cha hp l hay cn thiu trong SRS. Chng ny s a ra cch lm th no tm ra cc li mt cch sm nht v cc loi li l li nh th no. Bng 1.1 Table 1.1 Phn lp cc chi ph lin quan sa li t khi n cha c pht hin n khi c pht hin.1.2 Kim tra cc yu cu. Trong tc phm ca Christopher Alexander, ng ta ch ra rng, vic ch ra r rng cc yu cu l phi m t c cch thc thnh lp vic o lng cht lng cho mi yu cu: tng l mi yu cu u c chnh xc c th a ra c cc gii php cho cc yu cu . Cc gii php a ra c sp vo mt trong hai loi l p ng hay khng p ng yu cu. Hay ni cch khc, mt yu cu c cht lng c ngha yu cuCng ty Tinh Vn Lu hnh ni bS trang : 7/78 8. Effective Software Testing11/4/2013 phi c ch ra mt cch r rng, t a ra mt s gii php cho n. Mt s gii php s c chp nhn cn mt s khc th khng. Vic o lng cht lng yu cu c s dng kim tra h thng m i ngc vi cc yu cu . S c gng xc nh n v o lng cht lng a ra cc yu cu hp l, r rng. V d, mi ngi ng vi cu sau: h thng phi cung cp cc gii php tt nhng mi ngi li c cch hiu khc nhau v th no l mt gii php tt. i khi yu cu m khch hng a ra s c gii php tt p ng c, nhng i khi chng li khng c gii php ti u tho mn yu cu . Mt gii php s chng t yu cu r rng hay cha r rng. iu quan trng l cc nguyn tc pht trin yu cu v ti liu phi c xc nh t khi bt u d n. Trong cc phn mm nh, vic phn tch k cc yu cu m bo h thng pht trin ng cch. Cc Use cases l mt cch phn nh cc yu cu v chc nng mt phn mm cn c, t c th hon thin test h thng v cc test Procedure. Trong ti liu ny, hu nh ch gii hn li mt s yu cu chng minh cho mt vi c t phc v cho vic vit cc testcase v mt s loi ti liu khc khi m t chc nng ca h thng. Ngoi cc yu cu v chc nng cn c th mt h thng cng phi quan tm n cc yu t phi chc nng nh m bo l chy c v c tnh bo mt, qu trnh thao tc nhanh chng, tin li. Nh vy chng ta phi la chn cng ngh v mc ri ro. Nhng yu cu phi chc nng i hi h thng c nhng chc nng c trng, i hi phi xc nh mt cch cht ch cch thc m h thng thc hin cc chc nng l nh th no. Cc yu cu chc nng phi i i vi cc yu cu phi chc nng.( Chng 9:Tho lun v cc yu cu phi chc nng) Cc tester s lit k nhng mc cn test trong sut giai on c t yu cu nhm kim tra, xc minh li cc yu cu. Xc nh nhng mc cn test l bc u tin bt li ca chng trnh so vi yu cu, do , cc li ny s khng pht trin c trong cc giai on sau nn vic sa li s c chi ph thp hn v d dng hn. Tt c cc khch hng phi c trch nhim vi nhng yu cu c a ra v thng qua cc thuc tnh ca cc yu cu . S chnh xc ca cc yu cu.Cng ty Tinh Vn Lu hnh ni bS trang : 8/78 9. Effective Software Testing11/4/2013S chnh xc ca cc yu cu cn xt on da trn nhng g ngi dng mun. V d, nh cc nguyn tc hay qui nh c cn r rng hay khng? Cc yu cu c phn nh mt cch chnh xc nh ngi dng a ra hay khng? iu cp thit l khi ngi dng cui cng, hay mt i din thch hp phi c nhng lin quan, rng buc nhau trong sut giai on ca cc yu cu. S chnh xc cng c th c xem xt trn nhng tiu chun nht nh. Vy nhng tiu chun l g? Completeness. S hon thnh m bo rng tt c cc yu cu u c p ng. Mc tiu l trnh khi nhng yu cu khng r rng mt cch n gin nht v nhng yu cu ny thng khng c nhng cu hi ng hay khng c kho st ng i vi cc ngun lc thch hp. Cc Testers nn nhn mnh vo s kt hp vi gia yu cu chc nng v cc yu cu phi chc nng nh vic thc hin ca chng trnh, tnh bo mt, cc tin ch, s tng thch v kh nng truy cp, v nhng yu cu phi chc nng c m t cng vi cc yu cu chc nng. Cc yu cu phi chc nng thng c chia thnh 2 bc: 1. Khi h thng c tnh m th cc yu cu phi chc nng s c a ra. V d, giao din ngi dng ca h thng WEB phi tng thch vi c trnh duyt Netscape Navigator 4.x hay cao hn, v trnh duyt Microsoft Internet Explorer 4.x hay cao hn. 2. Mi c t yu cu nn c c on tiu ti liu yu cu phi chc nng m t mt s yu cu phi chc nng c bit Tnh n nh ca h thng. Tnh n nh ca h thng c ngha l h thng s khng c mu thun gia yu t bn trong v bn ngoi, gia cc thao tc trong 1 module v gia cc module vi nhau. Xt v cu hi S c t l xc nh ni dung bn cht ca cc yu cu. Chng ta c th xc nh cc yu t trong yu cu mt cch r rng v t m. V d, mt c t s dng thut ng viewer nhiu ni trong ti liu nhng vi cc ngha khc nhau tu thuc vo tng vn cnh v y l nguyn nhn trong vic thit k v coding s c nhiu ch khng r rng v nht qun, khi ny yu cu ng nhng b thit k khng chun. S thm tra xc minh mt yu cu. S thm tra xc minh mt yu cu to ra cc tnh hung kim th vi kt qu mong i l r rng v c th thy ngay c. Nu mt yu cu khng c test hay ni cch khc lCng ty Tinh Vn Lu hnh ni bS trang : 9/78 10. Effective Software Testing11/4/2013khng c thm tra, kim th, v thc t v theo logic th ri ro l r rng v yu cu phi c iu chnh. Tnh kh thi ca mt yu cu. Tnh kh thi ca mt yu cu m bo yu cu c thc hin vi s tin cn thc hin, thi gian thc hin, cng ngh v nhng ngun lc khc c qui nh. Necessity. S cn thit kim th, thm tra mi yu cu trong c t lin quan ti h thng. test logic v s cn thit, cc tester phi test ngc li vi mc tiu cn t c ca h thng. Phi chng yu cu ny ng gp vo cc kt qu? Hay n c th ngn khng cho h thng t c mc tiu? Nhng yu cu khc ph thuc vo yu cu ny? Mt s yu cu khng thc s phi l yu cu nhng n li ng gp vo mc tiu ca gii php . Tnh u tin. Tnh u tin cho php mi ngi hiu cc gi tr lin quan ti cc yu cu ca khch hng. Kt qu ca tnh u tin c m t bi 5 mc t 1 n 5 nh gi cht lng ca mt h thng l tt hay khng tt so vi yu cu ra, v nu khng tt th s b pht bao nhiu tin. Nu mt yu cu bt buc phi p ng v n c ngha sng cn n s thnh cng ca h thng th buc phi c v phi chun, nhng nu yu cu khng quan trng n mc th c th c hnh thc l pht tin. Cc bn c th a ra th t u tin cn thit v cc quyt nh da trn s tho hip t thit k h thng. Ci ch cn t c l phi cn bng c gia cc yu cu ca mi ngi dng, chi ph, ri ro lin quan ti cc yu cu. Tnh r rng. Tnh r rng l m bo cc yu cu a ra phi r rng. V d mt yu cu khng r rng nh sau: H thng phi p ng mt cch nhanh chng mi yu cu ca khch hng. Nhanh chng ch mang ngha ch quan v do yu cu l khng th p ng c. Mt khch hng c th ngh nhanh chng ngha l ch trong vng 5 giy trong khi ngi lp trnh cn n 3 pht. Ngc li, mt lp trnh ngh rng ch cn 2 pht hon thnh nhng k s thit k h thng cn nhiu thi gian hn th. h nng kt hp v theo di cc yu cu. Kh nng kt hp m bo mi yu cu c xc nh theo 1 cch m n s kt hp vi tt c cc phn khc ca h thng ni m n s c s dng. Khi yu cu thay i c th xc nh c tt c cc phn khc ca h thng thay i theo.Cng ty Tinh Vn Lu hnh ni bS trang : 10/78 11. Effective Software Testing11/4/2013i vi c tnh ny, mi yu cu coi nh xc nh c lp. iu cn thit l phi lin kt cc yu cu li vi nhau hiu c nh hng ca n ti cc yu cu khc. Nh vy l phi phn chia mt khi lng ln cc yu cu ri lin kt chng li . Suzanne Robertson a ra kin nn c gng x l ng thi mi yu cu mt lc, tt hn l chia nh cc yu cu thnh cc nhm qun l. iu ny c th da trn ni dung ca cc yu cu hoc da trn tnh u tin. lm c iu , s kt ni c hin theo 2 bc: th nht l lin kt cc yu cu trong cng 1 nhm, th 2 l kt hp cc yu cu gia cc nhm.Nu cc yu cu c nhm li sao cho vic kt ni gia cc nhm l nh nht th s phc tp ca vic theo di, kt hp cc yu cu s l nh nht. Vic kt hp, theo di cng cho php tp hp cc thng tin v nhng yu cu v cc phn khc trong h thng c th b nh hng mt khi yu cu ny thay i nh vic thit k, code, test, helpKhi yu cu b thay i, cc tester phi chc chn rng cc mc, cc phn lin quan s b nh hng. Nu cc yu cu l n l th c th xem xt li v c th bt u test li theo s thay i . Pht hin li sm c th gim c cc li gy ln nhng phn khng ng vi yu cu. T , thit k s cht ch hn v chi ph sa li s thp v vic sa li d dng hn. Sau nhng bc trn, cc ng dng s hon thin hn v s cho php t chc thc hin, lp k hoch, theo di tin v test. 1.3 Thit k test Procedures ngay khi c c t yu cu. Cc k s phn mm thit k da trn ti liu c t yu cu. V ti liu ny l rt cn thit nhm test thit k test Procedure. Trong mt vi t chc, vic thit k test Procedure thc hin sau khi phn mm c xy dng xong v ci t cho nhm test, do vy s b thiu thi gian v thc hin test khng tt. iu ny l vn c hu, v nh vy s b b qua mt s yu cu hay li s b pht hin mun hn, thm ch sau khi s n kt thc v khng th test c. Vic vit test Procedure c gng phi thc hin ngay sau khi c ti liu c t. V nh vy test Procedure s c ch hn. Trong qu trnh vit test Procedure s thy, pht hin c nhng thiu xt, lung cng vic khng ng v nhng li khc. Khi test th nn c gng lm nh hng n h thng vi nhng mc c bit, to ra cc b d liu u vo c bit. Qu trnh ny buc phi to ra cc kch bn cho cc yu cu. Nu khng bao qut ht c cc trng hp th cn phi b sung cc trng hp khi pht hin. Nu qu trnh ny sm c thc hin th vic nh hng n thit k s gim i hoc cc giai on sau s cn t thi gian hn. Cng ty Tinh Vn Lu hnh ni bS trang : 11/78 12. Effective Software Testing11/4/2013Nh ni phn 1, vic pht hin li sm lm gim chi ph. Nu li c pht hin cc giai on sau th c th phi thay i cc yu cu, thit k, code, m iu lm nh hng n s tin m bn nh cung cp nhn c, nh hng n k hoch, v tinh thn. Tuy nhin, nu li c pht hin ngay khi c c t th cn xem xt li ti liu , xem cc c t ng hay cha. Qu trnh xc nh nhng li hay thiu xt khi xy dng test Procedure l s cp n vic thm tra li ti liu c t . Nu ti liu m thiu thng tin hay thng tin khng r c th xy dng mt test Procedure, c th l khng lm c nhng test cases th ti liu khng th test c v c th khng thit k c phn mm. Test l m bo yu cu c thc hin v c th c nhng li ngoi l trong khi test. Nhng ngoi l phi r rng. V d, vi yu cu l d liu cc trng phi c lu li trong cc bn ghi trong vng 3 nm khng th thng qua ngay lp tc c. Tuy nhin, yu cu ny khng nht thit phi nh vy. Nu mt yu cu khng c thng qua th khng c g m bo rng n s c thc hin ng. m bo pht trin test Procedure th trong test case phi nu r b d liu u vo l g, cc bc thao tc v kt qu mong i r rng cho mi yu cu. Nh vy th s khng b b qua cc yu cu quan trng. S pht trin test Procedure cng sm c thc hin s cho php pht hin ra nhng phn cha c thng qua. Nu vic ny c thc hin sau khi phn mm coding xong v ghp xong mi gi cho cc tester th test Procedure khng tt l ng nhin bi h khng c thi gian. V d, test Procedure c th b thiu cc trng hp, hoc c th kt qu mong i l khng ng hay b d liu a vo khng chun. V kt qu l li vn xy ra hay yu cu khng c thc hin, thm ch phn mm b tht bi. Cc nh gi sm v cc yu cu ca ng dng c th l nn tng, ct li cho vic xc nh chin lc test. Trong khi xem xt cc yu cu, cc tester cn xc nh nhng g cn test, v d, h s dng cc cng c test, k thut test no bt li; phn no c th test th cng, phn no cn n cc test tool. Trong qu trnh test, h cn xc nh cc yu cu tnh ton phc tp, a dng test nhiu hn hay phi c nhng kch bn c bit. Vic vit test Procedure phi c bt u khi giai on c t yu cu kt thc v s c lp li, b sung nu pht hin thm li. Tuy nhin ti liu ny cng c mc u tin cho cc chc nng no cn test trc da vo ti liu c t. Theo tng th cc yu cu s c chuyn cho cc tester h xc nh li cc yu cu v to kch bn test.Cng ty Tinh Vn Lu hnh ni bS trang : 12/78 13. Effective Software Testing11/4/2013Qu trnh test phi c u tin da trn k hoch thc hin ca d n. Nu thi gian gp qu th u tin cho test xem chng trnh c chy c khng ri mi n test c th cc yu cu sau . Cc yu cu thng l c lc v phn tch thng qua vic xem xt, kim tra. Thng th mt yu cu mi a ra s c mt kch bn r rng trong sut giai on thit k v pht trin. Mi ngi ni rng tt c cc chi tit ca cc yu cu nn c gii quyt trong giai on kho st. Tuy nhin, thc t cc yu cu cu ny thng c tip tc b sung sau . Nu cc yu cu ny c lp li sau ca qu trnh th qu trnh test cng cn lp li. qun l hiu qu cc yu cu pht sinh mi v vic test ch cn quan tm ti phn pht sinh th phi c s gn kt cht ch gia cc b phn trong c qu trnh lm vic ca d n. Nhn vo phn 4 di y ta s thy tm quan trng ca vic giao tip, trao i vi khch hng nhanh chng nm bt c nhng thay i ca yu cu. 1.4 Cc thay i ca yu cu cn c update. Khi qui trnh test da trn ti liu c t, th khi yu cu thay i, nhm test cn phi c thng tin ngay. Tht vy, Nu thay i ca yu cu m khc so vi h thng th phi c update vo ti liu c t. Tester phi chu trch nhim i vi s pht trin v chy c ca h thng nn nu trong qu trnh test, c s thay i v yu cu m h khng c thng bo th dn n bo co li sai, khng t c mc ch ca test v lng ph thi gian. y l mt trong nhng nguyn nhn dn n qu trnh thng k gp cc vn sau: S thay i khng c c s. V d mt ngi no nh PM, ngi giao dch vi khch hng, ngi phn tch bit c s thay i nhng khng ni v update cho lp trnh hay update vo ti liu th lp trnh s lm theo ci c, v n l iu khng ph hp, khng ng vi yu cu ca khch hng t ra. Qu trnh, th tc cn phi r rng cho cc developer, c bit khi c thay i ca yu cu. iu ny thng c gi l Change Control Board, Engineering Review Board hay c ch tng t s c tho lun bn di. Ti liu c t c, li thi. Mt s thiu xt ca tester hay s m t ngho nn c th l nguyn nhn dn n mt tester a ra mt k hoch test hay test Procedure khng tt (v tester ny lm vic vi phin bn c ca ti liu c t). Cc yu cu cn c update vo ti liu ny v phiCng ty Tinh Vn Lu hnh ni bS trang : 13/78 14. Effective Software Testing11/4/2013c t di s qun l (gi l cc baseline)v cn c s thng qua ca tt c mi ngi c lin quan. Li phn mm. Cc developer c th lp trnh khng ng vi yu cu t ra mc d ti liu c t v cc ti liu khc tham kho l ng. V cui cng th kt qu test c bo co. Tuy nhin, nu cc thay i ca yu cu khng c update th cc kch bn trong cc test cases cha chc xy ra. Vy phi chng vn rc ri gp phi ca bt k 1 phn mm no l do ti liu c t, test Procedure hoc tt c nhng iu nu ra trn? trnh xa nhng vn gp phi ni trn th tt c cc yu cu thay i phi c update, nh gi v thng qua ca tt c mi ngi lin quan. Nh vy cn phi c s qun l qu trnh thay i yu cu, v qu trnh ny phi to thun li cho mi ngi. Nu mun c 1 yu cu chnh xc th qu trnh thay i yu cu cn phi nh du thnh nhng chng, mc thun li cho vic thit k, coding v cc ti liu khc lin quan nh cc test Procedure. qun l c hiu qu qu trnh ny, nhng thay i phi c cn c v nh du thnh cc version khc nhau. S thay i phi c xt trn cc im sau: Yu cu c thay i khi no, v thay i l thay i ci g, do ai yu cu v thay i bt ngun t u? Qu trnh thay i ny c th phi vit li ti liu c t t u v cn c review li, deign li, coding li, defect tracking, v test li. Mi 1 yu cu thay i c th c 1 ti liu khc cha y cc thng tin cn thit v s thay i . V n c tp hp li trong Change Control Board (CCB). T chc 1 CCB m bo rng s thay i 1 yu cu hay nhng yu cu khc phi tun theo mt qu trnh c t. Mt CCB thng cha cc thng tin tiu biu v nhng nhm qun l nh nhm qun l sn phm, qun l yu cu, nhm QA cng nh nhm test v qun l mng. Tt c cc khch hng u phi nh gi cc s thay i, cc xut theo kha cnh v u tin, mc ri ro. V d, khi 1 yu cu b thay i, n c th nh hng n ton b test Procedure, n nhiu yu cu khc v n lc test hay vic thc hin yu cu thay i th s thay i ton b cc k thut test hay cng c test t ng. V s nh hng phi c xc nh, phi c trao i trc khi s thay i c ph duyt. CCB xc nh c gi tr ca s thay i , s nh hng ca n, s cn thit v mc u tinCng ty Tinh Vn Lu hnh ni bS trang : 14/78 15. Effective Software Testing11/4/2013( V d, Nu cc thay i d c thc hin ngay lp tc hay khng th n cng phi c th hin bng ti liu c th trong qu trnh thc hin d n) CCB phi m bo rng, yu cu mi c a ra phi nh gi c mc ri ro lin quan v qu trnh ra quyt nh phi c th hin bng ti liu v c thng qua. iu cn thit l tt c cc phn thay i a ra cn nhn bit c, cho php chng ta phn tch c ri ro, lm gim bt nhng nh hng ca n n cc yu cu khc. m bo thc hin c iu ny l s dng requirements-management tool. Cng c ny c th c s dng theo di s thay i yu cu cng nh thay i test Procedure. Nu cc yu cu thay i c phn nh v update trong cc tool ny th tool ny s nh du li chng v c lng c s nh hng ca chng n vic test ra sao (cc yu t khc b nh hng nh design, codingcng c o lng mc nh hng), do cc phn tng ng ca sn phm cng b nh hng theo. Mi ngi s c cc thng tin mi nht thng qua tool ny. Thng tin thay i c qun l thng qua tool cho php cc testers nh gi li kh nng test theo yu cu c thay i cng nh nh hng ca n n cc test Procedure lm nh k hoch test b thay i ra sao.Khi ny ti liu, test procedure phi c xem xt v update li thch hp vi s thay i . Trc khi bt li th phi nh gi li xc nh cc yu cu mi so vi cc yu cu c khc nhau nh th no? Nu nh kch bn test hay cc c ch test c thit lp th chng cn c update. Khi qu trnh c xc nh l mang li nhng thun li, tin ch khi c s thay i ca yu cu th chng trnh test s l hiu qu v do d n thnh cng. 1.5 Developing and Testing da trn mt h thng sn c. Trong rt nhiu d n pht trin phn mm, sn phm c hon thnh m khng c ti liu c t hay ti liu ny rt s si v n da trn cu trc sn c v gi ch vic thit k li v nng cp. Hu ht cc t chc, module trong cc phn mm ny c, v vic test ch l test phn thay i so vi phn mm c m khng mt thi gian phn tch hay vit ti liu cho cc chc nng. V hnh thc m ni th d n phn mm ny s kt thc sm hn v giao cho khch hng sm hn. Nhng tht tic thay, tt c cc d n d l d n nh nht th chin lc s dng cc ng dng c sn cng gp ri ro cho d yu cu khc nhau khng ng k, do chc nng khng thch hp hay vic test khng c thc hin.Cng ty Tinh Vn Lu hnh ni bS trang : 15/78 16. Effective Software Testing11/4/2013Tht kh c kim tra phn mm c thit k trn phn c sn v d liu u vo c th khc nhau v phn mm khng thc hin c. Trong 1 s trng hp, nguyn nhn do d liu u vo lm nh hng, ri lon n d liu u ra. V s l nguyn nhn m developers a ra phng on tt nht v vic sai khc gia 2 phn mm. Tuy nhin, trong nhiu trng hp th cc phn mm da trn phn c sn vn hot ng v c pht trin mc d n c cu trc khc v cng ngh l li thi (v d v mn hnh l khc hay cc version Web l khc nhau), v n tip tc c bo dng v thm cc chc nng mi cn thit. Ngi c lin quan s chu trch nhim v sn phm mi ny s khng bit trc cc li c th xy ra do khng c ti liu c t. Hu ht cc c lng li ca phn mm ch l ngu nhin, khng chun. V hnh thc m ni th li ch khi thit k mt phn mm mi da trn ci c sn l r rng v rt ln. Khi ny cc tester c th so snh u ra ca ci c vi ci mi, nu n khng khc nhau th 2 phn mm ny l tng t nhau. Tuy nhin, iu ny l khng an ton. V nu u u ra ca phn mm c m sai trong 1 vi kch bn th iu g s xy ra? Nu phn mm mi ng th u ra ca phn mm c l sai. hay nu phn mm mi m chy c th test Procedure xy dng cho n v u ra ca 2 sn phm ny l khc nhau. Nh vy nu nh cc yu cu khng c th hin bng cc ti liu th lm cch no tester bit chc chn rng u ra l ng? Ch khi s phn tch phi c thc hin trong sut qu trnh tng hp yu cu xc nh kt qu mong i. Mc d phn mm mi c da trn phn mm c sn nhng c khi cc yu cu ca chng li khc nhau, nh vy cch thc qun l trong trng hp ny l xem xt kt qu mong i, tc u ra ca chng l g. S dng 1 application c fix. Ti sao mt ng dng mi buc phi da trn mt version c bit ca 1 ng dng c? D n mi phi chn 1 version ca ng dng c v l version ban u. Khi lm vic vi 1 version ca 1 application c fix th vic theo di li s thc t hn, chun hn. K t khi chn version th phi xc nh li ca application mi l u m khng quan tm ti vic application c c nng cp, sa li v li khng cn. .Ti liu ca application cCng ty Tinh Vn Lu hnh ni bS trang : 16/78 17. Effective Software Testing11/4/2013Bc tip theo c 1 ti liu c th v application mi l mi mt c trng th vit t nht 1 on th hin, a ra nhiu kch bn v kt qu mong i. C th, s phn tch y cc trng hp c th xy ra. Nhng thc t li phi quan tm ti thi gian v n lc ca ngi test phi b ra nn vic kim tra ht cc trng hp l khng th. Hu ht cc ti liu c t ca application mi khng y m ch c giao din ngi dng. Nu giao din ny khng th c ngha ti liu ny khng t yu cu. Ti liu ca application c nhng c update. Update c ngha l thm hay thay i yu cu cho application .V n s l cn c cho 1 application mi sau ny m application da trn application ny. iu ny s cho chng ta s phn tch r rng cc chc nng sn c v to ra design v test Procedure thch hp. Nu application c chy tt th ti liu c t, test Procedure v nhng ti liu khc vn c th s dng cho appliction mi. Nu vic update khng c thc hin th vic pht trin sn phm mi cng b nh hng. S mu thun gia ci c k tha v application mi s xy ra. Mt s mu thun gia 2 application ny l tng tng, trong khi mt s khc th khng, mt s mu thun th c d on trc trong khi mt s khc th ch c pht hin giai on test. Implement an effective development process going forward. Mc d h thng c c pht trin m khng c ti liu c t yu cu, design hay test Procedure, nhng bt k khi no c chc nng mi pht sinh th khng ch application trc m c application mi cc developers phi chc chn rng qu trnh pht trin c xc nh, v c thng qua trnh a ra nhng sn phm ti. Sau nhng bc trn, cc chc nng mi phi c t di s kim sot c th t chc, lp k hoch, theo di li v test cc chc nng thm mi tt hn.2. K HOCH TEST. C s nn tng c mt chng trnh test thnh cng l phi c mt k hoch test. Mt k hoch test thch hp i hi phi c hiu bit chung v qu trnh pht trin phn mm a ra yu cu thc hin thch hp. K hoch phi c t ra cng sm cng tt khi d n bt u. Bi v khi chng trnh test c t ra v c thc hin thnh cng hiu qu hn l khi code xong mi ln k hoch test. Khi ny, testers hiu c trch nhim ca mnh cn lm nhng g Cng ty Tinh Vn Lu hnh ni bS trang : 17/78 18. Effective Software Testing11/4/2013c th c lng c n lc cng nh xc nh nhng test tool no cn thit cho vic test ngh mua hay c o to.V khi chng trnh ra i l bt tay vo test c ngay. Ngoi ra, tester cn bit c yu cu phn cng phi p ng l nh th no. K hoch c vch ra sm cho php lch test v ngn sch c c lng, c ph duyt v cui cng l tp hp li thnh k hoch ca ton b d n. Khi ny, thi gian mua cc test tool v chun b test hay ni cch khc l thi gian chun b mi trng test v ci t chng trnh test, database v cc phn khc cn c test s sm c hon thnh. Khng phi cc n lc test u nh nhau. Mt k hoch test hiu qu yu cu phi hiu r rng v tt c cc phn v n nh hng n kt qu test. Thm vo , kinh nghim v s hiu bit v test l rt cn thit, bao gm k thut test, qu trnh test, v cc tool, chn chin lc test hiu qu p dng vo test chng trnh. Vic xy dng chin lc test , ri ro, ngn lc, thi gian v tin bc phi c coi trng. S hiu bit v cc k thut test v cch thc s dng chng l rt cn thit c lng, nh gi ngun lc, trch nhim, bao gm s ngi tham gia test, cn bao nhiu ngi c kinh nghim, vai tr v trch nhim ca mi ngi, thi gian v tin bc. C nhiu cch xc nh n lc, bao gm cc phng php t s v s so snh cc n lc trong qu kh ca cc d n tng t cn test. Vic xc nh ny s a ra mt nhm testers thch hp. 2.1. Trch nhim v mc tiu test Ni chung test l vic kim th phn mm nhm m bo chng phi t c tiu chun ra v tho mn yu cu ca khch hng. Nu test tt th cc li c hn ch, thm ch l ht li s gip cc chc nng ca phn mm ny hot ng ng, chun, do vy mc hi lng ca khch hng l cao nht. Mc tiu ca test l tm li v xo b chng to ln phn mm hon chnh. Mt chng trnh vi cc chc nng chy ng khi: B d liu u vo ng th u ra cng phi ng B d liu u vo khng ng th chng trnh s khng cho nhp v c thng bo li hin ln. Chng trnh khng b treo hay crash khi a vo cc b d liu ng hay sai Chng trnh chy ng v cho kt qu mong iCng ty Tinh Vn Lu hnh ni bS trang : 18/78 19. Effective Software Testing11/4/2013 Chng trnh p ng c c cc yu cu chc nng v yu cu phi chc nng. (chng 9, tho lun v cc yu cu phi chc nng) Khng th test ht c cc trng hp ca tt c cc b d liu u vo, ca cc kch bn, cc yu cu chc nng v phi chc nng. Chin lc Test cn c xc nh h tr m bo kt qu l cao nht. Thng th khng th fix tt c cc li m vn cn c li trong phn mm. V vy, phi xc nh li no cn c u tin test trc. Khng nht thit v cng khng cn nhiu chi ph fix tt c cc li trc khi bn giao. Cc mc tiu test cc chc nng, vai tr khc nhau l khc nhau. V d, mc tiu test cc chc nng ca chng trnh khc so vi test cu hnh. Ngi lp k hoch test thng l cc test leader v h phi c trch nhim xc nh mc tiu test l g? N lc test l bao nhiu? Mc tiu test da trn tiu chun ca tng h thng. S hiu bit v trch nhim, phm vi v mc tiu test lin quan, cn thit l nhng im u tin cn c trong mt k hoch test. K hoch test yu cu phi r rng trong cc bc, v nh th mi t c mc tiu ca test. Vy cch no t c iu ? Th nht, ti liu c t phi chun theo cc template t ra, xy dng k hoch test (trong bao gm chin lc test). Tip n l tch cc yu cu thnh cc chc nng ring bit. V cui cng l trao i gia nhm test vi bn design v developer. Cc yu cu lp 1 Test Plan: Hiu h thng. Hiu ton b h thng bao gm vic hiu v cc yu cu chc nng v phi chc nng. Nhm test bt buc phi hiu tt c cc yu cu ny. c nhng vn ri rc nh H thng nn . trong ti liu c t s cung cp mt bc tranh ton cnh bi v cc kch bn v cc chc nng u t m ra. Ti liu s bao gm cc yu cu, cc kt qu mong i cn c. Cc ti liu khc cng gip hiu su hn v h thng nh ti liu high-level business requirements, cc trng hp trong qun l cht lng sn phm v cc tnh hung khc trong kinh doanh. V d, mt h thng h tr phn phi thuc th yu cu hu nh khng c c bt k li no, cn cc h thng kinh doanh th c th chp nhn phn trm li nht nh. S lin quan, gn kt v trao i trong nhm test. Test leader v cc thnh vin ca nhm test cn c mi quan h cht ch vi nhau trong sut qu trnh test k t khi quyt nh u tin v yu cu 1 h thng c a ra. Khi Cng ty Tinh Vn Lu hnh ni bS trang : 19/78 20. Effective Software Testing11/4/2013s lin quan vi nhau c thc hin th mi ngi s trao i vi nhau nhiu hn, t ri ro ca phn mm s gim xung. Hiu r qu pht trin phn mm. Kin thc v nhng c m chung, c bn v qu trnh pht trin phn mm l cn thit thc hin c mc tiu test. Mc d mi thnh vin trong nhm test u n lc pht trin sn phm, nhng mt vi giai on trong qu trnh pht trin sn phm cn c vai tr ca cc SQA v PQA. Test leader cn c ci nhn xuyn sut c th a ra chin lc test hiu qu hon thnh mc tiu ca test. V d: o Phi chng n lc test bao gm n lc ca cc thnh vin c lp, tri vi vic kt hp gia nhm design v nhm developer? o C phi mt "chng trnh cui cng (extreme programming) l chng trnh ang thc hin v testers phi theo phng php ca chng trnh hay khng? o Nhm test l cng cui cng m mt phn mm phi i qua v phi chng nhm test chu hon ton trch nhim v cht lng ca phn mm? Phm vi thc hin. Ngoi vic hiu v cc vn ca h thng, cn phi hiu v cc vn chung v phm vi m nhm test phi lm. T xc nh c phm vi test. Kt qu mong i. Nhng kt qu mong i no cn qun l? Nhng kiu test no m khch hng mong i? V d, ngi dng cui cng s yu cu nhng g khi test? Cc kt qu mong i ti cc giai on test l g? Cc cu hi ny c tr li trong k hoch ca d n. Nhng bi hc. Cc bi hc c rt ra t trc khi c n lc test? Cc thng tin quan trng ca cc bi hc ny rt quan trng khi xc nh chin lc test v xc nh kt qu mong i thc t. Cc mc n lc. N lc xy dng ln h thng l g? S cn bao nhiu developer thc hin h thng ny? Cc thng tin ny rt c ch v phc v nhiu mc ch khc nhau. c lng, tnh ton c cc ch tiu trn cn xc nh mc phc tp ca phn mm yu cu? n lc ca test l bao nhiu? V iu ny da trn t l ca developers v testers l bao nhiu? (Xem phn sau ca chng tho lun cch thc o lng cc n lc ca test). Cc gii php.Cng ty Tinh Vn Lu hnh ni bS trang : 20/78 21. Effective Software Testing11/4/2013Gii php cui cng v phc tp nht s c thc hin hay nhng gii php m chi ph l hiu qu nht s c thc hin? Cc gii php ny yu cu thi gian lp trnh l t nht? bit r, chn la c th ngi lp k hoch phi hiu c cc kiu test c yu cu. La chn cng ngh. Cng ngh no s c chn thc hin pht trin phn mm ny? v nhng yu t tim nng no lin quan khi la chn cng ngh ? Kiu kin trc h thng no c s dng? sn phm l cc ng dng, hay cu trc client server hay ng dng web? Nhng thng tin ny s c xc nh trong chin lc test v cc test tool c chn. Budget. S tin b ra l bao nhiu thc hin, lm ra mt phn mm, bao gm c tin i vi n lc test b ra. Nhng thng tin ny s gip xc nh kiu test ph hp vi mc ph hp. Nhng thc t, s tin c xc nh lm ln mt phn mm li khng tnh n n lc test b ra. Thi gian test (lch test ) Thi gian dnh cho s pht trin v test l bao nhiu? Deadline l g? Nhng thi gian cho testing c c lng khng ng. Yu cu test leader phi lp lch kht vi thi gian kt thc d n. Gii php cho tng giai on. Vic thc hin mt d n c chia ra thnh nhiu giai on. V mi giai on c cc gii php ring. Vic test c th thc hin theo tng giai on v chng c mc u tin v do vic test cng c thc hin theo u tin . Thm vo , thi gian test l cn thit xc nh s tin v lch test c th v nhng phn cn thit khc. Cng nh phn cng cn p ng to mi trng hot ng cho phn mm , nhng nh gi, mua bn v thc hin ca cc test tool. Nu nh vic lp k hoch c thc hin sm th c hi la chn c test tool thch hp s rt cao v vn hnh c test tool l hon ton c th lm c. 2.2. Tnh ton cc ri ro Chng trnh Test c lp, cc iu kin xy ra i vi chng trnh v nhng ri ro phi c tnh ton trc khi a ra chin lc test. Vn ny bao gm cc s kin, hot ng, hon cnh c th xy ra i vi chng trnh test khi thc hin test theo lchCng ty Tinh Vn Lu hnh ni bS trang : 21/78 22. Effective Software Testing11/4/2013 nh, v d nh s ph duyt s tin c thc hin mun, tr hon vic trang b cc cng c, phng tin test hay phn mm ghp xong mun. Chin lc test bao gm cc hot ng c bit phi c thc hin t c cc mc tiu t ra. Nhiu yu t phi c quan tm khi a ra chin lc test. V d, kin trc h thng gm nhiu lp trng ln nhau. Ni chung chin lc test phi kt hp cht ch cc yu t gim ri ro mc thp nht v li, chi ph t nht, thi gian t nht hay nhng li khc. Trong sut qu trnh lp chin lc test th phi c s rng buc, lin quan ca cc yu t, bao gm s ri ro, ngun lc, gii hn thi gian, gii hn s tin. a. Mt chin lc test tt s thu hp trch nhim ca bn test vi cc im sau: Hiu cu trc h thng. Chia nh h thng thnh nhng lp ring r nh giao din ngi dng hay cch thc tip cn database. Hiu v cu trc h thng s gip testers xc nh c chin lc test cho mi lp h thng hay s kt hp gia cc lp vi nhau. (Vic tho lun, bn bc rng hn v vn ny s c nghin cu ti chng thit k cu trc h thng) Xc nh xem c p dng GUI testing hay cc chng trnh test ph tr hay p dng c hai. Khi hiu cu trc h thng th ngi ta s tm ra cch thc tt nht test thng qua giao din ngi dng ( GUI), chng trnh test ph tr hay c hai. Hu ht cc n lc test yu cu vic test c p dng trong c 2 mc , v d giao din ngi dng thng cha m, cc chun mc c s dng v thm tra. Khi xc nh c chin lc test, cc testers nn ghi nh ton b cc trng hp phc tp, cc mc yu cu mang tnh nghip v, cc loi test ph tr nhiu hn l test giao din ngi dng. S d nh vy l do ngn ng v cng ngh lm nn c mt sn phm phn mm l rt phc tp. V d, cc testers cng nn hiu ngn ngn ng C++ khi lp trnh chng trnh bng ngn ng C++, hay GUI tools v GUI testing, mt khc, cha k n cc chng trnh rng hn, cc k nng ni chung, cc nghip v chuyn su (iu ny ph thuc vo cc kiu test) c th yu cu cao hn. Khi xc nh kiu test cho vic trin khai chin lc test, cc testers nn qua tm n cc b d liu a vo cc trng khi test.. V d, mc ch ca cc application l pht trin, tp trung vo giao din ngi dng, c khi chim ti 75% chc nng ca chng trnh, cn 25% l test phn lp ( Vn ri ro ln nht khi test cc application).Cng ty Tinh Vn Lu hnh ni bS trang : 22/78 23. Effective Software Testing11/4/2013Khng th s dng 75% thi gian test phn lp chc nng bi v chc nng chnh cn test l test giao din ngi dng. Theo l thuyt th kch bn GUI s c cp nhiu v n dng nh thnh thi quen t khi b b qua. Nu khng th iu cn thit l phi thc hin phn lp chc nng (test business level). Chng hn nh t l cn xng l 75/25 cho test GUI v business-layer testing c th yu cu 2 phn test GUI v 1 developer test business-layer . Thm vo , testers test theo vng s s dng tt c cc k thut test ph thuc vo qui m v phc tp ca cc application ( test t ng s c bn n trong chng 8) Low-level testing c th khng cn thit ti 75% ca application cho cc record chun v cc m hnh update cc record. Tuy nhin, test GUI yu cu a ra cc b d liu trng hay nhng thiu xt ca mn hnh ti giao din . V d trn gii thch c rng iu quan trng l ti sao chin lc test phi quan tm ti ri ro, s phc tp v cc yu t cn thit. y khng phi l iu cng nhc, tuy nhin, mi mt d n yu cu s phn tch ring ca d n . Chn la k thut test. Vic thu hp cc kiu k thut test nhm gip gim bt s kt hp v a dng ca cc d liu u vo. Cc k thut test rt a dng v n phi c xc nh nh mt phn ca chin dch test. Mt vi k thut test s c bn n trong chng 5. Chn la cng c test. Khi chin lc test c a ra, testers phi xc nh cc cng c test c s dng, bao gm test th cng hay test bng cc tool no? Nu cn thit s xy dng nn mt tool ring thay v phi mua test tool . Chng 7 s bn v cc cng c test t ng. Tin hnh vit kch bn v khai thc cng c test. Ngi thit k test nhng g s quyt nh pht trin cc cng c test t ng. H s a ra cc kin thc v test th cng v cc loi cng c test t ng hin c trn th trng. Nu cc thao tc test khng th thc hin bng tay th tin hnh vit kch bn v khai thc cc cng c test t ng trn nhng kch bn vit . Xc nh nhn lc v kinh nghim yu cu. Cn c vo chin lc test phc tho s c c yu cu v nhn lc v kinh nghim ca c nhn cn c. Nu nh mt phn chin lc test phi s dng cng c test t ng th buc phi c ngi hiu v cng c test t ng . V iu cn thit t ra l cn phi c c nhng ngi test v lnh vc c bit , hay cn hiu l test su v nghip v. Cng ty Tinh Vn Lu hnh ni bS trang : 23/78 24. Effective Software Testing11/4/2013Nu nhm test khng c cc k nng test tt th s gy nguy him v nh hng ti s thnh cng ca phn mm . iu ny s c bn n trong chng 3. Xc nh phm vi test. Testers phi hiu c phm vi cn test l nhng g. Trong mt vi trng hp, v d c th c vn bn xc nhn, trong lit k tt c cc chc nng c yu cu test hay phm vi test. Trong mt s trng hp khc th testers phi t xc nh phm vi test, ngun lc test, lch test, cng c test, ri ro, cc phn khng cn test. Trong , u tin testers phi th hin bng ti liu nhng phn cn test v nhng phn c th b qua, khng cn test. Thit lp nhng phn, nhng tiu chun c loi b. Vic xc nh phm vi test c lin quan mt thit ti vic xc nh cc tiu chun tn ti. Release criteria ch ra rng cng vic test phi c coi nh hon thnh, do , iu quan trng l chng phi c th hin di hnh thc vn bn trc . V d, Tiu chun loi b c th l nhng phn c rt t li v li l rt nh. Bt k khi no th cc li nguy him hay nhng li lm cho chng trnh khng chy c phi c fix trc khi xc nh loi b nhng phn no. Nhng phn c th b qua khc c th c xc nh r rng vi nhng chc nng c u tin mc cao. Lp lch test. Chin lc test phi c xc nh trc xc nh n lc test. Lp lch chi tit cho vic test l rt quan trng trnh vic thc hin chin lc test khng ng nh yu cu t ra. Quan tm ti cc giai on test. Cc giai on test khc nhau p dng cc chin lc test khc nhau. V d, trong sut giai on test chc nng ca chng trnh, vic kim th cc chc nng xem n c hot ng c khng. Vy, k hoch t ra chin lc test p dng cho giai on no ca h thng. Hiu cc giai on test l rt cn thit a ra cc chin lc test cho mi giai on. C vi vn cn c quan tm khi a ra chin lc test. Nu khng c thi gian hiu h thng mt cch tng tn th hiu c ri ro ca d n l rt kh khn, m iu ny li rt quan trng khi xy dng chin lc test. Kch bn ri ro phi c lp trc v cn c qun l. khc phc c vn ny th nhm test phi u tin cho nhng yu cu v ri ro c hu trong mi giai on. Nhm test phi xem xt li cc chc nng chun v cc phn ri ro cao ca h thng, v quan tm ti cc thng tin ny khi xc nh mc u tin cho cc yu cu cn test. Cng ty Tinh Vn Lu hnh ni bS trang : 24/78 25. Effective Software Testing11/4/2013Khi xc nh th t cc phn cn test, nhm test nn xem xt li cc yu cu m bo rng phn no cn c u tin, k t cc chc nng chun nht n cc chc nng khng chun nht. D liu u vo ca ngi dng cui cng c xc nh lin quan cht ch ti s quan trng ca chc nng. Danh sch cc yu cu u tin nn c nhm test lit k c th. Thm vo , cc phn u tin ca cc chc nng rt c ch nhm cc yu cu thnh cc nhm chc nng lin quan hay thnh cc kch bn, cc lung cng vic. b. Danh sch cc cc tiu chun di y nhm xc nh th t cc nhm yu cu da trn yu cu ca Rational Software Corporation. Mc ri ro. Sau khi nh gi ri ro, yu cu test u tin c a ra nhm m bo gim mc ri ro cho cho h thng. Cc khon mc c ri ro cao c th l nhng chc nng nhp m khng cho nhp d liu vo h thng, v d, cc nguyn tc lm vic c th lm ph v cu trc d liu hay kt qu l vi phm cc nguyn tc . Tnh cht hot ng. Mt s yu cu test c sp xp theo th t u tin bi v chng c p dng cho cc chc nng thng xuyn c s dng hay nhng phn kin thc b thiu ht ca ngi s dng cui cng. Cc chc nng gn lin vi cc ngun lc k thut hay nhng ngi mi bt u s dng hay nhng chc nng khng c thng xuyn s dng n th s ng cui cng trong th t u tin. Yu cu ngi dng. Mt vi yu cu test c tnh cht quan trng, nh hng ti s chp nhn ca ngi dng. Nu vic test khng nhn mnh vo cc yu cu ny, kt qu phn mm s gp li hoc t cng ty sn xut phn mm trong tnh trng khng c li v mt ti chnh. V iu quan trng l n nh hng trc tip ti ngi dng cui cng v s nh hng ti khch hng tim nng ca cng ty trong tng lai. Ngun lc sn c: Yu t u tin trong test Procedure l ngun lc sn c. Nh tho lun trc , thit k test c s rng buc, bao gm gii hn nhn lc tham gia test, gii hn phn cng v tnh i lp ca cc yu cu ca d n. y l qu trnh kh khn ca vic tho hip thc hin. c. Hu ht ri ro xy ra do cc nguyn nhn sau.Cng ty Tinh Vn Lu hnh ni bS trang : 25/78 26. Effective Software Testing11/4/2013 Thi gian hon thnh phn mm ci t cho khch hng ngn. Thi gian d n nn dnh nhiu hn cho pha lp trnh. Nh cp trc , ngn sch v thi gian xc nh cho 1 d n rt kht khe, trong k hoch pht trin, khng c thi gian cho cho nhn lc test, m vic hon thnh v ci t 1 phn mm cho khch hng ch thng qua vic tham kho kinh nghim hay nhng k thut o lng hiu qu khc. Mt ngi qun l test tt cn hiu mt cch chc chn, nhanh nhy v h thng khi thi gian xy dng h thng c gii hn. Chin lc test phi thch hp, va khp vi thi gian c cn sn. Nu c vn cp thit th cn ch ra ngay lp tc cn iu chnh chin lc test hoc chp nhn ri ro ca h thng nu khng c thi gian dnh cho vic test. Qui trnh thit k mi. Gii thiu v qui trnh thit k mi, bao gm cc cng c thit k, k thut thit k v ri ro gia tng. Cng ngh mi. Nu cng ngh mi c thc hin, ri ro xy ra l c th cng ngh khng chy c. N s hiu lm yu cu, hay thc hin khng ng cc yu cu, m cng c th cc yu cu s b chp v. S phc tp. Vic phn tch cc ti liu test phi c thc hin xc nh chc nng no l phc tp nht v tp trung tm kim li trong chc nng v cc phn khc chu nh hng ca li nh th no. Nhm test ln tp trung vo chc nng . Mc s dng thng xuyn ca ngi dng. Cc chc nng thng xuyn c s dng lun tim n li (li ca h thng) v c kh nng ri ro cao nu phn ny b li. V vy, phn no ngi dng s dng nhiu cn c test k hn. Cc yu cu khng test. Cc yu cu chc nng v phi chc nng nu khng c test (b b xt) th ri ro h thng khng thnh cng l rt cao. Tuy nhin, nu nhm test kim tra, nghin cu cc yu cu ny trong giai on nghin cu c t yu cu ca phn mm (c xem xt trong chng 1), th nhng ri ro ny l nh nht. Khi ri ro xy ra, chng ta cn nh gi, sau tm cch khc phc nhm gim ri ro. Vic nh gi ri ro quan tm ti kh nng, xc sut xy ra ri ro v s dng mt vi m hnh nhn din ri ro cng nh ln chin lc gim ri ro. Tm quan trng v mc Cng ty Tinh Vn Lu hnh ni bS trang : 26/78 27. Effective Software Testing11/4/2013nh hng ca ri ro cng cn c nh gi. Chin lc gim ri ro nn c xc nh cho cc yu cu c kh nng xy ra ri ro cao nht. Thng th chng trnh cho php cha mt vi li, nhng cc li ny t khi xy ra do ngi dng t khi s dng. Vn kh khn l lm cch no nh gi ri ro mt cch chi tit nht. Mi ngi nn tp trung ng gp cho qu trnh nh gi ny, ngay c nhm di din khch hng(qun l sn phm) , ngi dng cui cng, cc c t yu cu, pha lp trnh, testers v QA. Mc ri ro cn c thng bo, a ra cho mi ngi cng bit cng c quyt nh gim thiu, ngn chn chng. Nu ri ro qu cao, h thng rt c th khng chy c, b tm ngng hay gin on. Phn tch ri ro a ra cc thng tin h tr test manager hay test leader ra quyt nh thch hp nh phn cng nhn s test c kinh nghim, c k nng tt nhm test k trnh, gim ri ro. Sau khi nh gi ri ro, xc nh c cc yu t dn n ri ro l g, v ri ro c th xy ra l g, cc phn b nh hng. T , a ra hng gii quyt. Chin lc gp phn gim ri ro: Test engineer hay test manager cn xc nh cc phn ri ro nht, cc phn c th c nhiu li nht, v tp trung vo chng. Mt khc, phi xc nh cc vn , cng vic cn lm gim ri ro, v mc nh hng l nh nht. Vic kim tra cn thn cc mc tiu cn t, ri ro l cn thit nhm a ra chin lc test hp l. 2.3. Xc nh n lc test cn tnh n thi gian b sung cc chc nng ca phn mm. Vic thc hin cc tnh nng ca phn mm phi c tnh u tin. S u tin ny da vo yu cu ca khch hng hay s cn thit phi a ra c cc yu t ri ro u tin. Tuy nhin, k hoch test v k hoch pht trin khng ch da vo tnh u tin v mc ri ro m cn da vo thi gian b sung cc tnh nng ca phn mm c th test tip v hon thnh cng vic test ca 1 d n. iu quan trng l thi gian b sung cc tnh nng ca phn mm, bao gm thi gian b sung cc chui hnh ng c lin quan ti qu trnh test, do vy, trong k hoch test cn c thi gian cho vic test b sung ny. Chng ta s thy tc dng ca vn ny hn trong vic thi gian test l c hn. Khng nn thay i thng xuyn lch ca cc tnh nng v nu c 1 thay i tnh nng dn n thay i trong k hoch pht trin hay k hoch test.Cng ty Tinh Vn Lu hnh ni bS trang : 27/78 28. Effective Software Testing11/4/2013Chc nng u tin l chc nng ch yu v c bit ca chng trnh. Trong hu ht cc trng hp, lch ca pha pht trin nn tp trung cho cc chc nng ch yu, quan trng u tin. Testers cng s test cc chc nng ny u tin. a. Danh sch cc chc nng u tin test trc da vo cc tiu chun khc nhau: Gim ri ro: Nh tho lun, chng ta cn quan tm n mc ri ro c xem xt trong k hoch pht trin v chin lc test ra sao. Cc chc nng c ri ro cao th cn u tin v tn nhiu n lc hn. Gim phc tp: C pha pht trin v test c gng u tin thc hin chc nng c tnh phc tp nht. Nhng iu khch hng yu cu v cn thit. Khuynh hng ca hu ht cc d n phn mm u tin cho cc chc nng m khch hng yu cu v cn thit. Cc chc nng ny s c ly lm chun, ct li marketing v bn sn phm. Rng buc v ngn sch. Phn ln cc d n phn mm u vt qu ngn sch cho php i vi phn mm . iu cn quan tm l phi ch trng vo ngn sch dnh cho pha test khi test cc chc nng u tin. V cc chc nng ny mang tnh quyt nh s thnh cng ca phn mm. Rng buc v thi gian. Vn cn quan tm l s rng buc v thi gian khi test cc chc nng c tnh u tin khng c quan tm ng mc, khng c qun l r rng. Rng buc v con ngi. Khi lp lch cho cc chc nng u tin th ngi lp lch nn ch , quan tm ti nhn lc c sn. Nhng ngi ch cht s thc hin test cc chc nng ny s m bo khng b xt trng hp v thi gian v mt s vn khc l c gii hn v b rng buc. 2.4. Lu li phn mm trong tr nh. Khi ln k hoch test th tester phi hiu c cc vn sau ca phn mm: Bn Beta hay bn trc khi ci t chnh thc cho khch hng. Nhm pht trin s b sung cc chc nng cn thiu vo cc bn Beta vi cng ngh ring r. Nhng khi test th phi test chng trn nhiu cng ngh khc nhau a ra nh gi cho pha pht trin cng sm cng tt. Cng ty Tinh Vn Lu hnh ni bS trang : 28/78 29. Effective Software Testing11/4/2013 Cng ngh mi hay cng ngh sc bn. S b sung, thay i cng ngh d dn n s sp h thng. Trong mt s trng hp cng ngh mi c th gy ra nhiu vn v phi lp trnh li. V d, mc ch ca lp trnh l thc hin 1 gii php s dng phin bn Beta nhng khi phin bn ny ra i, th vic thay i cng ngh ng ngha vi vic phi thit k, cu trc li h thng. M iu ny c ngha, h thng cn phi test li, n lc test tng ln. Thc hin cc giai on. u tin thc hin phin bn u tin ca h thng v cc chc nng c sn. V d, h thng phi tr ra giao din ngi dng khi nhp d liu vo v giao din ny phi c d liu nu d liu l hp l. K hoch test phi a ra cc iu kin la chn khc nhau cho vic x l v lu d liu. Li. Li c th c pht hin t 1 trong nhng phn c vn v test Procedure khng th thc hin ton b tt cc tnh hung c th. Trong giai on cu trc h thng, phi u tin vic tm ra cc li nu h thng c nhiu li sa. vn dng mt cch thch hp, ng n gii php ny, cn c s trao i gia testers v lp trnh sa ngay li khi pht hin. Phn mm ng gi hay tng phn. Bn cung cp phn mm c trch nhim cp nht chnh xc cc phin bn v gii thiu v cc chc nng mi. Nu h thng cha c test s thiu tnh chn thc khi cp nht cc thng tin v chng trnh. Do vy, trong k hoch test cng cn xc nh n lc cho cc ln test cc phin bn mi. V d, khi mt phin bn mi ra i, nhiu ngi s cp nht phin bn mi ny. Nu phin bn mi khng c test s khng m bo n tt hn ci c. 2.5. B d liu test hiu qu. Trong sut qu trnh thit k chi tit cc test procedures ( c ni n trong phn 3), d liu test cn c kt hp cht ch trong cc test cases, hay ni cch khc n c to thnh mt vng quay d liu. Chin lc test hiu qu yu cu c b d liu cn thn. S l khng hiu qu nu test chc nng vi b d liu ngho nn. Ngc li, vi b d liu tt gip nng cao hiu qu ca vic test chc nng, gim n lc test. Khi cc yu cu ca khch hng cn m h th vic chun b b d liu chun s gip khch hng tp trung, hiu r cc giao dch, thao tc m h cn.Cng ty Tinh Vn Lu hnh ni bS trang : 29/78 30. Effective Software Testing11/4/2013Mt b d liu chun v ti liu thit k test chi tit c ch rt nhiu cho pha pht trin. Thm vo , b d liu chun cn cho thy cu trc ca d liu, thnh phn ca b d liu chun, nguyn tc s dng v nhng thng tin hu ch khc. Ti liu thit k, gin database c bit cng c th gip xc nh cch thc nh hng ca h thng ti database ra sao. Khng th test ht s kt hp gia cc b d liu u vo v u ra. Tuy nhin, cc k thut test cng gip gim bt cc b d liu u vo v ra v s kt hp gia chng. S kt hp lung d liu trong cc test case, gip cho vic xc nh ng dn cho cc d liu ny. Test iu kin bin l mt k thut test khc. D liu test c chun b cho tng gi tr bin (gii hn s lng v ni dung d liu, thit t trong phn thit k h thng). H thng thng thay i gi tr bin ca chng. Li thng xy ra phn gi tr bin nn vn l phi c k thut xc nh ng c cc gi tr bin. Cc gi tr bin nn c lit k thnh 1 danh sch trong ti liu c t yu cu. V d, h thng s cho php nhp liu gi tr t 1 n 100 trong danh sch cc quyn la chn. Trong v d ny, cc gi tr cn test l 101, 99, 100 v 1, khng nhp gi tr no v gi tr 0. Khi gi tr bin khng c m t trong SRS, khi lp k hoch test, phi tm hiu h thng v a ra cc gi tr bin cn test. V iu ny li rt ph bin. Lp trnh thng khng xc nh c gi tr bin cho n khi chng trnh c test v tester trao i li. C cch kim tra pht hin gi tr bin ca chng trnh l s dng cc prototypes. Chiu su ca vn . Nhm test cn quan tm ti dung lng database. Nhm test cn xc nh 10 bn ghi hay cc bng d liu thch hp, hay 1000 bn ghi cn thit kim tra dung lng database. Vic test c thc hin cc giai on khc nhau v cc kiu test cng khc nhau, do vy, nn tng dung lng database vic test hiu qu. V d, vic test performance v test volume thc hin c vi 100 bn ghi nhng cha khng nh chc chn rng, database cha c 1000.000 bn ghi. (Xem thm chng 9 hiu r hn v performance testing). S a dng Ngi thit k test phi tng hp cc yu cu thay i v th hin n thng qua cc gi tr ca d liu (v d, 10.000 trng khc nhau cha cc gi tr d liu khc nhau v cc kiu trng khc nhau th cha cc kiu d liu khc nhau). Mt ngi thit k test tt s tnh ton c s thay i ca d liu v bit c khong d liu tng t nhau cng cho ra 1 kt qu mong i.Cng ty Tinh Vn Lu hnh ni bS trang : 30/78 31. Effective Software Testing11/4/2013Testers cn quan tm ti cc bn ghi cha cc d liu khc nhau. V d, gi tr ca 1 trng c th cha gi tr m hay cc gi tr nh (v d 100$), gi tr trung bnh (v d 1000$) hay gi tr ln (100.000$) v rt ln (10.000.000$). Testers cng cn quan tm ti cc kiu d liu khc nhau. V d, ti khon ca khch hng ti ngn hng cn phn bit theo nhiu cch khc nhau, bao gm, ti khon tit kim, ti khon thanh ton sc, ti khon cho vay.. Phm vi. Phm vi d liu test cn thch hp m bo tnh chnh xc, cc mi lin quan v mc hon thnh ca d liu. V d, khi vic test nhm xc nh s a dng cc loi ti khon ngn hng, nh xc nh cc ti khon c gi tr ln hn 100$ th khng nhng cn test vic hin th c tt c cc ti khon c gi tr trn 100$ m cn test vic nhp thm d liu, v xem d liu nhp thm c c phn nh vo c s d liu khng. Vic hon thin d liu test m bo test c tt c cc d liu validate (cc d liu c s dng khi nhp vo c s d liu) v h tr vic nh gi kt qu ca sn phm. m bo tnh ton vn d liu trong sut qu trnh test. Nhm test phi m bo tnh ton vn ca d liu trong sut qu trnh test. Testers cn tch bch, phn chia d liu, sa d liu v quay tr li database xem trng thi ban u ca d liu. Nhm test phi ch , khi c nhiu ngi cng test 1 lc th d liu test ca ngi ny s nh hng n d liu ca ngi khc. V d, nu 1 ngi trong s sa d liu trong khi ngi khc ang test phn lin quan ti d liu th rt c th kt qu test ca ngi th 2 s khng nh mong i. Mt cch ngn chn s nh hng test ca tester ny n tester khc l s tch bch v database ca 2 testers hoc phn chia v cc file d liu ca mi tester. Mt cch khc l phn chia mi tester s thc hin test cc chc nng khc nhau trnh s chng cho v d liu. Cc iu kin. S thit lp d liu c to ra phn nh cc iu kin c bit trong cc vng d liu khc nhau ca h thng. iu ny c ngha l cc kiu d liu c thit lp ch sau khi thc hin cc thao tc c bit. V d, h thng ti chnh thng c kho li cui nm. C ngha, cui nm d liu c lu li, iu ny a ra trng hp test trng thi d liu cui nm m khng cn nhp d liu u nm (c cui nm th s liu c cht li, d liu cui nm nay l d liu u nm sau). Vic to ra d liu test c s liu cui nm khng b rng buc. khi , tester c th c d liu cui nm m khng cn nhiuCng ty Tinh Vn Lu hnh ni bS trang : 31/78 32. Effective Software Testing11/4/2013thao tc nhp d liu vo trng thi cui nm (h thng t tnh ton v a ra con s cui nm). xc nh c cc d liu test theo yu cu, cn lit k bng danh sch cc d liu trong 1 ct v yu cu test d liu trong ct khc. Gia cc yu cu, iu quan trng cn ch ti ln v di d liu cn thit. Trong khi mt nhm t d liu thch hp, hiu qu cho vic test chc nng, nhng test c hiu nng th li cn s lng d liu rt ln. nhp c mt s lng ln d liu c khi phi mt vi thng. Nhm test cn c k hoch v nhn lc, thi gian t c, to ra v pht trin d liu test. C ch cho vic lm mi database c c trng thi ban u m bo cho vic test tt c cc tnh hung (cho c vic test li), cng phi c xem xt v a vo cc ti liu k hoch test ca d n. Testers phi xc nh tn v khu vc database thch hp test. D liu thng c chun b trc khi test. Vic chun b d liu c th lin quan ti vic x l d liu th dng text hay file, kim tra tnh chc chn ca d liu v phn tch b su cc yu t d liu. Bao gm nh ngha d liu test cho cc test case (cc tiu chun nh x), lc cc nh ngha v cc yu t d liu. Xc nhn li cc yu t chnh, nh ngha cc tham s d liu cho php nhp. chun b d liu, cng nh chun b cc kch bn pht trin v kch bn test, nhm test phi vo trong database v sa nhng g cn thit. Da vo iu ny, chng ta thy rng s tn ti cc d liu c sn m khng phi do 1 tester no nhp vo khi test, iu ny bao hm c s bin i ca d liu. im thun tin ca d liu tu thch l c th kt hp v s dng cc mu d liu khng c trong phn nhp vo ca tester . 2.6. K hoch cho mi trng test. Mi trng test bao gm tt c cc yu t h tr vic test nh d liu test, phn cng, phn mm, mng v cc iu kin khc. K hoch v mi trng phi xc nh ai v my ngi a ra vic tip cn mi trng test, v ch nh s lng y my tnh cung cp cho cc c nhn ny (Vic tho lun gia cc thnh vin trong nhm test c tho lun trong chng 3). Trong chng ny, thut ng production environment lin quan ti mi trng thc hin ca phin bn phn mm cui cng. Mi trng ny c ci t t my n n tt c cc my trong mng internet. Trong khi test unit v test tch hp c thc hin bi mi trng ca pha cc lp trnh vin th test h thng v test ca ngi dng cui cng c thc hin bi vic thit lp mi trng test ring bit. Mi trng ny c cu hnh ging vi khi ci t cho khch Cng ty Tinh Vn Lu hnh ni bS trang : 32/78 33. Effective Software Testing11/4/2013hng, hay ni cch khc, n m bo chng trnh s chy tt. Cu hnh mi trng test phi i din c cho mi trng ca phin bn cui cng i ci t cho khch hng bi v mi trng test phi l bn sao ca cu hnh c s ca production environment m ra cu hnh lin quan c th nh hng ti h thng nh phn mm k vi phn mm ang test, cc nhm v cc phn b firewall. Tuy nhin, Cu hnh bn sao mt cch y ging ht vi cu hnh ca production environment thng khng thc hin c do s rng buc v ngun lc v chi ph. Sau khi c cc thng tin v mi trng test v cc thng tin khc lin quan ti cng vic test, nhm test phi bin tp c cc thng tin v chun b ngun lc thit k mi trng test nh sau: M t kt qu t c t mi trng test tu thch, bao gm cc phn mm h tr, phn cng ..M t phn cng bao gm cc yu t nh phn gii ca video, khon trng ca a, tc x l v cc thng s v b nh, cng nh cc thng s my in (bao gm, loi my in, cng sut, ) Xc nh mi trng test nh a, a ghi CD (CD-R) cho php lu tr cc file c kch thc ln (cc file ny c ghi theo mt cch c bit trn h thng my clientserver). Xc nh c im ca mng trong mi trng tu bin nh s dng ng truyn thu, modem, kt ni Internet, v cc giao thc nh Ethernet, IPX, v TCP/IP. Trong trng hp client-server hay Web-based system, xc nh cc thng s m server, database v cc thnh phn khc yu cu. Xc nh cc test tool v cc licenses cn yu cu. Xc nh cc phn mm khc cn c thc hin test nh cc b x l word, cc bng tnh v cc phn mm v bo co. Khi xc nh mi trng phn cng cn thit test, cn quan tm ti cc yu cu v d liu test, bao gm, ln ca database. iu quan trng m bo my mc c cng sut v ngun lc ci t d liu l dung lng da v kt ni mng sn sng. Quan tm ti cc ngun lc c bit cn thit cho vic cu hnh test nh chuyn cng v phn mm x l nh. Theo cc yu cu chun b trn, nhm test pht trin mt mi trng test bao gm cu trc mi trng thit k ho vi mt lot cc thnh phn c yu cu h tr cho cu trc trn. Danh sch cc thnh phn h tr trn cn c xem xt c th thay th c, c th di chuyn t vng khc sang v phi mua c. Cng ty Tinh Vn Lu hnh ni bS trang : 33/78 34. Effective Software Testing11/4/2013Danh sch cc thnh phn c th mua c bao gm danh sch cc thit b test c th mua c. N lit k s lng cc yu cu, gi n v, chi ph bo hnh bo tr. Nhm test yu cu 1 s phn c th backup m bo thao tc test tip tc nu phn cng khng p ng.2.7. c lng thi gian chun b test v thi gian thc hin test. Trc khi hon thnh k hoch test v chin lc test tt nht, iu cn thit l c lng thi gian ca pha pht trin hon thnh code. Theo d liu lch s, n lc ca pha pht trin chim nhiu nht so vi n lc ca ton b d n. Thi gian cn cho vic m bo cht lng phn mm cn xc nh trong thi gian ca d n, c th l thi gian dnh cho test phn mm, thi gian test thng c c lng thng qua thi gian bit trc ca pha pht trin hay ca ton b d n. Tuy nhin, vic test c th thay i (thay i cc phn cn test .)nn thi gian test thng khng c c lng ng theo cch ny. C rt nhiu yu t nh hng ti n lc test cn c c lng. N lc test p dng cho d n c bit ph thuc s lng cc bin s nh hng. iu ny ph thuc cch thc t chc v ngy ht hn test, s phc tp ca phn mm, phm vi test, k nng ca c nhn thc hin test. Cc iu kin ny c coi nh u vo cho vic xc nh thi gian test cho mt module. Tuy nhin, vic a ra nhiu yu t nh hng n n lc test nhm a ra phng trnh xc nh thi gian thc hin test nhng iu ny cng kh phc tp. V ngi ta thng c lng thi gian test theo cch n gin hn. Vi tng ny, thi gian test lun c c lng bt u bng vic xc nh cu trc phn tng cng vic ( work breakdown structure (WBS)) hoc danh sch cc phn test chnh c xc nh da vo cu trc phn tng cho test. c hiu qu nht, phng php c a ra y phi p ng c c qu trnh v s cn thit m cng ty cn t c. a. Phng php t l vi pha pht trin. Xc nh n lc test da trn n lc ca pha pht trin c gi l Development Ratio Method. Phng php ny nhanh v d dng cho vic o lng n lc test. Thut ng developers trong trng hp ny bao gm cc c nhn c ch nh thc hin thit k, vit code v test unit. Cng ty Tinh Vn Lu hnh ni bS trang : 34/78 35. Effective Software Testing11/4/2013Kt qu ca phng php l a ra t l ph thuc ca n lc test da vo n lc pha pht trin, v c trnh by bng 12.1. T l trong bng 12.1 c p dng khi phm vi test lin quan ti vic test chc nng v test hiu nng ca giai on test tch hp v test h thng. Ch rng t l cc thnh vin test so vi cc thnh vin pha pht trin ph thuc vo loi v phc tp ca phn mm. V d, khi pha kinh doanh k c 1 hp ng ln th cn tng n lc test. Khi ny, t l testers so vi deverlopers tng (nu coi cc yu t nh hng khc khng thay i). Ngc li, t l ny s nh hn. Thm vo , thi gian ca qu trnh pht trin phn mm c th thay i nn t l ny cng phi thay i theo. Trong sut giai on test sau , khi lch test qu kht nhau hay deadline ca test sp n th developers, PQA, v PM cn gip testers. Trong tnh hung ny, t l ca testers so vi developers s tng, thm ch s testers cn nhiu hn developers. T l thc t thc hin s da vo ngn sch sn c v ph thuc ngi ra quyt nh, s pha tp ca phn mm, hiu qu ca vic test v nhiu yu t khc na. Bng 12.1. Thi gian test da vo pha pht trin. Loi sn phmS lng T l ca Developers v S lng Developers Testers TestersSn phm thng mi (th trng ln) Sn phm thng mi (th trng nh) Tch hp v pht trin cho my client Cc phn mm cho Chnh Ph, Nh nc (trong nc) Phn mm cho cc t chc trong nc303:220303:110304:17305:16304:17Note: T l trn s khc v n cn ph thuc phc tp hay phn mm c t li b. Phng php t l gia cc nhn vin trong d n. Cch khc c lng thi gian test l da vo t l nhn vin tham gia d n . Phng php ny c chi tit bng 12.2. Phng php ny da vo s ngi tham gia Cng ty Tinh Vn Lu hnh ni bS trang : 35/78 36. Effective Software Testing11/4/20131 d n, bao gm tham gia kho st yu cu khch hng, cu hnh h thng, qun l qui trnh (PQA), deverlopers v QA tnh ton s ngi v thi gian test. Phng php ny c gi tr c bit khi s ngi thc hin cng vic pht trin thng xuyn thay i hay rt kh xc nh s ngi tham gia pht trin. Trong vic tnh ton s ngi test trong bng 12.2, gi thit l phm vi n lc test bao gm c vic nghin cu SRS, test cu hnh h thng, test qu trnh x l lin quan, test chc nng v test hiu nng ca giai on test tch hp ve test h thng. Vic chn con s 50 trong ct "Project Staffing Level" nhm n gin ho vic tnh ton gi tr ca ct "Test Team Size". column. Tt nhin s lng ngi tham gia d n c th t hay nhiu hn. Bng 12.2. S Tester c tnh ton da vo s lng nhn vin ton d n. Type of Produces Project (Loi sn phm) Staffing Level (s nhn vin tham gia d n) Sn phm thng mi 50 (th trng ln) Sn phm thng mi 50 (th trng nh) Tch hp v pht trin 50 cho my client Cc phn mm cho 50 Chnh Ph, Nh nc (trong nc) Phn mm cho cc t 50 chc trong ncTest Team SizeS Testers271316814711514lng7c. Phng php test procedures. Cch khc o lng n lc test l s dng khi lng chng trnh test o lng, c th hn l da vo s lng test procedures ca d n c lp k hoch o lng. Phng php ny c phn b hn ch do ph thuc vo s lng test proceduresCng ty Tinh Vn Lu hnh ni bS trang : 36/78 37. Effective Software Testing11/4/2013ca d n m khng tnh n cc nhn t nh hng ti n lc test. Phng php ny l s kt hp vi 1 phng php trong hng lot cc phng php khc. p dng c phng php ny, cc Test Procedure ca d n cng nh qu trnh thc hin d n cn c ghi li ngay t u c d liu nh gi, nh vic ch ra cc chc nng, s lng test procedures s dng v kt qu n lc test c o lng vi n v l s gi/1 tester Tr s qui m pht trin c ti liu ho di dng nhng dng m lnh (lines of code (LOC)), nhng dng m lnh tng ng, hm con tr, s lng cc i tng c pht trin. Nhm test xc nh cc yu cu v mi lin h gia cc tr s qui m phn mm trc v s lng cc test procedures c s dng trong cc d n . T , chng ta tnh ton v c lng c s lng cc test procedures cho d n mi. Tip n l nhm test xc nh mi lin quan gia s lng cc test procedures v s gi mi tester cn c da vo kinh nghim t cc d n trc. Phng php c lng ny thnh cng nht khi cc d n so snh vi nhau c s tng t v bn cht, cng ngh, yu cu v s thnh tho, cch thc gii quyt vn v cc nhn t khc. Bng 12.3 trnh by v d v vic xc nh s gi test p dng phng php Test Procedure (gi thit, d n c 1.120 test procedures). Nhm test xem xt n lc test ca 2 hoc nhiu hn 2 d n c trung bnh 860 test procedures v cn ti 5.300 gi cho vic test. Trong n lc test ca cc d n trc , s gi test trn mi test procedure l 6.16 gi l hp l (cho ton b vng i ca d n). D n cn 5.300 gi thng ko di 9 thng, trong , cn 3,4 thng thit k test. Cng vic by gi l xc nh s gi test cho d n mi c 1.120 test procedures.Bng 12.3. c lng thi gian test da theo phng php TestProcedureCng ty Tinh Vn Lu hnh ni bS trang : 37/78 38. Effective Software Testing11/4/2013iu quan trng phi xc nh c mi lin quan gia s lng cc test procedures v phm vi cc yu cu cn test. u im ca phng php ny l xc nh c yu cu test v phm vi test sm hn so vi 2 phng php trn. Nhng nhc im ca n l thi gian c lng c tnh trc khi hon thnh xong c t yu cu ca khch hng. d. Phng php k hoch cng vic. Phng php khc c lng n lc yu cu ca chng trnh lin quan ti vic xem xt con s lch s v n lc test tng t. Phng php ny khc so vi phng php Test Procedure ch n tp trung vo cc task ca cng vic test. Bng 12.4 l 1 v d v vic c lng n lc test cho 1 d n c 1.120 test procedures da vo d n c 860 test procedures, cn 5.300 gi cho c d n v 6,16 gi test cho 1 test procedure( V d ny tng t v d khi s dng phng php Test Procedure trong bng 12.3.)Bng 12.4. c lng n lc test da theo phng php k hoch cng vic test (cc task cng vic test)Cng ty Tinh Vn Lu hnh ni bS trang : 38/78 39. Effective Software Testing11/4/2013 Gi thit:Nhm test cn xem xt cc con s ca cc d n trc chia s gi thc hin thnh cc task cng vic hay gi l cc giai on test. Tm li, s gi ca mi giai on test c trnh by trong bng 12.5.Bng 12.5. Xc nh s gi ca mi giai on test theo phng php k hoch cng vic.Cng ty Tinh Vn Lu hnh ni bS trang : 39/78 40. Effective Software Testing11/4/2013 a ra c cc con s ny, nhm test phi c lng ngay t khi d n mi c bt u (nu khng c cc con s ca d n trc th vic c lng thi gian cho mi giai on test s da vo kinh nghim ca ngi lp k hoch). Trong v d trn, d n mi c s dng cng c test t ng v vic a ra bc 3 v 4 l khng cn thit. Nhm test cng cn thn trng v d n khng c ngn qu dnh cho vic thc hin ci tin qui trnh test, v vy khng c bc 11 trong bng trn. Bc tip theo trong bng 12.6, tnh ton, c lng n lc nhm test da vo s iu chnh s gi 6.403. N lc nhm test c c lng tng ng l 3,1 testers vi 1 d n 12 thng. Nhm test s b tr chnh xc l 3 testers lm ton thi gian (100%) trong khong thi gian test xc nh. Cc testers phi tp trung test trc cc phn c ri ro cao. V chin lc test cn c iu chnh theo n lc va tnh ton trn. Nhm test c th b tr nhn lc test theo cc cch khc nhau, c th b tr ton thi gian ca 1 tester cho d n hay phn on thi gian nh 80% thi gian tester 1 v 80% tester 2. Bng 12.6. N lc Test da vo c lng thi gian ca nhn vin.Cng ty Tinh Vn Lu hnh ni bS trang : 40/78 41. Effective Software Testing11/4/2013e. Cc phng php khc. Trong cc tnh hung c bit, cn c vo kinh nghim xc nh n lc test m khng cn quan tm ti cc phng php. V d, khi s dng phng php t l tester so vi deverloper th khng nhn mnh c thi gian test trong cc d n trc . Do vy, khng nh ngha c qu trnh test, nn cn thit phi iu chnh t l ny. Tng t nh vy, khi p dng phng php k hoch cng vic, nu nhm test c t kinh nghim th rt d phi iu chnh cc task cng vic, cc nhn t nh hng. Cc nhn t nh hng ti vic c lng n lc test bao gm: Cch t chc. Phm vi test. C th test chc nng, test hiu nng v test giao din, test tnh bo mt, test tin ch (phm tt). K nng ca ngi thc hin test. Thnh tho cc cng c test. Khi s dng cng c test t ng s rt kh khn i vi ngi cha thc hin cng c bao gi, do vy, h cn c hc v tool . Mun s dng c cc test tool cn c kch bn test. iu ny l mi vi nhm test v h thiu kinh nghim hay thm ch khng c kinh nghim trong vit code. Hay thm ch, tester thnh tho vi 1 test tool ny nhng vi 1 tool khc th hon ton mi vi h. Kin thc v nghip v. Kin thc ca 1 tester v mt ng dng no cha su do khng phi h hiu tt c cc nghip v thuc tt c cc lnh vc. Cc kin thc cn c gi l "kin thc c th (domain knowledge) T chc nhm test. Chng 5 s trnh by k hn v cc loi t chc cng vic test. Phm vi chng trnh test.Cng ty Tinh Vn Lu hnh ni bS trang : 41/78 42. Effective Software Testing11/4/2013 Thi im bt u test K hoch test nn c bt u ngay khi d n bt u. iu ny c ngha l cc testers tham gia vo test d n s nghin cu, phn tch v thit k test cho d n . S tham gia sm ca tester khng nhng gip h hiu hn v yu cu cng nh thit k, cu trc h thng. T , xc nh c mi trng test hiu qu m cn sm pht hin ra li v ngn chn li ngay t giai on vit c t yu cu ca pha lp trnh (t c t ny s thit k chng trnh, v t thit k s vit code). S dng cc test tool. Vi nhiu hng phn mm chuyn nghip, vic s cc test tool gip gim n lc test, gim s phc tp khi lp k hoch test cng nh vic thc hin test. Ri ro ca phn mm cao. Nu mt phn mm c ri ro cao, c th c nhiu li m xc nh n lc test khng th dn n cht lng phn mm c xc sut ri ro cao. Cui cng, khi xc nh n lc test, cn quan tm ti cc yu t nh hng tnh n cc tnh hung c bit. Nhm h tr cho vic lp k hoch test, vic theo di s gi thc t ca mi task cng vic thng c s dng nht. Tuy nhin, vn i vi tt c cc phng php a ra l, rt t khi c 2 phn mm tng t nhau. Mt sn phm phn mm ph thuc vo phc tp, kinh nghim ca deverloper, cng ngh v nhiu yu t khc na.3. TEST PROCEDURE V THIT K TEST. Test Procedure v thit k Test l 2 cng vic quan trng ca nhm test. Nh ni chng s lng h s em ra khai thc, hai cng vic ny test ch c bt u khi phn mm c code xong, nhng nu 2 cng vic ny c bt u cng sm cng tt, v c th thc hin, tin hnh ngay khi ti liu c t yu cu c ph duyt. Khi ti liu c t v thit k h thng c sng lc, chn la k hay c lp li ( sa) ti liu hay thit k li th cc test Procedure cng s c hon thnh tng ng vi vic hon chnh ti liu v thit k cc chc nng ca h thng. Test Procedure mang li li ch r rng, gip chng ta t c ti ch nhanh chng v hiu qu. Qua ti liu ny s xc nh c l test black-box hay gray-box; nh dng cho ti liu ny, cc k thut test c chn l g. V d, nh s kim tra test bin,Cng ty Tinh Vn Lu hnh ni bS trang : 42/78 43. Effective Software Testing11/4/2013exploratory testing. Thm vo , kch bn test v cc test tool s gip chng ta t c ch mong mun. Trong vic nh gi cc yu cu v vic thit k phn mm i hi phi c hiu bit nhiu v cu trc, v vn ch cht u tin cn xem xt hay cc application c. V vy, cc testers phi chia v thc hin tng giai on, thao tc nh trong hng lot cc thao tc cn thc hin nhm m bo thc hin ng lch test v s tin ginh cho test. Nh vy, cc cu hi test ci g? test bng cch no? test nh th no? test khi no? v ai s test l cc cu hi cn c tr li trong chin lc test, phi chia nh thnh cc giai on nh, s dng cc k thut c bit v phi c mc u tin trong qu trnh test song song hay test lp. 3.1. S phn chia v thc hin test. Vi ti liu c t v thit k, cc testers sn sng lp ra v pht trin cc loi test Procedure. Khi phn mm c nhiu yu cu, quyt nh ni bt u lp v pht trin test Procedure dng nh rt kh. Phn ny mun a ra phng php gip chia nh cc giai on test. Trc khi thit k test, iu cn thit l phi quan tm ti cc giai on test cn thc hin. C s khc nhau gia cc giai on test nh test tin ch, test hiu nng, test bo mt, v cc giai on test khc nh test chc nng v test phi chc nng. Test phi chc nng s c bn n trong chng 9. Bc u tin trong vic thit k test Procedure l phi xem xt li k hoch test. Nu k hoch khng n c th hiu c cc tnh hung hay bn cht ca vn th s khng xc nh c mc tiu test, phm vi test. K hoch test cng lit k cc ngun lc tham gia qu trnh test nh cc tool h tr, cc phng php test, cc tiu chun test phi theo hay lch test. Nu k hoch test khng hp l hay khng c lp trc th cc thng tin v phm vi test, cc mc cn test .s phi ly t cc ngun khc. chia nh cc giai on test th phi tr li c cc cu hi sau: test ci g? test khi no? test nh th no? ai s tham gia vo qu trnh test? Nhng phn no cn test? Trong giai on lp k hoch test, phi xc nh ngay phn no cn test, phn no khng t xc nh c phm vi cn test. Khi no th test?Cng ty Tinh Vn Lu hnh ni bS trang : 43/78 44. Effective Software Testing11/4/2013Trong phn 3, chng ta a ra yu cu phi thit k test Procedure cng sm cng tt khi c ti liu c t. Khi xc nh c phn no cn no cn test, phn no khng th chng ta cn xc nh c trnh t test. Vy, vn t ra l ci g cn c test trc tin? Tester ln k hoch test phi bit c phn no c u tin test trc, phn no test cng nhau v t a ra lch test c th. Tin trnh test phi u tin cho mc cn test trc. Tr khi c ngoi l l cc chc nng chc chn cn c chy trc chun b cho cc chc nng khc. Nh vy, cc chc nng ny cn c u tin test trc hay khng? vn ny s c bn k hn trong cc phn, cc mc cn c u tin test trc trong phn 8). Thm vo , vic phn tch ri ro nn c tnh n khi xt n cc mc u tin ny. Nu khng phi test ton b chng trnh, cc testers ch cn quan tm ti cc phn cn test m thi. Vic phn tch ri ro a ra c ch xc nh nhng phn cn test v nhng phn c th b qua khng test. Test Procedure nn c thit k nh th no? Khng c bt k mt gii php n l no c th test ton b h thng mt cch hiu qu. Test Procedure cho cc phn khc nhau ca mt h thng cn c thit k thch hp, c bit cho cc phn c bit ca chng trnh. thit k test Procedure thch hp v hiu qu th iu cn thit l phi quan tm n cu trc h thng v tch hp h thng. V d, xc minh li cc chc nng ca h thng th c th thng qua giao din ngi dng. Test Procedure s da trn cc yu cu chc nng c trong ti liu, trong , cc test cases phi th hin y cc trng hp xy ra. Cc test cases s c bt u vi cc b d liu ng v b d liu khng ng cho test giao din xc minh li nh dng chun ca cc trng d liu u vo. iu ny lin quan ti mt chui cc thao tc kim th sau . V d, khi nhp d liu cho mt trng hay mn hnh ny li tr ra mt mn hnh khc m cng yu cu nhp d liu. Test Procedure phi thit k cho GUI testing hay back-end testing, hay c hai cn ph thuc vo chin lc test xc nh trc . GUI tests khc so vi back-end tests. Nhng ai s tham gia vo test? Khi xc nh c phi test phn no? v test khi no? test nh th no th s d dng xc nh c trch nhim ca tng ngi s test phn no da trn kh nng v kinh nghim ca cc tester. (xem phn 13). should develop the tests? Ngoi ra s c nhiu cu hi c t ra trong sut qu trnh lp v thit k test Procedure.Cng ty Tinh Vn Lu hnh ni bS trang : 44/78 45. Effective Software Testing11/4/2013 u khng c ti liu c t th test Procedure s c thit k ra sao? Nu khng c ti liu c t vit test case th iu cn thit c th vit test cases l hi ngi i din, ngi c trch nhim i vi cc yu cu hay nhn vin k thut hay nhng ngi review cc yu cu ca khch hng (nhng cc yu cu khng c vit thnh ti liu). V d nh hng dn ngi dng ca h thng hin ti (nu c) hay nhng ti liu hng dn ngi dng, c t yu cu ca cc h thng trc hiu tt hn v h thng ang thit k (xem phn 5 v nhng vn nguy him thng gp phi khi vic test phi da trn cc ti liu ca cc application tn ti. Nu nh c mt h thng c k tha, th phi c ti liu thit k ca n. Tuy nhin, nhng ti liu ny c th khng ng vi yu cu ca khch hng. Trong mt s trng hp, phi thc hin ngc li so vi thit k kim tra h thng, hay thc hin exploratory testing (vn ny s c tho lun phn sau) Black-box and gray-box Testing: Black-box and gray-box Testing c thc hin trong tt c b phn ca d n thng qua test giao din, v c gi l black-box. V d, nu mun thm mi mt ngi dng vo database th ngi dng ny s c insert vo database thng qua giao din ngi dng, various layersV d nh database layer, phn lp ngi dng, business-logic layers s c thc hin. Li thng th hin qua giao din ngi dng. (chng 4 s bn k hn v black-box and gray-box testing. Tuy nhin, trong mt s trng hp li khng c th hin qua giao din ngi dng bi v cc li ny thuc v c ch thng bo li ca phn mm. V d, khi mt application m khng thm mi c mt bn ghi vo c s d liu, nhng khng c thng bo trn giao din ngi dng th li ny l do code v khng hin th thng bo li trn mn hnh. Khi c giao din ngi dng, hay black-box, vic test khng th test ht li c. Do , graybox testing cng phi c p dng nhm tm ht ra li [1] Gray-box testing c ni n trong phn 16. Will a test harness have to be developed?. Mt s phn ca h thng ch c th test c bng cng c test. V d, Mt php tnh c th cho php kt hp cng mt lc hng nghn b d liu u vo. Vic test ny yu cu thit k test khc so vi test giao din hay black-box testing: Vi s lng u vo c kt hp cng vi s thay i ca d liu u vo qu ln v khng th test bng cch nhp nhp liu qua giao din ngi dng. Thi gian v cc vn cn quan tm, xem xt Cng ty Tinh Vn Lu hnh ni bS trang : 45/78 46. Effective Software Testing11/4/2013khc yu cu test phi s dng test tool tnh ton vi b d liu u vo ln th u ra ca chng l g? Vn ny s c ni k hn ti phn 37. Cc kiu k thut test c s dng l nhng kiu no? Cc kiu k thut test function rt a dng v c s dng test data v b d liu u vo. Mt kiu k thut test c th kim tra mt s lng ln s kt hp cc b d liu l orthogonal array testing. Orthogonal array testing cho php tp hp tt c s kt hp cc tham s chng t ch cn s lng test case nh nht nhng bao ph c ht cc trng hp xy ra.[2] Cc kiu k thut test khc gip thu hp c cc trng hp xy ra trong cng mt phn lp tng ng bng vic phn tch gi tr bin (xem phn 25). S kt hp cc k thut ny cho php gim s lng test case nhng vn m bo thng k y cc trng hp xy ra khi thit lp cc b d liu u vo. K thut test khc xy ra khi phi c s tham ra ca commercial off-the-shelf (COTS) tool. S pp li ca COTS tool vi gi tr tu thch c code s c kim th. V d, nu mt COTS tool c yu cu thc hin mt lnh SQL, khi test s phi chy cc kch bn chng t ni dung ca lnh SQL c sa l ng. Should a capture/playback tool or other testing tool be used? Mt capure/playback hay 1 cng c test khc nn c s dng nh th no? Khi mt test tool c khai thc, s dng test vic tnh ton lin quan t yu t k thut hay cc back-end functions khc, th cng c test t ng (capture/playback) s l hu ch cho GUI regression testing. Khi xc nh chin lc test yu cu phi xc nh cc phn ca application c test bng cng c test t ng. Cc phn khc khng cn test bng automated testing th khng nht thit p dng n, nguyn nhn ca vn s c tho lun trong phn 36. Which tests should be automated? Vic test t ng c thc hin nh th no? Ngi thit k test nn phn tch k, cn thn application khi a ra quyt nh p dng cng c test t ng hay test bng tay. iu ny gip trnh xa, loi b nhng chi ph khng cn thit. V ni chung test bng cng c test t ng th chi ph thng cao hn so vi test tay. Sau y l mt s v d p dng test t ng: o Vic test phi c thc hin nhiu hn mt ln:Cng ty Tinh Vn Lu hnh ni bS trang : 46/78 47. Effective Software Testing11/4/2013Ngc li, vic test ch c thc hin mt ln duy nht th vic s dng cng c test t ng l rt lng ph. o Vic test nhm nh gi cc iu kin ri ro cao. Cc nhn t ri ro t th khng nht thit phi p dng cng c test t ng. Chng ta quan tm ti test function ni ngi dng thc hin cc kch bn test c bit. V d, khi test, h thng cho php ngi dng thc hin cc hnh ng ny (do yu cu ca bn kinh doanh) nhng vic test chng khng th quan st ht, r rng bng trc quan. Ri ro lin quan ti cc kch bn ca loi test ny l thp nu s lng ngi dng l t. V khi mt hnh ng no khng n thun quan st c bng trc quan khi thit k test th cc ri ro xy ra l rt cao. o Tests thc hin trn nn tng, c s thng thng (Test that are run on a regular basis). V d, bao gm smoke (build verification) tests, regression tests, and mundane tests (tests n gin, test lp v lp nhiu ln). o Cng vic test khng th thc hin test tay. V d, Test t ng c thc hin khi cn kt qu u ra ca vic c 1000 ngi tip cn h thng trong mt thi im. o Test vi nhiu b d liu cho cng mt hnh ng (data-driven tests). o Baseline tests(danh gii test) c thc hin trn cc cu hnh khc nhau. o Test vi kt qu c th on trc. Khi ny, p dng cng c test t ng s mang li chi ph hiu qu. o Test xem s n nh ca h thng t n mc no. Vi functionality, implementation, v cng ngh khng thay i thng xuyn. Mt khc, s bo dng ca cc cng c test t ng s mang li cc li ch nhiu hn. What kind of test data is needed?Cc kiu test data cn thit l g. Trc y, cng vic test cha c phn chia mt cch r rt, cha th hin vai tr quan trng th vic test data c thc hin bng cch nhp cc b d liu u vo. iu quan trng l test data c chn la rt cn thn, nu test data vi b d liu u vo khng ng hay qu n gin c th dn n xt cc trng hp hay li s xy ra do vic test ch khng phi do chng trnh. Nh vy, test data yu cu phi y cc trng hp xy ra ( test data s c ni k hn trong phn 10).Cng ty Tinh Vn Lu hnh ni bS trang : 47/78 48. Effective Software Testing11/4/2013Vic tr li cc cu hi c lit k trong phn ny s gip cho ngi lp k hoch chia nh c cc cng vic test, quan trng l phi quan tm ti lch test v chi ph ginh cho test l bao nhiu. 3.2. S dng Template Test Procedure v cc tiu chun thit k test khc. Tnh lp li, chc chn, s hon thnh, template cc test Procedure chun nn c qui nh thch hp. Sau y l mt s v d v cc template test Procedure:Test Procedure TemplateCng ty Tinh Vn Lu hnh ni bS trang : 48/78 49. Effective Software Testing11/4/2013Phng php kim th: Hnh 21.1. Template file test case: Yu t u tin ca mt file test case chun c th hin qua hnh 21.1, bao gm:Cng ty Tinh Vn Lu hnh ni bS trang : 49/78 50. Effective Software Testing11/4/2013 M test case: Tho thun cch t ID cho test Procedure. Tn test case: Th hin s m t ca cc test case trong phn .. Ngy lp file test case: Ngy bt u to cc test case. Tn ngi thit k ln form ca file test case: H tn ca ngi thit k file test case Ngi to cc test case: H tn ngi to ra cc test case Mc ch test: Phc tho mc ch test ca test case . Mi lin quan gia cc use case, s lng cc yu cu: Th hin y s lng cc yu cu c xc nhn trong test Procedure. S d on, gi thit v s rng buc: a ra cc tiu chun hay cc iu kin tin quyt cn c trc khi vit cc test case, v d nh cc d liu c bit cho cc yu cu t ra l g. iu ny s c hon thnh khi test case ph thuc vo cc test case trc . iu ny cng c th c hon thnh khi 2 test case ny c xung t nhau nu nh chng cng c thc hin trong cng mt khong thi gian. Cn ch rng iu kin tin quyt ca cc use case thng l iu kin tin quyt ca cc test case. Phng php kim th: Mc ny ny c th bao gm cc kiu test c kim chng, cc cng c test t ng v test tay, s kim th, vic thc hin v phn tch. User Action (Inputs): y l kt qu mong i ca thao tc v kt qu mong i ny phi r rng v c s. Kt qu mong i l kt qu sau khi thc hin cc thao tc, cc bc c m t. u vo ca kt qu mong i c th l nh nhau i vi cc phn mm khc nhau. Vic ch r trng ny lm cho ti liu r rng, d hiu, d kim tra. Cc bc m t phi tun theo cc use case. Kt qu mong i: Xc nh kt qu mong i khi thc hin ln lt cc thao tc c m t trc . Thng tin theo di Log: Document the behavior of back-end components. Trong sut qu trnh thc hin cc thao tc, cc bc trong h thng, s c Log li chi tit cc chc nng m chng c thc hin. Qu trnh ghi Log cng c din t trong file test case. Kt qu thc t: Trng kt qu thc t c th c cc gi tr mc nh m t kt qu thc t nu nh test case ny b tht bi khng ng vi kt qu mong i hay thnh cng. Yu cu test data: S tham chiu ca vic thit lp test data s to nn cc test case trong file test case. Chng ta s nghin cu phn 26 bit thm chi tit. Cng ty Tinh Vn Lu hnh ni bS trang : 50/78 51. Effective Software Testing11/4/2013Khi xc nh n lc test, test cc yu cu phi chc nng thng c thc hin sau. Tuy nhin, iu quan trng l phi quan tm ti test phi chc nng ngay t khi bt u d n. Ch , trong phn 21.1, file test case c chia thnh 5 phn, mt phn ginh cho test chc nng, v 4 phn cn li ginh cho test phi chc nng, bao gm, test tnh bo mt_an ton h thng, test hiu nng, s tng thch, tin ch. Xem phn 41 bit nhiu hn v vic cn thit ca test phi chc nng. Cc tiu chun ca mt ti liu thit k test phi c th hin bng ti liu, trao i v buc phi tun theo mi ngi lin quan c c nhng nguyn tc thit k v cc thng tin v yu cu ca khch hng.[2]. Vic to ra mu file test case v cc nguyn tc l iu cn thit cho vic test tay v test t ng. Cc tiu chun cho file test case bao gm cc v d cng chi tit cng tt. Mc chi tit nn n gin khi thc hin m t cc thao tc. V d, Bc 1. Click chn File menu. Bc 2. Chn nt Open. Bc 3. Chn mt th mc trn my tnh Ph thuc vo qui m ca application c test v thi gian v s tin ginh cho vic test m qui nh thi gian cho vit test case nhiu hay t, v vit k hay khng k cc trng hp. Mt file test case chun bao gm cc nguyn tc trong vic m t kt qu mong i. Cc tiu chun nn ch tm vo nhiu cu hi: kt qu mong i s c th hin ra mn hnh nh th no? Yu cu test s b loi b bi ngi th 2 thc hin test? Khi t n vic test t ng theo ci chun th cc chun mc phi da trn k thut Code tt nht nh s kt ni r rng, cc bin chun,Vic Code nh hng ln n cht lng ca phn mm. Trong mt s trng hp, khng phi kch bn test c m t r rng, chi tit trong SRS hay URD. Test case ca cc ng dng kh, phc tp nh h thng v ti chnh; i vi h thng phn mm cung cp cho lnh vc ti chnh, u vo l hng vn cc php tnh v kt qu u ra l khc nhau. 3.3. Vic chuyn ho thnh cc test cases t yu cu ca khch hng. Mc ch chnh ca Test chc nng m bo chng trnh c v thc hin y d cc chc nng theo yu cu ca khch hng. Test chng trnh theo cc kch bn hay ni cch khc theo cc case v c m t trong test Procedure case gip cho vic test hiu qu hn. Cng ty Tinh Vn Lu hnh ni bS trang : 51/78 52. Effective Software Testing11/4/2013 m bo mc ch ca test chc nng th tester phi bm st vo ti liu c t yu cu khch hng. Thm vo , phi c cc test case test hiu nng, test tnh bo mt, v test tin ch. Trong chng 1 tho lun v mt SRS chi tit, hon thnh v c th thc hin test. Tuy nhin, trong qu trnh thc hin vit SRS th khng phi trng hp no cng thc hin tt. to ra cc kch bn test chc nng chun, cc tester phi hiu chi tit v tnh phc tp ca h thng. Mun vy, tester phi phn tch c h thng. Thm ch h phi a ra c lung test ngi khc nhn vo lung s bit tester s test nh th no, ng hay sai. Do , tester phi kho st h thng hiu y v h thng. Ni chung, cc tester phi phn tch lm cch no hiu c s chuyn i cc phn ca h thng, nh thay i bin v trng th s nh hng, thay i n cc phn cn li. Khng nn coi nh vic thay i yu cu. V d, h thng c tnh linh ng v cho php thay i yu cu, khi ny h thng s s dng tp con ca s kt hp v dao ng d liu u vo; v s thay i ny vn cho php lu li mt cch chnh xc. Khi ny, kt qu test trc vn khng b nh hng vo n vn bao gm tt c cc trng hp xy ra. V d, Xem xt yu cu sau: H thng phi cho php ngi dng sa tn tu thch v c th hin trn bn ghi vi trng tng ng. Trng tn v s gii hn ca trng tn cng phi c th hin c th trong SRS. Mt s bc test m bo cho yu cu ny bao gm: 1. Kim tra h thng xem n c cho php ngi dng sa tn tu thch trn giao din ngi dng bng cch click vo bn ghi c trng tn v sa hay khng. 2. C gng kt hp kim tra c trng hp ng v sai, tt c cc phn lp tng ng, cc gi tr bin. 3. Chy lnh SQL kim tra vic update l ng v c update vo 1 bng thch hp. trn bao gm cc bc kim th c bn. Tuy nhin, trong mt s trng hp vn cn b st cc tnh hung ca yu cu a ra. Ngoi vic test hiu nng v test phi chc nng khc th cu hi cn phi tr li l " lm th no bit c c s thay i trong h thng khi mt trng no b thay i?, giao din ngi dng, cc chc nng hay cc mc khc s b nh hng, cn cc phn no khng b nh hng?.Cng ty Tinh Vn Lu hnh ni bS trang : 52/78 53. Effective Software Testing11/4/2013V d: Kim tra chc nng to mi 1 n t hng trong module t hng l vic kim tra xem n t hng c c insert vo CSDL v c th hin trn giao din hay khng. Thm mt bn ghi v kim tra xem bn ghi c c lu li vi tn ng nh khi thm mi hay khng. Thc hin test chc nng thm mi v cc chc nng khc c lin quan ti chc nng thm mi thy s nh hng ca vic thm mi . Tester phi phn tch v test ht cc phn lin quan, b nh hng. Khi yu cu khng c c th ho chi tit trong SRS, test hiu qu trong trng hp ny rt kh, do , d b b xt. Thc t, hu ht cc yu cu khng c vit thnh ti liu mt cch y , r rng c th thy ngay mi lin h gia cc yu cu v cc chc nng. Do vy, thng th mt test Procedure hiu qu khng c vit ln t ring SRS. Ti liu thit k test hiu qu khng c chng cho ln nhau, thay v a ra mt quyt nh phi test hiu qu ton b vi n lc cn l gp i ( mc d n lc thi gian gp i nhng vn khng trnh khi s thiu st khi test). S khng hiu qu nu 2 tester test cng mt chc nng nhng trn 2 file test case khc nhau ca 2 ngi, tr khi iu l cn thit cho vic test ton b cc chc nng ( V d, khi c 2 phn cng s dng cc bc tng t nhau) Vn quan trng khi phn tch lung test nhm m bo trong sut qu trnh test, vic test c din ra ng theo lung, v chng trnh x l c ng hay khng m khng cn n lc gp i, tester khng cn test d liu khng hp l vi kt qu mong i khc, v khi ny ch lng ph thi gian. Nu test theo lung th lp trnh cng tn t thi gian sa li hn, v tp trung vo nhng li quan trng. Nhm test nn review k hoch test v ti liu thit k test : Xc nh cc kiu actions hay cc events tng t thng xy ra. Vic xc nh ny gip cho vic vit test Procedure c tt hn, do vy, c th ti s dng v kt hp li cc actions hay events i vi cc chc nng, trnh c vic tng n lc gp i. Xc nh th t hay s test. Cc vn cn test trc th phi c u tin thc hin test trc, nh vic xc nh cu hnh database, hay cc yu cu m kt qu mong i cn c kim sot, hay cc work flow. To ra cc mi lin h c kt hp cht ch theo lung, cc phn test cn u tin test trc trong test Procedure. S mi lin h ny a ra s nh hng ln nhau ca cc chc nng, s lung test c to ra t qu trnh thit k test v lm tng hiu qu test. Cng ty Tinh Vn Lu hnh ni bS trang : 53/78 54. Effective Software Testing11/4/2013Vic phn tch trn gip nhm test xc nh trnh t test thch hp trong ti liu thit k v pht trin test. Cc vn khc cn quan tm khc to ra test Procedure hiu qu l phi xc nh v review cc yu cu c ri ro cao c s u tin test v test k hn, chc nng quan trng nht s u tin test sm hn. Nh vy, s l lng ph thi gian u t to ra test Procedure cc chc nng rt him khi ngi dng s dng, trong khi cc chc nng quan trng li cha c test v test k dn n ri ro cao. Cn phi xc nh u tin test i vi cc chc nng c xc sut ri ro cao v vic s dng l nhiu nht. Phn 8 s cho chng ta bit chi tit hn) c test case hiu qu, phi hiu h thng, lung test v cc kch bn. Vn kh khn thng xy ra l nu ch thng qua 1 ti liu SRS th rt kh c th hiu ht c s kt ni, lung v mi tng quan gia cc i tng. Suy ngh theo logic v quan tm n chi tit cc yu cu hiu c tnh phc tp ca h thng. Test Procedure v thit k test s b thiu cc trng hp nu thit k test khng c chi tit trong khi test hp en. 3.4. SRS l ti liu khng th khng c (nh ti liu sng cn) ca qu trnh test (Living" Documents) Thng th ngi thit k test Procedure ch thc hin test cc case 1 hoc 2 ln ri thi, do s thay i yu cu, thit k, hay vic thc hin test ch din ra 2 ln. Do p lc cng vic, cc testers thng khng xem li test Procedure ca h. Cc testers da vo trc gic v k nng phn tch vit cc test case, bao qut ton b cc trng hp, cc chc nng quan trng ca h thng. Vn l, nu ti liu SRS khng cn thch hp, n tr nn qu li thi th cng vic trc to ra cc ti liu ny tr nn lng ph. V vy, vn quan trng l phi coi SRS nh ti liu sng cn ca vic test v n ti liu ng ch khng phi khng c s thay i. Hu ht cc d n phn mm c pht trin theo kiu lp li v pht trin, v ti liu test thng tng t theo 1 cch. Trong vng i ca 1 d n pht trin, a s l c xy dng da trn 1 k hoch ring. V iu rt kh ngi vit test Procedure gi v tha k li cc test Procedure trc . Khi phn xy dng u tin c hon thnh v giao li cho pha test, th ti liu ny phi dng to test case c. Chng ta s khng th hon thnh vic test ton b h thng nu nhm pht trin vn ang trong giai on code hay mi ch code xong mt s phn h ca h thng . Trong Cng ty Tinh Vn Lu hnh ni bS trang : 54/78 55. Effective Software Testing11/4/2013trng hp ny, nhm test ch vit test Procedure cho cc phn c code xong da vo k hoch c xy dng trc , v test Procedure ny khng phi l tt c cc yu cu, thit k chi tit, v tt c kch bn tes