Embed Size (px)
Citation preview
The p
urpo
se o
f tes
t:Pr
ovid
e inf
orm
atio
n to
assu
re th
e qua
lity o
f
-the
pro
duct
(fin
ding
faul
ts)
-dec
ision
s (qu
antif
ying
risks
)
-pro
cess
(fin
ding
root
caus
es)
©DE
LTA,
WW
W.D
ELTA
.DK
-Ann
e Me
tteJo
nass
enHa
ss, A
MJ@
DELT
A.DK
–ba
sed o
n ISE
B So
ftwar
e Tes
ting P
racti
tione
r Syll
abus
, BS-
7925
-1:19
98; IE
EE S
td. 61
0-19
90; IE
EE S
td. 82
9-19
98; I
STQB
testi
ng te
rms 2
005 a
nd pr
esen
tation
s at E
uroS
TAR
confe
renc
es by
Lee C
opela
nd, S
tewar
d Reid
, Mar
tin P
ool, P
aul G
erra
rd, G
rove
Con
sulta
nts an
d man
y othe
rs
G
raph
ic ad
vise:
EBB-
CONS
ULT,
Den
mark
Scr
een
Bea
ns®
Clip
Art,
USA
Test
appr
oach
esAn
alytic
al (ri
sk)
Mode
l-bas
ed (s
tatist
ical)
Stru
cture
d Co
nsult
ative
(dom
ain ex
perts
)Me
thodic
al (ch
eck-l
ists)
Heur
istic
(exp
lorato
ry)
Stan
dard
comp
liant
Regr
essio
n-av
erse
(reu
se an
d auto
matio
n)
Test
stra
tegy
1. E
ntry &
exit c
riteria
2. T
est a
ppro
ach
3. T
echn
iques
to us
e4.
Com
pletio
n crite
ria5.
Inde
pend
ence
6. S
tanda
rds t
o use
7. E
nviro
nmen
t8.
Tes
t auto
matio
n9.
Deg
ree o
f reu
se10
. Rete
st an
d re
gres
sion t
estin
g11
. Tes
t pro
cess
12. M
easu
res
13. In
ciden
t ma
nage
ment
Stan
dard
sQu
ality
assu
ranc
e(yo
u sha
ll tes
t)–I
SO 90
00:20
01
Testi
ng st
anda
rds
(you s
hall t
est li
ke th
is)–B
S-79
25–I
EEE
829
–IEE
E 10
28
Indus
try sp
ecific
(you s
hall t
est th
is mu
ch)
–avia
tion
–med
ical d
evice
s –m
ilitar
y equ
ipmen
t
Initi
al
Rep
eata
ble
Des
crib
edCon
trolle
d
Opt
imis
ing
1
2
3
4
5
Leve
lH
ighe
r pro
duct
ivity
and
qual
ityLo
wer
risk Initi
al
Rep
eata
ble
Des
crib
edCon
trolle
d
Opt
imis
ing
1
2
3
4
5
Leve
lH
ighe
r pro
duct
ivity
and
qual
ityLo
wer
risk
CMM
-lev
els
PA 5.
2N
NN
NN
N
PA 5.
1N
NN
NN
N
PA 4.
2N
NN
NN
N
PA 4.
1N
NN
NN
N
PA 3.
2L
LP
FL
P
PA 3.
1L
LP
FL
P
PA 2.
2L
LP
FL
L
PA 2.
1F
FL
FF
P
PA 1.
1L
FP
FL
P
ISO
1550
4 –re
sult
prof
ile
Test process improvement models
General process improvement models
Initi
atin
g
Actin
g (im
pleme
nting
)
Diag
nosin
g (a
sses
smen
t)
Esta
blish
ing
(plan
and w
rite)
Lear
ning
CMMI
–pro
cess
area
s
Org
.alI
nnov
atio
nan
d D
eplo
ymen
t
Org
aniz
atio
nal
Proc
ess
Perf
orm
ance
Org
aniz
atio
nal
Proc
ess
Focu
s
Org
aniz
atio
nal
Proc
ess
Def
initi
on
Org
aniz
atio
nal
Trai
ning
Org
aniz
atio
nal
Proc
ess
Focu
s
Org
aniz
atio
nal
Proc
ess
Def
initi
on
Org
aniz
atio
nal
Trai
ning
Qua
ntita
tive
Proj
ect M
anag
emen
t
Inte
grat
ed P
roje
ct
Man
agem
ent f
or IP
PD
Ris
k M
anag
emen
t
Inte
grat
ed T
eam
ing
Inte
grat
edSu
pplie
r Man
agem
ent
Inte
grat
ed P
roje
ct
Man
agem
ent f
or IP
PD
Ris
k M
anag
emen
t
Inte
grat
ed T
eam
ing
Inte
grat
edSu
pplie
r Man
agem
ent
Proj
ect P
lann
ing
Proj
ect M
onito
ring
and
Con
trol
Supp
lier
Agr
eem
ent
Man
agem
ent
Proj
ect P
lann
ing
Proj
ect M
onito
ring
and
Con
trol
Supp
lier
Agr
eem
ent
Man
agem
ent
Req
uire
men
tsD
evel
opm
ent
Tech
nica
lSo
lutio
n
Prod
uct I
nteg
ratio
n
Verif
icat
ion
Valid
atio
n
Req
uire
men
tsD
evel
opm
ent
Tech
nica
lSo
lutio
n
Prod
uct I
nteg
ratio
n
Verif
icat
ion
Valid
atio
n
Req
uire
men
tsM
anag
emen
t
Cau
sal A
naly
sis
and
Res
olut
ion
Org
aniz
atio
nal E
nviro
n-m
entf
or In
tegr
atio
n
Dec
isio
n A
naly
sis
and
Res
olut
ion
Org
aniz
atio
nal E
nviro
n-m
entf
or In
tegr
atio
n
Dec
isio
n A
naly
sis
and
Res
olut
ion
Con
figur
atio
nM
anag
emen
t
Proc
ess
and
Prod
uct
Qua
lity
Assu
ranc
e
Mea
sure
men
tan
d An
alys
is
Con
figur
atio
nM
anag
emen
t
Proc
ess
and
Prod
uct
Qua
lity
Assu
ranc
e
Mea
sure
men
tan
d An
alys
is
Proc
ess
Man
agem
ent
Proj
ect M
anag
emen
tEn
gine
erin
gSu
ppor
t
2345
RPr
ojec
t plan
Mista
ke/ E
rror
Proc
ess i
mpr
ovem
ent
Tool
supp
ort f
or
Test
plan
ning
and
mon
itorin
g
Test
Rol
esTe
st lea
der (
mana
ger)
Test
analy
st / d
esign
erTe
st ex
ecute
r
Revie
wer /
insp
ector
Test
envir
onme
nt re
spon
sible
(T
est)t
oolre
spon
sibleR
Softw
are T
estin
g at
a Gl
ance
–or
two
Softw
are T
estin
g at
a Gl
ance
–or
two
Failu
re
Defec
t/ Fa
ult
R
Over
allte
st p
lan
Mana
gem
ent(
of ev
eryt
hing
)
Com
mun
icatio
n
Phas
e spe
cific
test
stra
tegy
Resp
onsib
ility m
atrix
People
Res
pons
ible
, Per
form
ing,
Con
sulte
d
Risk
analy
sisEs
timat
ion
Sche
dulin
g
Test
man
agem
ent
Conf
igur
atio
n m
anag
emen
t
Tool
supp
ort f
or st
atic
test
ing
Stat
ic an
alysis
, incl.
requ
irem
ents
test
ing
Proj
ect m
anag
emen
t
Quali
ty as
sura
nce
Orga
niza
tiona
l man
agem
ent
The p
rice o
f a fa
ult co
rrecti
on
depe
nds o
n whe
n the
fault
is
found
100 10 1
Desi
gn
Te
st
P
rodu
ctio
nRe
quire
men
tsp
ecifi
catio
nSo
urce
: Gro
ve C
onsu
ltant
s, U
K
1000 10
0 10 1De
sign
Test
Pro
duct
ion
Requ
irem
ent
spec
ifica
tion
Sour
ce: G
rove
Con
sulta
nts,
UK
1000
Revie
w ty
pes:
infor
mal re
view,
walk
throu
gh, te
chnic
al re
view,
man
agem
ent r
eview
, insp
ectio
n, au
ditR
Stat
ic an
alysis
by to
olsDy
nam
ic an
alysis
by to
olsS
D
Proc
ess I
mpr
ovem
ent
Test
is co
mpa
ring
what
is to
wha
t sho
uld
be
Verif
icatio
nVa
lidat
ion
Defin
ition
of q
ualit
y crit
eria
Repo
rting
Defin
ition
of q
ualit
y crit
eria
Repo
rting
Quali
ty as
sura
nce
for a
ll wor
k pro
duct
s Valid
atio
nVe
rifica
tion
Tool
supp
ort
Tool
supp
ort
Risk
s hit
in m
any p
laces
Risk
man
agem
ent
Risk
expo
sure
= pr
obab
ility x
effe
ct
Prod
uct
desi
gn
R
R
Itera
tive
Con
ceiv
e D
esig
n Im
plem
ent
Test
+ C
orre
ctio
n
CC
DD
IITTTT
Wat
erfa
ll an
d V-
mod
els
RA
D, R
UP
or A
gile
Sequ
entia
l
CD
IT
CC
DD
IITTTT
CC
DD
IITTTT
CC
DD
IITTTT
Arc
hite
ctur
al
desi
gn
Syst
em
requ
irem
ents
Det
aile
d de
sign
T p
Codi
ngT p
R
RR
Test
plan
Test
spec
ificati
on
RR
Test
plan
Test
spec
ificati
on
RR
Test
plan
Test
spec
ificati
on
T s
Identi
ficati
on
Repo
rting
Conf
igur
atio
n m
anag
emen
tof
selec
ted w
ork p
rodu
cts
, pr
oduc
t com
pone
nts
, an
d pro
ducts
Disp
ositio
nCh
ange
man
agem
ent
Actio
nInv
estig
ation
Reco
gnitio
n
Test
er sk
ills
Busin
ess
Proc
ess
Proje
ct
Test
could
be ru
led by
prod
uct r
isks
+ wi
llingn
ess t
o run
risks
Tool
supp
ort f
or d
ynam
ic an
alysis
Prod
uct
S
Test
targ
ets
New
prod
uct
Chan
ge re
lated
-fun
ction
al-r
egre
ssion
testi
ng
-non
-func
tiona
l
-r
etesti
ng-s
tructu
re/ar
chite
cture
Maint
enan
ce
Dyna
mic
test
manu
ally o
rby t
ools
Deve
lopm
ent
mod
els
Requ
irem
ents
towe
r
Tool
supp
ort f
or
Requ
irem
ents
man
agem
ent
Prod
uct q
ualit
y req
uire
men
ts
Func
tiona
l requ
ireme
nts
Perfo
rman
ce re
quire
ments
Usab
ility r
equir
emen
tsAv
ailab
ility r
equir
emen
tsMa
intain
abilit
y req
uirem
ents
Non-
functi
onal
requ
ireme
nts
Proj
ectr
equi
rem
ents
Cost
Reso
urce
sTi
me
Envir
onme
nt re
quire
ments
Platf
orm
Hard
ware
Stan
dard
s
Plan
at pr
oject
start
Plan
at te
st sta
rttest
deve
lopme
nt
Plan
durin
g dev
elopm
ent
test
deve
lopme
nt
test
deve
lopme
nt
e l v e yd ri e l v e yd ri e l v e yd ri
Degr
ee o
f ind
epen
denc
e(p
rodu
cer v
s. tes
ter)
1.Pr
oduc
er te
sts ow
n pro
duct
2.Te
sts ar
e des
igned
by ot
her t
eam
memb
ers
3.Te
sts ar
e des
igned
by in
depe
nden
t teste
rs4.
Tests
are d
esign
ed by
exter
nal te
sters
Proc
edur
e:-A
ctivit
y 1-A
ctivit
y 2- -A
ctivit
y n
templa
teEn
try
criter
ia
Exit
criter
ia
Outp
ut
Proc
ess
Inpu
t
this i
s wha
tI s
aythi
s is w
hat
I hea
r
this i
s wha
t I m
ean
back
grou
ndba
ckgr
ound
back
grou
nd
this i
s wha
t I thi
nk is
mea
nt
back
grou
nd
Com
mun
icatio
n is
Visio
n / id
eas /
nee
ds / e
xpec
tatio
nsVi
sion
/ idea
s / n
eeds
/ exp
ecta
tions
The b
est (
test)t
eam
is ba
sed o
n kno
wled
ge of
Belb
inty
pes:
Cere
bral
Plan
tMo
nitor
/Eva
luator
Spec
ialist
Actio
n orie
nted
Shap
erIm
pleme
nter
Comp
leter
/Fini
sher
Peop
le or
iented
Coor
dinato
rTe
am-w
orke
rRe
ssou
rceinv
estig
ator
Test
pha
ses
Acce
ptanc
e tes
ting
-use
r -o
pera
tiona
l (OAT
)-c
ontra
ctual
(FAT
)-a
lpha &
beta
Syste
m int
egra
tion
testin
gSy
stem
testin
g-f
uncti
onal
-non
-func
tiona
lCo
mpon
ent
integ
ratio
n tes
ting
Comp
onen
t testi
ng
Soft
skills
Doma
in kn
owled
geIT
skills
Test
skills So
ft sk
illsDo
main
know
ledgeIT
sk
ills
Test
skills
Soft
skills
Doma
in kn
owled
geIT
skills
Test
skills
Soft
skills
Doma
in kn
owled
geIT
skills
Test
skills
Test
pol
icy-d
efinit
ion of
test
-tes
t pro
cess
to us
e -t
est e
valua
tion
-qua
lity le
vel
-app
roac
h to
impr
ovem
ent
Use
r re
quire
men
ts
R
Over
all
test
stra
tegy
PR
CC
PR
P
CP
RR
RR
R
PC
RTa
sks
TMM
-lev
els
Star
the
reBu
sines
s goa
ls
Test
plan
1. In
trodu
ction
2. T
est it
em(s)
3. F
eatur
es to
be te
sted
4. F
eatur
es no
t to be
5. A
ppro
ach
6. Ite
m pa
ss/fa
il crite
ria7.
Sus
pens
ion cr
iteria
8. T
est d
elive
rable
s9.
Tes
ting t
asks
10. E
nviro
nmen
tal ne
eds
11. R
espo
nsibi
lities
12. S
taffin
g and
train
ing13
. Sch
edule
14. R
isks A
plan m
ust b
e Sp
ecific
Meas
urab
leAg
reed
Relev
ant
Time s
pecif
ic
Be p
repa
red
-Be
pre
pare
d -
Hw
Hw
€
T
T
WW
W.D
ELTA
.DK
Development
Goo
dco
deK
now
nqu
ality
Poor
code
Poor
te
st
UN
-kn
own
qual
ity
Goo
d te
st
Stor
age
Repo
rting
Repo
rting
Repo
rting
Repo
rting
Repo
rting
Why
do
we w
ork?
incen
tives
motiv
es
Trian
gle o
f tes
t qua
lity
chan
ge on
e asp
ect
-> ch
ange
at le
ast tw
o
Reso
urce
sTim
eQu
ality
Moni
torin
g an
d co
ntro
l
R
User
re
quire
ments
R
Prod
uct
desig
n
R
SWre
quire
ments
R
Arch
itectu
ral
desig
n
R
Detai
ledde
sign
Comp
onen
tCo
mpon
ent
Comp
onen
tCo
mpon
ent
RT
sCo
mpo
nent
test
ing
T
Repo
rt
Com
pone
ntin
tegr
atio
n te
stin
gT
Integration
Repo
rt
Syst
em te
stin
gT
NRe
port
Syst
em in
tegr
atio
n te
stin
gT
Integration
Acce
ptan
cete
stin
g Repo
rtT
-pre
vents
omiss
ions
-pre
vents
gold-
platin
g-s
hows
the r
ation
ale fo
r tes
t cas
es
Req.
146
Test
case
27
Req.
148
Req.
147
Test
case
56
Trac
ing
V. T
-UK-
o-06
03
Othe
r rela
ted st
anda
rds
–IEE
E 10
44–I
SO 91
26–I
EEE/
ISO
1220
7–I
EEE/
ISO
1528
8
CB
ALo
w-lev
el tes
ting
BA
Evalu
ating
CB
ATe
st pr
oces
s man
agem
ent
DC
BA
Testw
arem
anag
emen
tC
BA
Defec
t man
agem
ent
DC
BA
Repo
rting
CB
ACo
mmun
icatio
nC
BA
Scop
e of m
ethod
ology
CB
ATe
st fun
ction
s and
train
ingC
BA
Comm
itmen
t and
moti
vatio
nA
Offic
e env
ironm
ent
CB
ATe
st en
viron
ment
CB
ATe
st too
lsD
CB
AMe
trics
BA
Stati
c tes
t tech
nique
sB
ATe
st sp
ecific
ation
tech
nique
sB
AEs
timati
ng an
d plan
ning
DC
BA
Mome
nt of
involv
emen
tB
ALif
e-cy
cle m
odel
DC
BA
Test
strate
gyp
g
CB
ALo
w-lev
el tes
ting
BA
Evalu
ating
CB
ATe
st pr
oces
s man
agem
ent
DC
BA
Testw
arem
anag
emen
tC
BA
Defec
t man
agem
ent
DC
BA
Repo
rting
CB
ACo
mmun
icatio
nC
BA
Scop
e of m
ethod
ology
CB
ATe
st fun
ction
s and
train
ingC
BA
Comm
itmen
t and
moti
vatio
nA
Offic
e env
ironm
ent
CB
ATe
st en
viron
ment
CB
ATe
st too
lsD
CB
AMe
trics
BA
Stati
c tes
t tech
nique
sB
ATe
st sp
ecific
ation
tech
nique
sB
AEs
timati
ng an
d plan
ning
DC
BA
Mome
nt of
involv
emen
tB
ALif
e-cy
cle m
odel
DC
BA
Test
strate
gyp
g
TPI –
mat
rix®
Test
repo
rt1.
Summ
ary
2. Va
rianc
es
3. Co
mpre
hens
ivene
ss4.
Summ
ary o
f res
ults
5. Ev
aluati
on
6. Su
mmar
y of
activ
ities
Proc
ess
impr
ovem
ent
Fault
corre
ction
From
test
bas
is to
test
case
s
Tool
supp
ort
for t
est
spec
ifica
tion
Test
desig
nTe
st inp
ut da
ta pr
epar
ation
Test
orac
les
A foo
l with
a too
l is
still a
fool
Test
pro
cess
for a
ll tes
t pha
ses Monitoring and control
Test
plan
ning
Test
spec
ifica
tion
Test
exec
utio
n
Incide
nt re
port
Incid
ent re
port
Reco
gnitio
nsu
ppor
ting d
atacla
ssific
ation
impa
ctInv
estig
ation
supp
ortin
g data
class
ificati
onim
pact
Actio
n supp
ortin
g data
class
ificati
onim
pact
Disp
ositio
nsu
ppor
ting d
atacla
ssific
.im
pact
The g
olde
n ru
le of
test
ing:
Alwa
ys te
st so
that
when
ever
yo
u hav
e to s
top yo
u hav
e do
ne th
e bes
t pos
sible
test.
Coop
erat
ion
mat
rix
Matur
ity le
vels
☺
55 44 33 22 1
12
34
5
Test
Spe
cifica
tion
1. T
est D
esign
1.1
Featu
res t
o be t
ested
1.2
Appr
oach
refin
emen
t1.3
As
socia
ted te
st ca
se1.4
Fe
ature
pass
/fail c
riteria
2. T
est C
ases
2.1 T
est C
ase 1
2.1.1
Test
items
(rati
onale
) 2.1
.2 P
rere
quisi
tes2.1
.3 In
puts
2.1.4
Exp
ected
outco
mes
2.1.5
Inter
case
de
pend
encie
s
2.N
Test
Case
n
Trac
e tab
les
If yo
u do
n’t m
easu
re yo
u’re
left
with
on
ly on
e rea
son
to b
eliev
e you
’re in
co
ntro
l –hy
ster
ical o
ptim
ism.
Tom
De M
arco
Testg
rupp
eTe
stgru
ppe
Test
proc
edur
e /
Test
scrip
t
4321 4321
Base
docu
ment
Test
cond
itions
/ Te
st re
quire
ments
deriv
ecre
ate us
ing
test c
ase d
esign
tech
nique
s
Test
Pro
cedu
re1.
Purp
ose
2. Pr
ereq
uisite
s3.
Proc
edur
e ste
ps
Test
case
des
ign
tech
niqu
esSp
ecific
ation
base
d-e
quiva
lence
clas
s par
tition
ing-b
ound
ary v
alue a
nalys
is-d
ecisi
on ta
bles
-stat
e tra
nsitio
ns-u
se ca
ses
Expe
rienc
e bas
ed-e
rror g
uess
ing-c
heck
lists
-exp
lorato
rySt
ructu
re ba
sed
-stat
emen
ts-d
ecisi
ons
-con
dition
s-m
odels
The w
hite
-box
inse
ct statem
ent
decis
ion
bran
chbr
anch
bran
ch (in
)
bran
ch po
int
(out)
decis
ion ou
tcome
basic
bloc
k-------
-------
-------
-------
-------
-------
-------
-------
-------
-------
-------
-------
(out)
cond
ition
proc
edur
esm
etho
dste
chni
ques
Lear
ning
Act
ions
Dep
loym
ent
Adj
ustm
ent
Tool
s
Key areas
Custo
mer
satis
factio
n
Orga
nize i
nto
÷Te
st ca
ses
Test
cove
rage
% of
the c
over
age i
tems t
ouch
ed by
a tes
t
Cove
rage
items
:-s
tatem
ents,
decis
ions,
cond
itions
-inter
faces
-use
r req
uirem
ents,
use c
ases
-bus
iness
proc
esse
s, bu
sines
s goa
ls
Sca
le
Depl
oym
ent
Main
tena
nce t
estin
gTo
ol su
ppor
t for
mon
itorin
gCo
ntinu
ous a
nalys
is of
usag
e H
yper
links
Disp
osal
Chec
king
for
test
com
plet
ion
Test
re
cord
ing
corre
ction
of
thetes
t obje
ct
Phas
ete
st
repo
rt
Test
logs
Phas
ete
st
repo
rtPh
ase
test
re
port
Phas
ete
st
repo
rtPh
ase
test
re
port Ov
erall
test
repo
rt
Busin
ess
requ
irem
ents
Tool
supp
ort f
or te
st ex
ecut
ion
and
logg
ing
Test
runn
ingTe
st sc
ript g
ener
ation
Test
harn
ess a
nd dr
ivers
C
over
age m
easu
reme
nt Co
mpar
ators
Sim
ulator
S
ecur
ity te
sting
Test
envir
onm
ent
Hard
ware
, soft
ware
, netw
ork,
other
syste
ms, to
ols, d
ata,
room
, per
ipher
als, s
tation
ary,
chair
s, ‘ph
ones
, food
, drin
k, ca
ndy
Tool
supp
ort f
or n
on-fu
nctio
nalt
est P
erfor
manc
e, Lo
ad, S
tress
D
Leve
l 1: I
nitia
l
Leve
l 2: P
hase
Def
initi
on
•In
stitu
tiona
lise
basi
c te
stin
g te
chni
ques
and
met
hods
•In
itiat
e a
test
pla
nnin
g pr
oces
s•
Dev
elop
test
ing
and
debu
ggin
g go
als
Leve
l 2: P
hase
Def
initi
on
•In
stitu
tiona
lise
basi
c te
stin
g te
chni
ques
and
met
hods
•In
itiat
e a
test
pla
nnin
g pr
oces
s•
Dev
elop
test
ing
and
debu
ggin
g go
als
Leve
l 3: I
nteg
ratio
n
•C
ontro
l and
mon
itor t
he te
st p
roce
ss•
Inte
grat
e te
stin
g in
to th
e so
ftwar
e lif
ecyc
le•
Esta
blis
h a
tech
nica
l tra
inin
g pr
ogra
m•
Esta
blis
h a
softw
are
test
org
anis
atio
n
Leve
l 3: I
nteg
ratio
n
•C
ontro
l and
mon
itor t
he te
st p
roce
ss•
Inte
grat
e te
stin
g in
to th
e so
ftwar
e lif
ecyc
le•
Esta
blis
h a
tech
nica
l tra
inin
g pr
ogra
m•
Esta
blis
h a
softw
are
test
org
anis
atio
n
Leve
l 4: M
anag
emen
t and
Mea
sure
men
t
•So
ftwar
e qu
ality
eva
luat
ion
•Es
tabl
ish
a te
st m
easu
rem
ent p
rogr
am•
Esta
blis
h an
org
anis
atio
n-w
ide
revi
ew p
rogr
am
Leve
l 4: M
anag
emen
t and
Mea
sure
men
t
•So
ftwar
e qu
ality
eva
luat
ion
•Es
tabl
ish
a te
st m
easu
rem
ent p
rogr
am•
Esta
blis
h an
org
anis
atio
n-w
ide
revi
ew p
rogr
am
Leve
l 5: O
ptim
izat
ion,
Def
ect P
reve
ntio
n an
d Q
ualit
y C
ontro
l
•Te
st p
roce
ss o
ptim
isat
ion
•Q
ualit
y co
ntro
l•
Appl
icat
ion
of p
roce
ss d
ata
for d
efec
t pre
vent
ion
Leve
l 5: O
ptim
izat
ion,
Def
ect P
reve
ntio
n an
d Q
ualit
y C
ontro
l
•Te
st p
roce
ss o
ptim
isat
ion
•Q
ualit
y co
ntro
l•
Appl
icat
ion
of p
roce
ss d
ata
for d
efec
t pre
vent
ion
Repo
rt
