Transcript
Page 1: Software Testing at a Glance – or two€¦ · - Anne Mette Jonassen Hass, AMJ@DELTA.DK – based on ISEB Software Testing Practitioner Syllabus, BS-7925-1:1998; IEEE Std. 610-1990;

The p

urpo

se o

f tes

t:Pr

ovid

e inf

orm

atio

n to

assu

re th

e qua

lity o

f

-the

pro

duct

(fin

ding

faul

ts)

-dec

ision

s (qu

antif

ying

risks

)

-pro

cess

(fin

ding

root

caus

es)

©DE

LTA,

WW

W.D

ELTA

.DK

-Ann

e Me

tteJo

nass

enHa

ss, A

MJ@

DELT

A.DK

–ba

sed o

n ISE

B So

ftwar

e Tes

ting P

racti

tione

r Syll

abus

, BS-

7925

-1:19

98; IE

EE S

td. 61

0-19

90; IE

EE S

td. 82

9-19

98; I

STQB

testi

ng te

rms 2

005 a

nd pr

esen

tation

s at E

uroS

TAR

confe

renc

es by

Lee C

opela

nd, S

tewar

d Reid

, Mar

tin P

ool, P

aul G

erra

rd, G

rove

Con

sulta

nts an

d man

y othe

rs

G

raph

ic ad

vise:

EBB-

CONS

ULT,

Den

mark

Scr

een

Bea

ns®

Clip

Art,

USA

Test

appr

oach

esAn

alytic

al (ri

sk)

Mode

l-bas

ed (s

tatist

ical)

Stru

cture

d Co

nsult

ative

(dom

ain ex

perts

)Me

thodic

al (ch

eck-l

ists)

Heur

istic

(exp

lorato

ry)

Stan

dard

comp

liant

Regr

essio

n-av

erse

(reu

se an

d auto

matio

n)

Test

stra

tegy

1. E

ntry &

exit c

riteria

2. T

est a

ppro

ach

3. T

echn

iques

to us

e4.

Com

pletio

n crite

ria5.

Inde

pend

ence

6. S

tanda

rds t

o use

7. E

nviro

nmen

t8.

Tes

t auto

matio

n9.

Deg

ree o

f reu

se10

. Rete

st an

d re

gres

sion t

estin

g11

. Tes

t pro

cess

12. M

easu

res

13. In

ciden

t ma

nage

ment

Stan

dard

sQu

ality

assu

ranc

e(yo

u sha

ll tes

t)–I

SO 90

00:20

01

Testi

ng st

anda

rds

(you s

hall t

est li

ke th

is)–B

S-79

25–I

EEE

829

–IEE

E 10

28

Indus

try sp

ecific

(you s

hall t

est th

is mu

ch)

–avia

tion

–med

ical d

evice

s –m

ilitar

y equ

ipmen

t

Initi

al

Rep

eata

ble

Des

crib

edCon

trolle

d

Opt

imis

ing

1

2

3

4

5

Leve

lH

ighe

r pro

duct

ivity

and

qual

ityLo

wer

risk Initi

al

Rep

eata

ble

Des

crib

edCon

trolle

d

Opt

imis

ing

1

2

3

4

5

Leve

lH

ighe

r pro

duct

ivity

and

qual

ityLo

wer

risk

CMM

-lev

els

PA 5.

2N

NN

NN

N

PA 5.

1N

NN

NN

N

PA 4.

2N

NN

NN

N

PA 4.

1N

NN

NN

N

PA 3.

2L

LP

FL

P

PA 3.

1L

LP

FL

P

PA 2.

2L

LP

FL

L

PA 2.

1F

FL

FF

P

PA 1.

1L

FP

FL

P

ISO

1550

4 –re

sult

prof

ile

Test process improvement models

General process improvement models

Initi

atin

g

Actin

g (im

pleme

nting

)

Diag

nosin

g (a

sses

smen

t)

Esta

blish

ing

(plan

and w

rite)

Lear

ning

CMMI

–pro

cess

area

s

Org

.alI

nnov

atio

nan

d D

eplo

ymen

t

Org

aniz

atio

nal

Proc

ess

Perf

orm

ance

Org

aniz

atio

nal

Proc

ess

Focu

s

Org

aniz

atio

nal

Proc

ess

Def

initi

on

Org

aniz

atio

nal

Trai

ning

Org

aniz

atio

nal

Proc

ess

Focu

s

Org

aniz

atio

nal

Proc

ess

Def

initi

on

Org

aniz

atio

nal

Trai

ning

Qua

ntita

tive

Proj

ect M

anag

emen

t

Inte

grat

ed P

roje

ct

Man

agem

ent f

or IP

PD

Ris

k M

anag

emen

t

Inte

grat

ed T

eam

ing

Inte

grat

edSu

pplie

r Man

agem

ent

Inte

grat

ed P

roje

ct

Man

agem

ent f

or IP

PD

Ris

k M

anag

emen

t

Inte

grat

ed T

eam

ing

Inte

grat

edSu

pplie

r Man

agem

ent

Proj

ect P

lann

ing

Proj

ect M

onito

ring

and

Con

trol

Supp

lier

Agr

eem

ent

Man

agem

ent

Proj

ect P

lann

ing

Proj

ect M

onito

ring

and

Con

trol

Supp

lier

Agr

eem

ent

Man

agem

ent

Req

uire

men

tsD

evel

opm

ent

Tech

nica

lSo

lutio

n

Prod

uct I

nteg

ratio

n

Verif

icat

ion

Valid

atio

n

Req

uire

men

tsD

evel

opm

ent

Tech

nica

lSo

lutio

n

Prod

uct I

nteg

ratio

n

Verif

icat

ion

Valid

atio

n

Req

uire

men

tsM

anag

emen

t

Cau

sal A

naly

sis

and

Res

olut

ion

Org

aniz

atio

nal E

nviro

n-m

entf

or In

tegr

atio

n

Dec

isio

n A

naly

sis

and

Res

olut

ion

Org

aniz

atio

nal E

nviro

n-m

entf

or In

tegr

atio

n

Dec

isio

n A

naly

sis

and

Res

olut

ion

Con

figur

atio

nM

anag

emen

t

Proc

ess

and

Prod

uct

Qua

lity

Assu

ranc

e

Mea

sure

men

tan

d An

alys

is

Con

figur

atio

nM

anag

emen

t

Proc

ess

and

Prod

uct

Qua

lity

Assu

ranc

e

Mea

sure

men

tan

d An

alys

is

Proc

ess

Man

agem

ent

Proj

ect M

anag

emen

tEn

gine

erin

gSu

ppor

t

2345

RPr

ojec

t plan

Mista

ke/ E

rror

Proc

ess i

mpr

ovem

ent

Tool

supp

ort f

or

Test

plan

ning

and

mon

itorin

g

Test

Rol

esTe

st lea

der (

mana

ger)

Test

analy

st / d

esign

erTe

st ex

ecute

r

Revie

wer /

insp

ector

Test

envir

onme

nt re

spon

sible

(T

est)t

oolre

spon

sibleR

Softw

are T

estin

g at

a Gl

ance

–or

two

Softw

are T

estin

g at

a Gl

ance

–or

two

Failu

re

Defec

t/ Fa

ult

R

Over

allte

st p

lan

Mana

gem

ent(

of ev

eryt

hing

)

Com

mun

icatio

n

Phas

e spe

cific

test

stra

tegy

Resp

onsib

ility m

atrix

People

Res

pons

ible

, Per

form

ing,

Con

sulte

d

Risk

analy

sisEs

timat

ion

Sche

dulin

g

Test

man

agem

ent

Conf

igur

atio

n m

anag

emen

t

Tool

supp

ort f

or st

atic

test

ing

Stat

ic an

alysis

, incl.

requ

irem

ents

test

ing

Proj

ect m

anag

emen

t

Quali

ty as

sura

nce

Orga

niza

tiona

l man

agem

ent

The p

rice o

f a fa

ult co

rrecti

on

depe

nds o

n whe

n the

fault

is

found

100 10 1

Desi

gn

Te

st

P

rodu

ctio

nRe

quire

men

tsp

ecifi

catio

nSo

urce

: Gro

ve C

onsu

ltant

s, U

K

1000 10

0 10 1De

sign

Test

Pro

duct

ion

Requ

irem

ent

spec

ifica

tion

Sour

ce: G

rove

Con

sulta

nts,

UK

1000

Revie

w ty

pes:

infor

mal re

view,

walk

throu

gh, te

chnic

al re

view,

man

agem

ent r

eview

, insp

ectio

n, au

ditR

Stat

ic an

alysis

by to

olsDy

nam

ic an

alysis

by to

olsS

D

Proc

ess I

mpr

ovem

ent

Test

is co

mpa

ring

what

is to

wha

t sho

uld

be

Verif

icatio

nVa

lidat

ion

Defin

ition

of q

ualit

y crit

eria

Repo

rting

Defin

ition

of q

ualit

y crit

eria

Repo

rting

Quali

ty as

sura

nce

for a

ll wor

k pro

duct

s Valid

atio

nVe

rifica

tion

Tool

supp

ort

Tool

supp

ort

Risk

s hit

in m

any p

laces

Risk

man

agem

ent

Risk

expo

sure

= pr

obab

ility x

effe

ct

Prod

uct

desi

gn

R

R

Itera

tive

Con

ceiv

e D

esig

n Im

plem

ent

Test

+ C

orre

ctio

n

CC

DD

IITTTT

Wat

erfa

ll an

d V-

mod

els

RA

D, R

UP

or A

gile

Sequ

entia

l

CD

IT

CC

DD

IITTTT

CC

DD

IITTTT

CC

DD

IITTTT

Arc

hite

ctur

al

desi

gn

Syst

em

requ

irem

ents

Det

aile

d de

sign

T p

Codi

ngT p

R

RR

Test

plan

Test

spec

ificati

on

RR

Test

plan

Test

spec

ificati

on

RR

Test

plan

Test

spec

ificati

on

T s

Identi

ficati

on

Repo

rting

Conf

igur

atio

n m

anag

emen

tof

selec

ted w

ork p

rodu

cts

, pr

oduc

t com

pone

nts

, an

d pro

ducts

Disp

ositio

nCh

ange

man

agem

ent

Actio

nInv

estig

ation

Reco

gnitio

n

Test

er sk

ills

Busin

ess

Proc

ess

Proje

ct

Test

could

be ru

led by

prod

uct r

isks

+ wi

llingn

ess t

o run

risks

Tool

supp

ort f

or d

ynam

ic an

alysis

Prod

uct

S

Test

targ

ets

New

prod

uct

Chan

ge re

lated

-fun

ction

al-r

egre

ssion

testi

ng

-non

-func

tiona

l

-r

etesti

ng-s

tructu

re/ar

chite

cture

Maint

enan

ce

Dyna

mic

test

manu

ally o

rby t

ools

Deve

lopm

ent

mod

els

Requ

irem

ents

towe

r

Tool

supp

ort f

or

Requ

irem

ents

man

agem

ent

Prod

uct q

ualit

y req

uire

men

ts

Func

tiona

l requ

ireme

nts

Perfo

rman

ce re

quire

ments

Usab

ility r

equir

emen

tsAv

ailab

ility r

equir

emen

tsMa

intain

abilit

y req

uirem

ents

Non-

functi

onal

requ

ireme

nts

Proj

ectr

equi

rem

ents

Cost

Reso

urce

sTi

me

Envir

onme

nt re

quire

ments

Platf

orm

Hard

ware

Stan

dard

s

Plan

at pr

oject

start

Plan

at te

st sta

rttest

deve

lopme

nt

Plan

durin

g dev

elopm

ent

test

deve

lopme

nt

test

deve

lopme

nt

e l v e yd ri e l v e yd ri e l v e yd ri

Degr

ee o

f ind

epen

denc

e(p

rodu

cer v

s. tes

ter)

1.Pr

oduc

er te

sts ow

n pro

duct

2.Te

sts ar

e des

igned

by ot

her t

eam

memb

ers

3.Te

sts ar

e des

igned

by in

depe

nden

t teste

rs4.

Tests

are d

esign

ed by

exter

nal te

sters

Proc

edur

e:-A

ctivit

y 1-A

ctivit

y 2- -A

ctivit

y n

templa

teEn

try

criter

ia

Exit

criter

ia

Outp

ut

Proc

ess

Inpu

t

this i

s wha

tI s

aythi

s is w

hat

I hea

r

this i

s wha

t I m

ean

back

grou

ndba

ckgr

ound

back

grou

nd

this i

s wha

t I thi

nk is

mea

nt

back

grou

nd

Com

mun

icatio

n is

Visio

n / id

eas /

nee

ds / e

xpec

tatio

nsVi

sion

/ idea

s / n

eeds

/ exp

ecta

tions

The b

est (

test)t

eam

is ba

sed o

n kno

wled

ge of

Belb

inty

pes:

Cere

bral

Plan

tMo

nitor

/Eva

luator

Spec

ialist

Actio

n orie

nted

Shap

erIm

pleme

nter

Comp

leter

/Fini

sher

Peop

le or

iented

Coor

dinato

rTe

am-w

orke

rRe

ssou

rceinv

estig

ator

Test

pha

ses

Acce

ptanc

e tes

ting

-use

r -o

pera

tiona

l (OAT

)-c

ontra

ctual

(FAT

)-a

lpha &

beta

Syste

m int

egra

tion

testin

gSy

stem

testin

g-f

uncti

onal

-non

-func

tiona

lCo

mpon

ent

integ

ratio

n tes

ting

Comp

onen

t testi

ng

Soft

skills

Doma

in kn

owled

geIT

skills

Test

skills So

ft sk

illsDo

main

know

ledgeIT

sk

ills

Test

skills

Soft

skills

Doma

in kn

owled

geIT

skills

Test

skills

Soft

skills

Doma

in kn

owled

geIT

skills

Test

skills

Test

pol

icy-d

efinit

ion of

test

-tes

t pro

cess

to us

e -t

est e

valua

tion

-qua

lity le

vel

-app

roac

h to

impr

ovem

ent

Use

r re

quire

men

ts

R

Over

all

test

stra

tegy

PR

CC

PR

P

CP

RR

RR

R

PC

RTa

sks

TMM

-lev

els

Star

the

reBu

sines

s goa

ls

Test

plan

1. In

trodu

ction

2. T

est it

em(s)

3. F

eatur

es to

be te

sted

4. F

eatur

es no

t to be

5. A

ppro

ach

6. Ite

m pa

ss/fa

il crite

ria7.

Sus

pens

ion cr

iteria

8. T

est d

elive

rable

s9.

Tes

ting t

asks

10. E

nviro

nmen

tal ne

eds

11. R

espo

nsibi

lities

12. S

taffin

g and

train

ing13

. Sch

edule

14. R

isks A

plan m

ust b

e Sp

ecific

Meas

urab

leAg

reed

Relev

ant

Time s

pecif

ic

Be p

repa

red

-Be

pre

pare

d -

Hw

Hw

T

T

WW

W.D

ELTA

.DK

Development

Goo

dco

deK

now

nqu

ality

Poor

code

Poor

te

st

UN

-kn

own

qual

ity

Goo

d te

st

Stor

age

Repo

rting

Repo

rting

Repo

rting

Repo

rting

Repo

rting

Why

do

we w

ork?

incen

tives

motiv

es

Trian

gle o

f tes

t qua

lity

chan

ge on

e asp

ect

-> ch

ange

at le

ast tw

o

Reso

urce

sTim

eQu

ality

Moni

torin

g an

d co

ntro

l

R

User

re

quire

ments

R

Prod

uct

desig

n

R

SWre

quire

ments

R

Arch

itectu

ral

desig

n

R

Detai

ledde

sign

Comp

onen

tCo

mpon

ent

Comp

onen

tCo

mpon

ent

RT

sCo

mpo

nent

test

ing

T

Repo

rt

Com

pone

ntin

tegr

atio

n te

stin

gT

Integration

Repo

rt

Syst

em te

stin

gT

NRe

port

Syst

em in

tegr

atio

n te

stin

gT

Integration

Acce

ptan

cete

stin

g Repo

rtT

-pre

vents

omiss

ions

-pre

vents

gold-

platin

g-s

hows

the r

ation

ale fo

r tes

t cas

es

Req.

146

Test

case

27

Req.

148

Req.

147

Test

case

56

Trac

ing

V. T

-UK-

o-06

03

Othe

r rela

ted st

anda

rds

–IEE

E 10

44–I

SO 91

26–I

EEE/

ISO

1220

7–I

EEE/

ISO

1528

8

CB

ALo

w-lev

el tes

ting

BA

Evalu

ating

CB

ATe

st pr

oces

s man

agem

ent

DC

BA

Testw

arem

anag

emen

tC

BA

Defec

t man

agem

ent

DC

BA

Repo

rting

CB

ACo

mmun

icatio

nC

BA

Scop

e of m

ethod

ology

CB

ATe

st fun

ction

s and

train

ingC

BA

Comm

itmen

t and

moti

vatio

nA

Offic

e env

ironm

ent

CB

ATe

st en

viron

ment

CB

ATe

st too

lsD

CB

AMe

trics

BA

Stati

c tes

t tech

nique

sB

ATe

st sp

ecific

ation

tech

nique

sB

AEs

timati

ng an

d plan

ning

DC

BA

Mome

nt of

involv

emen

tB

ALif

e-cy

cle m

odel

DC

BA

Test

strate

gyp

g

CB

ALo

w-lev

el tes

ting

BA

Evalu

ating

CB

ATe

st pr

oces

s man

agem

ent

DC

BA

Testw

arem

anag

emen

tC

BA

Defec

t man

agem

ent

DC

BA

Repo

rting

CB

ACo

mmun

icatio

nC

BA

Scop

e of m

ethod

ology

CB

ATe

st fun

ction

s and

train

ingC

BA

Comm

itmen

t and

moti

vatio

nA

Offic

e env

ironm

ent

CB

ATe

st en

viron

ment

CB

ATe

st too

lsD

CB

AMe

trics

BA

Stati

c tes

t tech

nique

sB

ATe

st sp

ecific

ation

tech

nique

sB

AEs

timati

ng an

d plan

ning

DC

BA

Mome

nt of

involv

emen

tB

ALif

e-cy

cle m

odel

DC

BA

Test

strate

gyp

g

TPI –

mat

rix®

Test

repo

rt1.

Summ

ary

2. Va

rianc

es

3. Co

mpre

hens

ivene

ss4.

Summ

ary o

f res

ults

5. Ev

aluati

on

6. Su

mmar

y of

activ

ities

Proc

ess

impr

ovem

ent

Fault

corre

ction

From

test

bas

is to

test

case

s

Tool

supp

ort

for t

est

spec

ifica

tion

Test

desig

nTe

st inp

ut da

ta pr

epar

ation

Test

orac

les

A foo

l with

a too

l is

still a

fool

Test

pro

cess

for a

ll tes

t pha

ses Monitoring and control

Test

plan

ning

Test

spec

ifica

tion

Test

exec

utio

n

Incide

nt re

port

Incid

ent re

port

Reco

gnitio

nsu

ppor

ting d

atacla

ssific

ation

impa

ctInv

estig

ation

supp

ortin

g data

class

ificati

onim

pact

Actio

n supp

ortin

g data

class

ificati

onim

pact

Disp

ositio

nsu

ppor

ting d

atacla

ssific

.im

pact

The g

olde

n ru

le of

test

ing:

Alwa

ys te

st so

that

when

ever

yo

u hav

e to s

top yo

u hav

e do

ne th

e bes

t pos

sible

test.

Coop

erat

ion

mat

rix

Matur

ity le

vels

55 44 33 22 1

12

34

5

Test

Spe

cifica

tion

1. T

est D

esign

1.1

Featu

res t

o be t

ested

1.2

Appr

oach

refin

emen

t1.3

As

socia

ted te

st ca

se1.4

Fe

ature

pass

/fail c

riteria

2. T

est C

ases

2.1 T

est C

ase 1

2.1.1

Test

items

(rati

onale

) 2.1

.2 P

rere

quisi

tes2.1

.3 In

puts

2.1.4

Exp

ected

outco

mes

2.1.5

Inter

case

de

pend

encie

s

2.N

Test

Case

n

Trac

e tab

les

If yo

u do

n’t m

easu

re yo

u’re

left

with

on

ly on

e rea

son

to b

eliev

e you

’re in

co

ntro

l –hy

ster

ical o

ptim

ism.

Tom

De M

arco

Testg

rupp

eTe

stgru

ppe

Test

proc

edur

e /

Test

scrip

t

4321 4321

Base

docu

ment

Test

cond

itions

/ Te

st re

quire

ments

deriv

ecre

ate us

ing

test c

ase d

esign

tech

nique

s

Test

Pro

cedu

re1.

Purp

ose

2. Pr

ereq

uisite

s3.

Proc

edur

e ste

ps

Test

case

des

ign

tech

niqu

esSp

ecific

ation

base

d-e

quiva

lence

clas

s par

tition

ing-b

ound

ary v

alue a

nalys

is-d

ecisi

on ta

bles

-stat

e tra

nsitio

ns-u

se ca

ses

Expe

rienc

e bas

ed-e

rror g

uess

ing-c

heck

lists

-exp

lorato

rySt

ructu

re ba

sed

-stat

emen

ts-d

ecisi

ons

-con

dition

s-m

odels

The w

hite

-box

inse

ct statem

ent

decis

ion

bran

chbr

anch

bran

ch (in

)

bran

ch po

int

(out)

decis

ion ou

tcome

basic

bloc

k-------

-------

-------

-------

-------

-------

-------

-------

-------

-------

-------

-------

(out)

cond

ition

proc

edur

esm

etho

dste

chni

ques

Lear

ning

Act

ions

Dep

loym

ent

Adj

ustm

ent

Tool

s

Key areas

Custo

mer

satis

factio

n

Orga

nize i

nto

÷Te

st ca

ses

Test

cove

rage

% of

the c

over

age i

tems t

ouch

ed by

a tes

t

Cove

rage

items

:-s

tatem

ents,

decis

ions,

cond

itions

-inter

faces

-use

r req

uirem

ents,

use c

ases

-bus

iness

proc

esse

s, bu

sines

s goa

ls

Sca

le

Depl

oym

ent

Main

tena

nce t

estin

gTo

ol su

ppor

t for

mon

itorin

gCo

ntinu

ous a

nalys

is of

usag

e H

yper

links

Disp

osal

Chec

king

for

test

com

plet

ion

Test

re

cord

ing

corre

ction

of

thetes

t obje

ct

Phas

ete

st

repo

rt

Test

logs

Phas

ete

st

repo

rtPh

ase

test

re

port

Phas

ete

st

repo

rtPh

ase

test

re

port Ov

erall

test

repo

rt

Busin

ess

requ

irem

ents

Tool

supp

ort f

or te

st ex

ecut

ion

and

logg

ing

Test

runn

ingTe

st sc

ript g

ener

ation

Test

harn

ess a

nd dr

ivers

C

over

age m

easu

reme

nt Co

mpar

ators

Sim

ulator

S

ecur

ity te

sting

Test

envir

onm

ent

Hard

ware

, soft

ware

, netw

ork,

other

syste

ms, to

ols, d

ata,

room

, per

ipher

als, s

tation

ary,

chair

s, ‘ph

ones

, food

, drin

k, ca

ndy

Tool

supp

ort f

or n

on-fu

nctio

nalt

est P

erfor

manc

e, Lo

ad, S

tress

D

Leve

l 1: I

nitia

l

Leve

l 2: P

hase

Def

initi

on

•In

stitu

tiona

lise

basi

c te

stin

g te

chni

ques

and

met

hods

•In

itiat

e a

test

pla

nnin

g pr

oces

s•

Dev

elop

test

ing

and

debu

ggin

g go

als

Leve

l 2: P

hase

Def

initi

on

•In

stitu

tiona

lise

basi

c te

stin

g te

chni

ques

and

met

hods

•In

itiat

e a

test

pla

nnin

g pr

oces

s•

Dev

elop

test

ing

and

debu

ggin

g go

als

Leve

l 3: I

nteg

ratio

n

•C

ontro

l and

mon

itor t

he te

st p

roce

ss•

Inte

grat

e te

stin

g in

to th

e so

ftwar

e lif

ecyc

le•

Esta

blis

h a

tech

nica

l tra

inin

g pr

ogra

m•

Esta

blis

h a

softw

are

test

org

anis

atio

n

Leve

l 3: I

nteg

ratio

n

•C

ontro

l and

mon

itor t

he te

st p

roce

ss•

Inte

grat

e te

stin

g in

to th

e so

ftwar

e lif

ecyc

le•

Esta

blis

h a

tech

nica

l tra

inin

g pr

ogra

m•

Esta

blis

h a

softw

are

test

org

anis

atio

n

Leve

l 4: M

anag

emen

t and

Mea

sure

men

t

•So

ftwar

e qu

ality

eva

luat

ion

•Es

tabl

ish

a te

st m

easu

rem

ent p

rogr

am•

Esta

blis

h an

org

anis

atio

n-w

ide

revi

ew p

rogr

am

Leve

l 4: M

anag

emen

t and

Mea

sure

men

t

•So

ftwar

e qu

ality

eva

luat

ion

•Es

tabl

ish

a te

st m

easu

rem

ent p

rogr

am•

Esta

blis

h an

org

anis

atio

n-w

ide

revi

ew p

rogr

am

Leve

l 5: O

ptim

izat

ion,

Def

ect P

reve

ntio

n an

d Q

ualit

y C

ontro

l

•Te

st p

roce

ss o

ptim

isat

ion

•Q

ualit

y co

ntro

l•

Appl

icat

ion

of p

roce

ss d

ata

for d

efec

t pre

vent

ion

Leve

l 5: O

ptim

izat

ion,

Def

ect P

reve

ntio

n an

d Q

ualit

y C

ontro

l

•Te

st p

roce

ss o

ptim

isat

ion

•Q

ualit

y co

ntro

l•

Appl

icat

ion

of p

roce

ss d

ata

for d

efec

t pre

vent

ion

Repo

rt