-
7/25/2019 Day 2 - ASL
1/22
National Seminar-Workshop on
Assessing Student LearningCurrent Trends on Classroom
Applicationof Test and Measurement
February 15-16, 2008Venue: Institute for Small Scale
Industries(ISSI
Virata !all, "# $acinto Street%& 'iliman, ue)on *ity
Prepared by:
+nunciacion V# ara, '#%ni.ersity of te &ili//ines
'iliman, ue)on *ity
-
7/25/2019 Day 2 - ASL
2/22
Day Two
-
7/25/2019 Day 2 - ASL
3/22
Session One
Topi:'eterminin te uality of a est trouValidity
!" Learning Targets
+t te end of tis session te /artici/antssould be able to:a# dene
te term .alidityb# describe te ty/es of .alidity
c# identify ty/es of criterion-related .alidation
d# identify ty/es of e.idence used inconstruct .alidation
-
7/25/2019 Day 2 - ASL
4/22
!" Learning Targets+t te end of tis session te /artici/antssould
be able to:
e# describe te metods used in te.alidity of te inter/retations
from
te test scores
e# identify construct .alidation3 and
f# a//reciate te .alidity of test#
-
7/25/2019 Day 2 - ASL
5/22
!!" Session Notes
A" De#nition and other $eatures o$
%alidity
Validity refers to te a//ro/riateness of te
inter/retation of te results of a test or
e.aluation instrument for a i.en rou/ of
indi.iduals, and not to te instrument itself#
It is more correct to s/ea4 of te .alidity ofte inter/retation
to be made of te
results#
-
7/25/2019 Day 2 - ASL
6/22
Validity is a matter of deree#
est considered in terms of cateories tat
s/ecify deree, suc as i .alidity, moderate
.alidity and lo .alidity#
Is alays s/ecic to some /articular useinter/retation#
Is as unitary conce/t based on .arious 4inds of
e.idence#
-
7/25/2019 Day 2 - ASL
7/22
&" Approahes to Test 'alidation
*ontent-related e.idence
*riterion-related e.idence
*onstruct-related e.idence
(" Types o$ riterion-related%alidation )based on time
di*ereneonly+
-
7/25/2019 Day 2 - ASL
8/22
-
7/25/2019 Day 2 - ASL
9/22
D" Some types o$ e%idene in onstrut%alidation
7at easonin est *om/are te test tas4s to te tas4 domain
(content-related e.idence#
!a.e test ta4ers 9in4 +loud as tey anser
(to cec4 on mental /rocess# *om/are scores of mat ma;ors it
scores of
non-ma;ors#
*orrelate scores of oter mat reasonin tests#
*orrelate scores it scores of readin tests(to rule out readin
ability#
*orrelate scores it mat rades
(criterion-related e.idence#
-
7/25/2019 Day 2 - ASL
10/22
," ethods used in (onstrut %alidation
'enin te domain of tas4s to be measured#
+naly)in te mental /rocess re
-
7/25/2019 Day 2 - ASL
11/22
." .ators that lower the %alidity o$ theinterpretations $rom the
test sores
%nclear direction
eadin .ocabulary and sentence structure toodi=cult
+//ro/riate le.el of di=culty of te test items
&oorly constructed test items
+mbiuity
-
7/25/2019 Day 2 - ASL
12/22
." .ators that lower the %alidity o$ theinterpretations $rom the
test sores
est items ina//ro/riate for te outcomesbein measured
Inade
-
7/25/2019 Day 2 - ASL
13/22
Session Two
Topi: Determining the /uality o$ a Test through0eliability
!" Learning Targets+t te end of tis session te /artici/ants
souldbe able to:
a# dene te term reliability3b# dene basic terminoloy: coe=cient,
.alidity
coe=cient and reliability coe=cient3c# e>/lain te /rocedure
for determinin reliability by
correlation metods3d# discuss te metods of estimatin
reliability3e# e>/lain reliability demands and nature of te
decision3 andf# a//reciate te reliability of tests#
-
7/25/2019 Day 2 - ASL
14/22
!!" Session Notes
De#nition and other $eatures o$ reliability
eliability refers to te results obtained itan assessment
instrument and not to te
instrument itself# +n estimate of reliability alays refers to
a
/articular ty/e of consistency#
-
7/25/2019 Day 2 - ASL
15/22
est scores are reliable (or enerali)able o.er
di?erent /eriods of time
di?erent scores of
-
7/25/2019 Day 2 - ASL
16/22
&"Determining reliability by orrelationmethods(refer to
+ttacment @1 eliability
(" ethods o$ estimating reliability(refer to +ttacment @2 A
eliability
-
7/25/2019 Day 2 - ASL
17/22
D" Some basi terminology
*orrelation coe=cient
Validity *oe=cient
eliability coe=cient (refer to +ttacment @ B- eliability
-
7/25/2019 Day 2 - ASL
18/22
," 0eliability demands and nature o$ thedeision
!i reliability is demanded en te
'ecision is im/ortant#
'ecision is nal#
'ecision concerns indi.iduals#
">am/le:
Select or re;ect collee a//licant#
-
7/25/2019 Day 2 - ASL
19/22
o reliability is tolerable en te
'ecision is minor im/ortance
'ecisions concerns rou/s
'ecision ma4in is in early stae
'ecision is re.ersible
">am/le:
C Deter to re.ie a classroom lesson#
-
7/25/2019 Day 2 - ASL
20/22
Session Three
Workshop !!:,1erises on 'alidity and
0eliability!" Learning Targets
+t te end of te session te /artici/antssould be able to:
a# anser e>ercises on .alidity and reliability3
b# calculate te &earson rusin bot tede.iation score formula
and te ra scoreformula3
c# inter/ret te &earson r a//reciatecorrelation
coe=cient#
-
7/25/2019 Day 2 - ASL
21/22
!!" Workshop !!
1# 'iscussion of e>ercise on reliability and.alidity#
2# 'iscussion of te &earson /roduct-momentcorrelation and te
to formulae#
B# *alculation of &earsonr#
E# Inter/retation of &earson r#
-
7/25/2019 Day 2 - ASL
22/22
an4 you#
