The effect of medium of learning and levels of processing on test performance

Flying Circus

Topic and Rationale•Technology is

common place •Computers and

tablets commonly used to study

•Exams still done on paper

Topic and Rationale•Students are studying

using on screen learning (OSL) but taking exams on paper

•Exam scores are lower for OSL versus on paper learning (OPL)

•The difference is due to metacognitive learning regulation (MLR)

Previous Research•Ackerman and

Lauterman (2012) •OSL promotes

shallow processing•Lower retention

rates

Previous Research• Ackerman and

Goldsmith (2011)• screen use cues

us to shallow processing

Previous Research• Craik and Lockhart

(1972) • Levels Of Processing

Theory• How one

processes information is what matters

• Retention depends on depth of processing

Research Question•Are the negative

effects of OSL on test performance due to the nature of screen devices, or is it the learning behaviors that are commonly employed when using screen devices?

Design• Independent Variables

• Level of Processing

• Shallow or Deep

• Medium of Word List

• Computer or Paper

• Dependent Variable

• Performance on a free recall task

Predictions• Main effect of level of

processing• deep = higher

retention• shallow = lower

retention• No main effect of

medium of word list• There will be no

interaction

Method

Participants• 39 undergrad

students at WWU• Obtained from

university’s psychology research pool

Materials• 20 words• Nouns• Priming questions

• 20 2-digit math problems

• Less words recalled equals shallow processing

In what instance would this be most useful?

How many vowels are in this word?

Sound

Procedure• Assigned to one of four

conditions

• Computer & shallow processing

• Computer & deep processing

• Paper & shallow processing

• Paper & deep processing

Procedure• Signed consent form

• Given 15 minutes to:

• study flash cards

• Solve math problems

• Free recall task

• Demographic questionnaire

• Debriefed and dismissed

Results

Results• 2x2 ANOVA• Between subjects

design• Alpha level of .05

Results• Main effect of level of

processing

• F(1, 35) = 30.095, p < .001, η2 = .43

• Main effect of medium of study

• F(1, 35) = 5.06, p = .03, η2 = .07

• No interaction

• F(1, 35) = .256, p = .616, η2 = .004

Results

Discussion

Research Question•Are the negative

effects of OSL on test performance due to the nature of screen devices, or is it the learning behaviors that are commonly employed when using screen devices?

Predictions• main effects of level of

processing• Results DID support this

hypothesis• No main effects of medium

of study• Results DID NOT support

this hypothesis• No interaction

• Results DID support this hypothesis

Limitations• Sample population may have consisted of

particularly tech-savvy students

• Generational

• Canvas

• Eco-friendly

• If students were not equally tech-savvy, there may not have been a main effect of medium of study (consistent with our predictions)

Limitations• Nature of paper conditions

• More material

• Greater cognitive load, decreases working memory

• Less room for learning and memorizing material

• If the tasks were equally difficult, there may not have been a main effect of medium of study (consistent with our predictions)

Future Directions• Are there different effects of

medium of study on test performance between individuals of different levels of technological skill?• Low skill vs. High skill

• Do individuals of different populations have varying effects of medium of study on test performance?• Age• Socio-economic status• Culture

Any questions?

Thank you!