Are Clickers Worth It? … is all about: Writing good clicker questions

Are Clickers Worth It?

… is all about:Writing good clicker questions

Klaus WoelkInterim Chair / Associate Professor

Chemistry Department

Are Clickers Worth It?

Klaus WoelkInterim Chair / Associate Professor

Chemistry Department

You came here because you heard about clickers or have already used them, and you wish to learn more.

2%

7%

1%

15%

76% 1. Strongly agree2. Agree3. Don’t know4. Disagree5. Strongly disagree

Klaus WoelkInterim Chair / Associate Professor

Chemistry Department

Students who dislike clickers complain mostly about ...

50%

10%

20%

20% 1. Instructors not using them enough2. Instructors not using them right3. Technology problems4. No particular reason

Klaus WoelkInterim Chair / Associate Professor

Chemistry Department

Students who dislike clickers complain mostly about ...

50%

10%

20%

20% 1. Instructors not using them enough2. Instructors not using them right3. Technology problems4. No particular reason

Writing Good Clicker Questions

--- Group Activity ---

Answer the following questions:• What would you like to achieve with a clicker

question during the lecture?• Why do you need the feedback from your

students for this purpose?• Why are clickers the method of choice for this

purpose?

Writing Good Clicker Questions

Important Considerations• What role should testing play in the learning

process? • How can tests create a real dialogue between

ourselves and our students about what students do and do not understand?

• How can we avoid using tests to simply punish or reward cramming?

http://tep.uoregon.edu/resources/assessment/multiplechoicequestions/importantconsider.html

Writing Good Clicker Questions

Some suggestions• Use frequent, small quizzes and tests rather

than monolithic once-or-twice per-term exams.• Give students instant feedback on their

performance (for example, putting the correct answers up on an overhead after all the tests are turned in).

• Consider allowing students to take quizzes first as individuals and then the same quiz again in groups.

http://tep.uoregon.edu/resources/assessment/multiplechoicequestions/importantconsider.html

Developing Good Clicker Questions

Note the Order of Tasks

• Determine the goal for your clicker question.

Goals of Clicker Questions

• check attendance• assess preparedness• create interest and motivation• evaluate learning progress• promote conceptual understanding• advance critical thinking

Taxonomy of Clicker Utilization• 6 basic categories

– 3 categories to test the current standing or stipulation of students• Attendance• Preparedness• Interest

– 3 categories to probe into the learning progress• Learning• Understanding• Applying

J. Chem. Educ. 85 (2008) 1400 – 1405

Developing Good Clicker Questions

Note the Order of Tasks

• Determine the goal for your clicker question.• Find an appropriate task (icebreaker, numerical

calculation, discussion problem, new application, etc.) to fulfill the goal.

x ≥ 0 is valid for – 3 (x – 4 ) = x + 4

1. True2. False

– 3x + 12 = x + 4 – 4x = – 8 x = 2 (t)

– 3x – 12 = x + 4 – 4x = 16 x = – 4 (f)– 3x + 4 = x + 4 – 4x = 0 x = 0 (t)– 3x – 4 = x + 4 – 4x = 8 x = – 2 (f)

Question must be: x > 0 is valid for – 3 (x – 4 ) = x + 4

Developing Good Clicker Questions

Note the Order of Tasks

• Determine the goal for your clicker question.• Find an appropriate task (icebreaker, numerical

calculation, discussion problem, new application, etc.) to fulfill the goal.

• Check the correct answer.• If multiple choice, find qualified distracters?

Writing Good Clicker Questions

--- Group Activity ---

Develop a good clicker question!

Attendance: Taking and honoring attendance

reduces the number of students dropping out or finishing with low grades (D’s and F’s).

Doing it with clickers is particularly efficient in large-enrollment courses.

Click ― I am here

34%

17%

6%

2%

12%

8%

15%

7%

Many of us know the historic town of Washington, MO. Which other name refers to a town in Missouri?

1. Pittsburg2. Philadelphia3. Nashville4. Cleveland5. Denver6. Knoxville7. Miami8. Houston

Preparedness: Clicker quizzes on assigned

reading assure preparedness for the topics covered in class.

Well-picked question and appropriate grading are essential.

Click ― I am prepared

Trivia question:

The first person to survive plunging over Niagara Falls in a barrel was a 63 year old woman.

Annie Taylor did it in 1901, and afterwards was quoted as saying: “No one ought ever do that again.”

57%

43% 1. Fact2. Crap

Motivation: Polling on common knowledge or

opinions (even on controversial issues or common misconceptions) creates initial interest and motivation.

It is crucial that students have developed trust in the technology, especially, if responses are collected anonymously.

Click ― I am interested

In 20 years, my car will likely be fueled by …

2%16%

13%4%

31%34% 1. Gasoline

2. Electricity3. Hydrogen4. Biodiesel5. Ethanol6. None of the above

Learning: On-the-spot assessment improves

student alertness and offers immediate feedback on the learning progress to both student and instructor.

Repeating a question or posting a similar one can be used for progress evaluation and student satisfaction.

Click ― I learn

The Criss-cross Rule

Al3+

Al2

O2-

O 3

NH+

PO3-

4 4

NH PO 4 4( )3

Which ionic compound has a cation-to-anion ratio of 3:2 ?

1%

2%

82%

15%

Apatite: Ca3(PO4)2

1. Aluminum carbonate: Al 3+ CO3 2-

2. Calcium phosphate: Ca 2+ PO4 3-

3. Magnesium carbonate: Mg 2+ CO3

2-

4. Sodium nitrate: Na + NO3

-

Are you really testing learning?

The true shape of the Earth is best described as a

2%97%1%0% 1. … perfect sphere

2. … perfect ellipse3. … slightly oblate sphere4. … highly eccentric ellipse

A density of 2.24 g/mL results when 2.24 g of material occupy a volume of 1.00 mL. What mass of the same material will occupy a volume of 3.00 mL? Enter your result correctly rounded off to 3 significant digits.

6.72 680.75 252.24 70.74 71.34 3

In what order will you pass the following cities when travelling the Mississippi River from north to south?

(1) Davenport (2) Dubuque (3) Grand Rapids(4) Hannibal (5) Memphis (6) Vicksburg

Enter all numbers in the correct order but without spaces (e.g., 123456)

321456 55312456 41654123 8213456 43 2 1 4 5 6 2

Correct: +1Incorrect: -1

Grading of Clicker Questions• acknowledge participation

– correct 1 - 2 points– incorrect 1 point

• participation is not an achievement– correct 1 point– incorrect 0 points

• encourage discussion– correct 1 - 2 points– incorrect -1 point

Understanding: Asking about a subject matter in

different ways provides insight into students’ understanding.

Active learning is fostered by encouraging peer discussion and instruction during the response time or by a repeated poll if the responses are split between different answers.

Click ― I understand

Is a concept understood?

At which location would an observer find the greatest force due to Earth's gravity?

18%2%53%27%

10

1. The center of the earth2. The north pole3. The tropic of Cancer (23.5 N)4. The equator

Deferred multiple choices

How confident are you that your answer was correct.

48%

20%

11%

12%

9% 1. Absolutely sure2. Very confident3. Confident4. Not very confident5. Not sure at all

Sulfur tetrafluoride is a polar molecule.

57%

43% 1. Fact2. Crap

Sulfur tetrafluoride is a polar molecule.

22%

78% 1. Fact2. Crap

Applying: Conceptual knowledge and

mastery is created when clicker questions branch into areas beyond the material covered in class or in the textbook requiring the application of newly taught concepts to real-world or open-ended problems.

Click ― I apply

To facilitate the conversion of H2S2O8 to yield S2H4, you must add as a key reactant …

2%8%7%38%24%5%9%7% 1. … a strong acid.

2. … a weak acid.3. … a base.4. … an oxidizing reactant.5. … a reducing agent.6. … a polar solvent.7. … a non-polar solvent.8. … nothing (the reaction will occur by itself).

Summary• Clickers are found in many highschool, college,

and university classrooms• They provide more than just immediate feedback to

instructor and students• Six basic ways of utilizing the power of clickers

• Attendance • Preparedness • Initial interest and motivation

• On-the-spot assessment (formative assessment)• Active learning (peer discussion and instruction)• Problem-based, deep learning (mastery of concepts, applications

to real-world, or open-ended problems)

9%

27%

20%

6%

2%

37%

Open-ended Problems: What is a valid Lewis Structure for the cyanate ion?

1. ¯ N = C = O

2. N ≡ C = O ¯

3. N – C – O ¯

4. ¯ ¯ N – C ≡ O +

5. N ≡ C – O ¯

6. N – C = O ¯

Using Open-ended Problems

Click ― I will be here

Click ― I will be prepared

Click ― I will be interested

J. Chem. Educ. 2008, 85, 1400-1405