MCQ MCQ Multiple Choice Questions Why concern? •...

MCQMCQMultiple Choice Questions

Why concern?Why concern?

• ยั�งคงมี�การใช้�อยั��–ข้�อสอบ comprehensive 4 สถาบ�น–ข้�อสอบ national test แพทยัสภา

• เช้�ยังใหมี� (ดู�เหมี�อนจะ) มี�ปั!ญหา–ภาควิ$ช้าส�วินใหญ� ไมี�มี�ระบบค�ดูกรองข้�อสอบ

อยั�างจร$งจ�ง–ส�ดูส�วินข้�อสอบไดู�ร�บการค�ดูเลื�อกน�อยั–ผลืการสอบข้อง นศพ. เช้�ยังใหมี� ไมี�สวิยังามี

เท�าไรน�ก

Why still be used?Why still be used?

• reliability • content validity • practicality

Why educator hate it?Why educator hate it?

• poor MCQ–validity

• patient doesn’t come with choices!

–lower order thinking• recall

First ConclusionFirst Conclusion

• It still be used

• National licensing examination–Part I: basic sc 300 items

–Part II: clinical sc 450 items

• We have to improve ourselves

How to construct?How to construct?

• planning

• writing

• reviewing and revising

• publishing

How to improve?How to improve?

• knowledge

• skill

• attitude

Basic KnowledgeBasic Knowledge

• Theoretically; MCQ = –one best answer, +

–matching, +

–extended matching, + etc

• Practically; –MCQ => one best answer

PlanningPlanning

• identify the outcome–Medical Council Standard

–cognitive domain

Cognitive DomainCognitive Domain

knowledgeknowledge

comprehensivecomprehensive

applicationapplication

analysisanalysis

synthesissynthesis

evaluationevaluation

recallrecall

interpretationinterpretation

-problem solving-problem solving

ApplicationApplication

recallrecall

PlanningPlanning

• identify the outcome–Medical Council Standard

–cognitive domain

• identify number of item–time => 150 item : 180 min

–formula

• table of specification

Table of SpecificationTable of Specification

สาระน้ำ��าหน้ำก(รวม

100%)

จำ�าน้ำวน้ำข้�อสอบ

(รวม 300

ข้�อ)B1 General Principles 33% 100

B1.1 Biochemistry and molecular biology 10% 10

B1.2 Biology of cells 10% 10

B1.3 Human development and genetics 10% 10

B1.4 Biology of tissue response to disease 10% 10

B1.5 Gender, ethnic, and behavioral considerations affecting disease treatment and prevention, including psychosocial, cultural, occupational, and environment

5% 5

Table of SpecificationTable of Specification

สาระ น้ำ��าหน้ำก(รวม

100%)

จำ�าน้ำวน้ำข้�อสอบ

(รวม 300 ข้�อ)

B1 General Principles 33% 100

B1.6 Multisystem processes 10% 10

B1.7 Principles of specimen collections and laboratory interpretations

5% 5

B1.8 Pharmacodynamic and pharmacokinetic processes

10% 10

B1.9 Microbial biology and infection 10% 10

B1.10 Immune responses 10% 10

B1.11 Quantitative methods 10% 10

Table of SpecificationTable of Specification

สาระ น้ำ��าหน้ำก(รวม

100%)

จำ�าน้ำวน้ำข้�อสอบ

(รวม 300 ข้�อ)

B2 Hematopoietic and Lymphoreticular System 7.4% 22

B2.1 Normal processes 40% 9

B2.2 Abnormal processes 40% 9

B2.3 Principles of therapeutics 10% 2

B2.4 Gender, ethnic, and behavioral considerations affecting disease treatment and prevention, including psychosocial, cultural, occupational, and environment

10% 2

Table of SpecificationTable of Specification

• Cognitive taxonomy ratio–recall : application

• basic sciences = 50:50

• body system = 30:70

PlanningPlanning

• identify the outcome–Medical Council Standard

–cognitive domain

• identify number of item–time => 150 item : 180 min

–formula

• table of specification

WritingWriting

• 1 item = stem + options• stem• options / choices

–1 answer / key–3-4 distracters

• avoid testwiseness• avoid irrelevant difficulty

Good StemGood Stem

• Valid

• What? => TMC standard

• Which aspect? => Form

• How deep? => For GP

Good StemGood Stem

• avoid–trivial fact

• color reagent

• enzyme

–extreme recall• the second most common

• the least common

Good StemGood Stem

• 1 stem = 1 aspect

• No more –What are … and …?

• Usually long stem + short options

• Don’t teach in the test!

Good StemGood Stem

• 1 stem = 1 aspect

• No more –What are … and …?

• Usually long stem + short options

• Don’t teach in the test!

Good StemGood Stem

• Vignette + leading question

Item template : Gross anatomy A (patient description) is unable to (functional disability). Which of the following is most likely to have been injured?

A 65-year-old man has difficulty rising from a seated position and straightening his trunk, but he has no difficulty flexing his leg. Which of the following muscles is most likely to have been injured?

Good StemGood Stem

Item template : A (patient description) has (history findings) and is taking (medications). Which of the following medications is the most likely cause of his (one history, PE or lab finding)?

Item template :A (patient description) has a (type of injury and location). Which of the following structures is most likely to be affected?

Good StemGood Stem

Item template :A (patient description) has (abnormal findings). Which [additional] finding would suggest/suggests a diagnosis of (disease 1) rather than (disease 2)?

Item template :A (patient description) dies of (disease). Which of the following is most likely finding on autopsy?

Good StemGood Stem

A patient has (abnormal findings) but (normal findings). Which of the following is the most likely diagnosis?

Item template : A patient has (symptoms and signs). Which of the following is the most likely explanation for the (findings)?

Good StemGood Stem

• Series of stems are fine–BUT independent

Good StemGood Stem

• Should not –What do you think?

Good StemGood Stem

• allow data gathering

• provide a sizable data base

• simulate reality

• include appropriate “noise”

• start with problem, not a diagnosis

• use unfamiliar (not uncommon) case

• test only cognitive objective

• avoid diagnostic label

Good OptionsGood Options

• same direction

• similar length, otherwise–long answer + short distracters

• similar style, otherwise–nice answer (copy from textbook) +

poor distracters

Good DistractorsGood Distractors

• incorrect!

• reasonable

• common misunderstanding

• common mistakes

Options TidinessOptions Tidiness

• sequencing–alphabetical

–length

–chronological

–logical

• word repeated

TestwisenessTestwiseness

• grammatically guide

• totally, absolutely, none, etc

• latin translation

• all of above, none of above, K type

• question A => answer of question B

Unawares, the answerUnawares, the answer

• is usually the option which is–longest

–looked nicest

–most understandable

–appeared most frequent

Irrelevant difficultyIrrelevant difficulty

• poor written, poor chart

• double negative

• too long, too complicated

• difficult vocabulary, jargon

• unordered number

• subjective : often, usually

• tricky

How to construct?How to construct?

• planning

• writing

• reviewing and revising–self-test

–pilot / colleagues

• publishing–readable

How to improve?How to improve?

• Knowledge

• Skill

• Attitude

SkillSkill

• Practicing–Form

–Item development team

–Item analysis

MiscellaneousMiscellaneous

• AI

• p

• r

• item sequencing

ConclusionConclusion

• Knowledge

• Skill

• Attitude