crafting effective multiple choice questions
TRANSCRIPT
Slide 1
Crafting Effective Multiple
Choice Questions
Crafting
Effective
Multiple Choice
Questions
Slide 2
Crafting Effective Multiple
Choice Questions
Overview
1. Multiple Choice Testing
2. Advantages of Multiple Choice Questions
3. Constructing a Meaningful Problem (Stem)
4. Create Effective Answer Options
Source: Test Generator – Crafting Effective Multiple Choice Questions
Slide 3
Crafting Effective Multiple
Choice Questions
• Multiple choice exams can be created using test generator software.
• These exams are a straight-forward and efficient way to test knowledge.
• The compact nature of multiple choice questions means that test-takers can be assessed on a wider range of information than might be covered on more subjective tests.
• When it comes to ensuring reliability and validity, crafting effective multiple choice questions can be quite challenging.
Multiple Choice Testing
Source: Test Generator – Crafting Effective Multiple Choice Questions
Slide 4
Crafting Effective Multiple
Choice Questions
• There are usually four options with multiple choice tests, so test takers are unlikely to pass by merely guessing answers.
• The answers in multiple choice tests are objective, so bias in grading is vastly reduced.
• With the use of online exam software, multiple choice tests take less time to administer than tests with subjective responses.
– This can result in a more comprehensive evaluation of a test taker’s knowledge.
Advantages of Multiple Choice Questions
Source: Test Generator – Crafting Effective Multiple Choice Questions
Slide 5
Crafting Effective Multiple
Choice Questions
Constructing a Meaningful Problem (Stem)
• When administrators create a test with multiple choice questions, the “stem” is the question candidates endeavor to answer.
• Some authors make the mistake of excluding a problem from the stem, thus making the stem meaningless.
– For example, a non-meaningful stem would state “World War 2 was:” with a list of potential response.
• These types of stems are vague and do not present the candidate with a legitimate problem to solve.
• A meaningful stem may instead ask “What was a contributing factor to the outbreak of WW2?”.
Source: Test Generator – Crafting Effective Multiple Choice Questions
Slide 6
Crafting Effective Multiple
Choice Questions
• It’s important to ensure that stems do not contain irrelevant material that could confuse the test-taker and decrease the reliability of the assessment.
• It’s also important to remember that a multiple choice stem should never be written in the negative unless the negative is imperative to the question.
• Test takers often have a difficult time switching between the negative and the affirmative, so if the question must include a negative, it is important to bold the negative words so they are not overlooked.
Constructing a Meaningful Problem (Stem)
Source: Test Generator – Crafting Effective Multiple Choice Questions
Slide 7
Crafting Effective Multiple
Choice Questions
Create Effective Answer Options
• When using a test maker to design an online assessment, administrators should understand the importance of multiple choice “distractors.”
• Distractors are potential answers which seem plausible, but are incorrect, and show the test administrator which candidates really know and understand the material.
• Implausible distractors are those which are obviously not the answer.
– If the test asks who invented moving film and an answer option is George Lucas, this is an implausible distractor.
Source: Test Generator – Crafting Effective Multiple Choice Questions
Slide 8
Crafting Effective Multiple
Choice Questions
• Distractors which contain overlapping content containing the correct answer will likely be regarded as “tricks” and will erode trust in the test.
• Just like with wordy stems, wordy answers will also lead to unreliable test results.
• When administrators create a test, it’s important that they keep answers concise.
Create Effective Answer Options
Source: Test Generator – Crafting Effective Multiple Choice Questions
Slide 9
Crafting Effective Multiple
Choice Questions
Questions? 928.266.0553 [email protected]
Visit our Website: Test Generator