Designing Summative Assessments via Bloom's Taxonomy
Objective Item Craftsmanship
The Anatomy of a Good Question
A well-crafted multiple-choice question is a precision instrument. It doesn't just check for memorization; it probes understanding. Each question has three core parts: the stem, the key, and the distractors. Getting each part right is critical to measuring what a student actually knows.
The stem is the question or problem. It should be clear, concise, and pose a complete problem on its own. A student should be able to formulate an answer just by reading the stem.
Consider this poorly written stem:
"Photosynthesis is..."
This is too open-ended. A student has to read all the options to even understand what the question is asking. A better stem is a direct question:
"Which of the following is the primary product of photosynthesis that provides energy for the plant?"
Next is the key, which is the one unambiguously correct answer. It must be indisputably right. Finally, you have the distractors. These are the incorrect options, but they shouldn't be random. Good distractors are plausible. They represent common misconceptions, logical errors, or answers that are correct in a different context. The goal is for a student who doesn't know the material to find them tempting.
Sidestepping Common Traps
Many multiple-choice questions accidentally contain clues that have nothing to do with the content. These flaws allow students to guess correctly using rather than actual knowledge. Your goal is to eliminate these tells.
Here are the most common traps to avoid:
| Flaw to Avoid | Description | Example (Flawed) |
|---|---|---|
| Grammatical Cues | The stem and the key fit together grammatically, while the distractors do not. | Which part of the cell is an... a) mitochondria b) ribosome c) organelle d) nucleus |
| Absolute Language | Options use words like always, never, or all. These are rarely true, making them easy to eliminate. | To improve your writing, you should: a) Always avoid passive voice. b) Never start a sentence with 'And'. c) Vary your sentence structure. |
| Convergent Options | Two options are very similar, suggesting one of them is likely the key. | What is the capital of Australia? a) Sydney b) Melbourne c) Canberra d) Perth |
| Length/Detail Mismatch | The key is significantly longer or more detailed than the distractors. | A key feature of the scientific method is: a) Proving theories. b) A systematic process of observation, measurement, experiment, and the formulation, testing, and modification of hypotheses. c) Guessing answers. |
Another common crutch is using "All of the above" or "None of the above." While tempting, these can be problematic. If a student identifies just two options as correct, they can confidently select "All of the above" without considering the third. Similarly, "None of the above" turns the question into a true/false series, changing the cognitive task you're trying to measure.
How Many Choices?
The standard format for multiple-choice questions has long been four options: one key and three distractors. The logic was simple: with four options, a random guess has a 25% chance of being correct. This seemed like a good balance between rigor and practicality. But is it always the best approach?
Recent research challenges this tradition. Studies suggest that the third distractor is often just filler. It's difficult to write three plausible, high-quality distractors for every question. As a result, the third one is frequently non-functional, meaning almost no one chooses it. It doesn't effectively differentiate between students who know the material and those who don't.
High-quality multiple choice questions can do more than test a student's memory—they can uncover thought processes and conceptual understanding.
Switching to a three-option format (one key, two distractors) can be more efficient. It forces you to focus on creating two excellent distractors that target common errors. This saves time for the test creator and, more importantly, for the student. With less time spent reading a non-functional option, students can devote more cognitive energy to the actual problem posed in the stem. Evidence indicates that well-written, three-option questions can be just as reliable and valid as their four-option counterparts.
Of course, context matters. For complex, higher-order questions at the 'Analyze' or 'Evaluate' levels of Bloom's Taxonomy, having a third distractor might be necessary to introduce sufficient nuance. But for most knowledge and application questions, three options are often stronger.
Here's a quick rundown of the trade-offs:
| Feature | 4-Option Items (1 Key, 3 Distractors) | 3-Option Items (1 Key, 2 Distractors) |
|---|---|---|
| Guessing Probability | 25% | 33% |
| Creation Time | Higher; difficult to write 3 good distractors. | Lower; focuses effort on 2 plausible distractors. |
| Student Time | More time spent reading options. | Less time spent reading; more focus on the stem. |
| Reliability | Potentially lower if one distractor is non-functional. | Potentially higher reliability per item. |
| Best Use Case | Complex scenarios requiring nuanced distinctions. | Most situations, especially for knowledge and application. |
Crafting good objective items is a skill. By focusing on stem clarity, plausible distractors, and avoiding common flaws, you create assessments that truly measure learning.
In a multiple-choice question, what are the incorrect answer choices officially called?
According to the text, what is the primary problem with using an incomplete sentence like "Photosynthesis is..." as a question stem?