No history yet

Alignment and Validity

From Objectives to Questions

Every effective summative assessment begins with a clear map connecting what was taught to what is tested. This map is built on a simple principle: the cognitive skill required in the learning objective must match the cognitive skill demanded by the assessment question. When these align, the assessment has content validity. It accurately measures what it's supposed to measure.

Every assessment—formative or summative—should be directly related to one or more learning objectives for your course.

For the foundational levels of Bloom's Taxonomy, this mapping is straightforward but requires precision. We start by choosing verbs for our learning objectives that are unambiguous and measurable. Vague verbs like "know" or "be familiar with" are useless for assessment design. Instead, we need action verbs that point to a specific, observable behavior.

Bloom's LevelObjective VerbsAssessment Actions
RememberDefine, List, Recall, NameMatch terms to definitions, Fill in the blank, Label a diagram
UnderstandExplain, Summarize, ParaphraseExplain a concept in one's own words, Classify examples
ApplySolve, Use, Implement, DemonstrateSolve a novel problem, Apply a formula to a new dataset

The table above isn't just a list; it's a blueprint for alignment. If your objective is for students to list the causes of an event (Remember), a multiple-choice question asking them to explain the significance of those causes (Understand) is a mismatch. This is a common pitfall. The assessment might still be a good question, but it doesn't measure the stated objective.

Guarding Against the Alignment Gap

The most common mistake in assessment design is the 'Alignment Gap', especially when trying to test the 'Apply' level. An instructor writes an objective for students to apply a concept, but the corresponding exam question only asks them to recall a textbook example of that application. The question stem fails to provide a novel scenario, so the student isn't problem-solving; they're just remembering.

True application requires a student to transfer knowledge to a situation they haven't seen before.

Consider a physics objective: "Students will be able to apply Newton's Second Law (F=maF=ma) to solve for acceleration." A weak question might present the exact numbers used in a homework problem. A strong question would provide a completely new scenario, perhaps with different units or an extra variable to ignore, forcing the student to implement the formula, not just recite a memorized answer. This distinction is critical for ensuring you're testing the intended skill.

Lesson image

This rigor also impacts reliability and cognitive load. An assessment is reliable if it consistently produces the same results under the same conditions. When questions are ambiguous or misaligned with the cognitive level taught, student performance can become erratic. A well-designed question minimizes extraneous cognitive load by being clear and focused, allowing the student's effort to be spent on demonstrating their knowledge, not on deciphering the question itself. An exam full of alignment gaps is not just invalid; it's often unreliable, too.

Blueprinting for Validity

To prevent these issues at scale, we use an assessment blueprint, also known as a table of specifications. This is a formal grid that maps content areas against cognitive levels. It serves as a quality control check before you ever write a single question. It dictates how many questions will target each content area and at which level of Bloom's Taxonomy.

This blueprinting process forces you to make conscious decisions. How much of the exam should focus on simple recall versus deeper understanding? Does the weight of each topic on the exam reflect the instructional time spent on it? By answering these questions beforehand, you ensure the final assessment is a balanced and valid instrument that accurately reflects the course's learning goals. It moves test creation from an art to a systematic process.

Now, let's test your ability to apply these concepts.

Quiz Questions 1/5

What is the primary principle for ensuring an assessment has content validity?

Quiz Questions 2/5

An instructor's learning objective is: 'Students will be able to list the three main causes of the French Revolution.' Which assessment question is best aligned with this objective?

Building a valid assessment is a foundational skill. By deliberately aligning objectives, verbs, and question types using a blueprint, you create a test that is fair, reliable, and, most importantly, a true measure of learning.