What makes a policy evaluation question answerable?
A focused, open-ended question that links the policy, population, and outcome—and, when relevant, a time period or context.
Study Policy Outcome Evaluation: Questions, Indicators, and Evidence with 12 free online flashcards. Review key terms, definitions, and concepts with this interactive flashcard deck.
What makes a policy evaluation question answerable?
A focused, open-ended question that links the policy, population, and outcome—and, when relevant, a time period or context.
How do outputs, outcomes, and impacts differ?
An output is a product or service delivered directly by implementation; an outcome is a change associated with the policy; an impact is a broader or longer-term effect.
How does an indicator differ from a measure?
An indicator is a measurable sign of progress toward an outcome. A measure specifies how that indicator is calculated or assessed.
What makes an evaluation indicator valid?
A valid indicator represents the outcome of interest rather than an easier, indirect substitute.
When is quantitative versus qualitative evidence useful?
Use quantitative evidence to estimate how much change occurred, and qualitative evidence to explore how change happened and how people experienced it.
What is a policy evaluation baseline?
A baseline describes the outcome before implementation using the same definition and measurement approach planned for follow-up.
What does a counterfactual estimate?
A counterfactual is a credible estimate of what would have happened without the policy.
Why examine policy outcomes across groups?
Disaggregate results by relevant characteristics, where appropriate and ethically safe, to reveal who benefits, who faces barriers, and under what conditions.
What are unintended effects, and how can evaluators find them?
They are positive or negative consequences the policy did not intend. Open-ended questions and other evidence can help surface them.
How can evaluators interpret different types of evidence together?
Compare quantitative patterns with qualitative accounts and implementation information, then investigate where they agree or differ.
How should evaluation conclusions be calibrated to evidence?
State limitations and avoid claims stronger than the evidence supports; distinguish observed change from evidence of causal effect.
What makes an indicator reliable?
A reliable indicator uses a collection method that produces consistent results when the underlying situation has not changed.
Explore how geography, chronology, evidence, and networks shaped the diverse societies of the ancient Mediterranean.
A medium-difficulty quiz on Renaissance humanism, artistic practices, political life, patronage, and the movement’s varied forms across Europe.
A medium-difficulty quiz on the Reformation, Catholic reform, and the political settlements and changes that shaped religious life in Europe.
Trace how Greek communities developed into independent poleis and compare the distinct political and social paths of Sparta and Athens during the Archaic Age.
Compare political power and citizenship in Athens and Sparta, then trace how the Persian Wars and rival alliances shaped Greek warfare and the Peloponnesian War.
Explore how religion, philosophy, performance, art, architecture, and social life shaped diverse ancient Greek communities.
Trace Macedon’s rise, Alexander’s conquests, the competing successor kingdoms, and the political, social, religious, and artistic connections that shaped the Hellenistic Mediterranean.
Review Rome’s early origins, republican institutions, social reforms, and expansion across Italy.
A medium-difficulty quiz on Rome's Mediterranean expansion, provincial government, and the pressures that destabilized the Republic.
Trace how Rome’s Mediterranean conquests expanded its power and strained Republican institutions, from the Punic Wars to Augustus’s new political settlement.
A medium-difficulty quiz on Roman imperial government, provincial administration, and the army.
A medium-difficulty quiz on Roman religion, social relationships, labor, trade, and urban life.