Timedora

Measuring Regulatory Performance

How to evaluate whether a regulation achieves its objectives by distinguishing regulatory activity from real-world results and setting measures that can reveal effects over time.

From Regulatory Activity to Real-World Results

Start with the goal

Evaluation asks whether a regulation addresses the problem it was designed to solve, at what cost, and with what side effects. Begin with its stated objectives, then translate them into indicators that can be measured before and after implementation. Set the baseline—the starting measurement—and performance measures early, so later results can be compared with the original objectives.

Three levels of regulatory performance
CategoryExamplesWhat it indicates
Inputs and activitiesResources spent; inspections conducted; guidance issuedResources used or work done
OutputsFirms inspected; applications processedImmediate products of regulatory activity
Outcomes and impactsChanges in compliance, risk, safety, health, or environmental qualityChanges in conditions the regulation seeks to improve
A results chain distinguishes what regulators do from the conditions a regulation aims to improve; the categories alone do not prove that one caused another.

Measure results, not just effort

These categories help keep evaluation focused on different questions: What resources and work went into implementation? What did regulators produce? Did the conditions the rule was meant to improve change? Outputs show what regulators did, but do not by themselves establish that the regulation worked.

For example, an increase in inspections indicates more enforcement activity. It does not, on its own, show that workplace injuries fell. Pair such operational measures with indicators of the intended outcome. Also look for unintended effects, differences in results across affected groups, and whether improvements persist. Together, these checks make it less likely that a busy program—or an average improvement that leaves some groups behind—is mistaken for lasting success.