Timedora

Evaluating Regulatory Performance

A practical guide to judging whether regulations remain relevant, achieve public outcomes, justify their costs, and should be retained or changed.

What Good Performance Evaluation Tests

What a strong review asks

A regulation should be judged against several connected tests:

  • Relevance: Does the underlying problem remain important, and is regulation still an appropriate response?

  • Effectiveness: Did the rule achieve its objectives and improve the underlying ? Were there negative or unexpected effects?

  • Efficiency: Were the benefits worth the costs, and could comparable results have been achieved at lower cost?

  • Coherence: Is the rule consistent with other regulations and government objectives?

  • Alternatives: Might a different regulatory design—or a non-regulatory approach—work better?

Together, these questions test not only whether a rule was implemented, but whether it remains a suitable and worthwhile way to address the problem.

Measure results, not just activity

Choose indicators that reflect the problem and intended public . For a workplace-safety rule, for example, injury rates and severity are more direct evidence of safety outcomes than the number of inspections completed. Inspection counts, violation notices, and compliance rates still matter: they can help explain how the rule was implemented. But they should be interpreted alongside real-world outcomes, not treated as proof that those outcomes improved.

Even when an changes after a rule takes effect, the timing alone does not show that the rule caused the change. Other factors may have contributed. Evaluators therefore compare observed results with a credible estimate of what would have happened without the rule—the . Depending on the circumstances and available data, this may involve comparing affected and unaffected groups or locations, examining trends before and after implementation, or using another suitable research design.

For instance, hypothetically, if injuries declined after a workplace rule began, a review might compare the affected workplaces with suitable unaffected workplaces. The comparison is informative only to the extent that it credibly estimates what would have happened to the affected workplaces without the rule. A review should state the assumptions and uncertainty involved. An observed improvement is evidence to examine, not by itself proof of causation.

Weighing Impacts and Building an Accountable Review

Count impacts—and identify who experiences them

A review should consider effects on regulated organizations, individuals, government agencies, and the wider community. Costs may include compliance and reporting, as well as administration, inspection, and enforcement. Benefits may include reduced harm, greater safety, or improved market confidence when these outcomes relate to the rule’s purpose.

Quantify impacts where practical. If an impact cannot be reliably expressed in money, describe it clearly rather than treating it as zero. Also show how are distributed: an overall gain may coexist with substantial burdens for a particular group.

Look for unintended consequences, too. A rule might discourage useful activity, shift risks elsewhere, encourage evasion, or affect groups unevenly. For example, a reporting requirement may improve regulators’ information while imposing disproportionate costs on small firms. That finding does not automatically mean the rule should be abandoned; it can point to ways to preserve the public benefit while reducing avoidable harm.

Make the review accountable

Start with clear objectives, indicators, and a plan for gathering evidence. Then explain what was assessed, what the evidence shows, where uncertainty remains, and how the findings will guide decisions. This makes it possible to distinguish a well-supported conclusion from one that depends on assumptions or incomplete evidence.

Administrative data may not reveal every practical difficulty or effect. Stakeholder input can help surface issues missing from those records, while publishing the findings allows affected people and oversight bodies to scrutinize the analysis. The review should also examine whether implementation and enforcement were adequate, proportionate, and consistent with the regulation’s goals. These checks help explain not only what outcomes occurred, but whether the rule was put into practice in a way that could reasonably support its objectives.

Turning Findings into Action

Match the response to the evidence

Evaluation is useful when it leads to a practical, proportionate decision:

  • Keep the rule if it remains effective and justified.

  • Clarify or simplify it if unnecessary burdens are hindering compliance.

  • Strengthen or retarget implementation if the objective remains important but outcomes are weak.

  • Revise, replace, or repeal it if evidence indicates that it is ineffective, outdated, or inferior to an alternative.

Weak outcomes do not always mean the rule itself should be abandoned: the problem may instead call for changes to how it is implemented. Conversely, continuing a rule is not justified merely because it exists; the review should consider whether it still addresses an important problem and whether a better alternative is available.

Reviews should be scheduled periodically, with earlier review considered when risks, technology, or other circumstances change. This keeps decisions responsive to conditions that may alter a rule’s relevance or performance.

  • : A structured review of whether a rule still addresses an important problem, achieves its objectives, justifies its costs, fits with other rules and government objectives, and is preferable to available alternatives.

  • : The way a rule’s fall across regulated organizations, individuals, government agencies, and the wider community.

  • : A decision to keep, adjust, strengthen, replace, or remove a regulation in light of its performance and continuing justification.