Evaluation, Review, and Continuous Improvement
Carbon pricing systems are not static. They require ongoing evaluation, periodic review, and continuous improvement to remain effective as circumstances change. This final lesson in the module examines how to build learning and adaptation into carbon pricing design.
Why Continuous Improvement Matters
Carbon pricing operates in a dynamic environment:
Changing science: Climate science continues to evolve. New understanding may require adjusted ambition.
Economic shifts: Economic conditions change. What worked in 2020 may not work in 2030.
Technology developments: New technologies emerge. Abatement costs fall. The marginal abatement cost curve shifts.
Policy interactions: Other policies change. Carbon pricing must adapt to new complementary or overlapping measures.
Political context: Public attitudes and political realities evolve.
The best carbon pricing systems are designed for learning and adaptation from the start. Build in review mechanisms, collect the right data, and create processes for making changes based on evidence.
The Evaluation Framework
Evaluation should assess multiple dimensions:
Environmental effectiveness:
- Are emissions declining as expected?
- Is the system meeting its targets?
- How do actual reductions compare to projections?
Economic efficiency:
- What is the cost per ton of emissions reduced?
- How do prices compare to marginal abatement costs?
- Is the system finding low-cost reductions?
Distributional impacts:
- Who bears the costs?
- Are vulnerable populations protected?
- How is revenue being used?
Administrative performance:
- Is MRV working effectively?
- What are compliance rates?
- What are administrative costs?
Market functioning (for ETS):
- Is there sufficient liquidity?
- Is price discovery working?
- Are there market manipulation concerns?
| Dimension | Key questions | Data sources |
|---|---|---|
| Environmental | Emissions trends vs targets | MRV data, emissions inventories |
| Economic | Cost-effectiveness, price levels | Market data, surveys, modeling |
| Distributional | Who pays, who benefits | Household surveys, input-output analysis |
| Administrative | Compliance, costs | Registry data, government accounts |
| Market | Liquidity, price discovery | Trading data, bid-ask spreads |
Data Collection for Evaluation
Good evaluation requires good data collected from the start:
MRV data: Emissions reports from covered entities form the foundation.
Market data: Transaction prices, volumes, auction results.
Compliance data: Surrender rates, penalties issued, enforcement actions.
Economic data: Energy prices, production levels, investment patterns.
Survey data: Stakeholder perceptions, behavioral responses.
The EU ETS evaluation framework:
The EU collects comprehensive data for ETS evaluation:
- Annual emissions data from all covered installations
- Transaction-level data from the EU registry
- Auction prices and volumes from each auction
- Verification reports and compliance statistics
- Regular stakeholder consultations
- Independent academic studies
This data feeds into formal reviews every five years, informing each new trading period's design adjustments.
Scheduled Reviews
Many jurisdictions build formal review points into their systems:
Annual reviews: Light-touch assessments of operational performance. Are things working as intended?
Periodic comprehensive reviews: Deep evaluations every 3-5 years. Should the design change?
Triggered reviews: Automatic reviews when certain conditions occur (price thresholds, emission trends).
Sunset clauses: Some systems require explicit reauthorization, forcing evaluation.
British Columbia has used multiple review mechanisms:
Initial reviews: Independent review in 2012 assessed the tax's first four years. Found emissions declining, economy healthy.
Rate freeze and review: The tax was frozen at $30/ton from 2012-2018 while a broader climate policy review occurred.
Resumption: Based on review findings, increases resumed in 2018, with a clear trajectory to $50/ton by 2022.
Ongoing assessment: Annual reports track emissions, revenue use, and economic impacts.
Lesson: Reviews can both validate the policy (as in 2012) and lead to pauses for reconsideration (2012-2018). Both outcomes represent the review process working as intended.
Adapting the System
Reviews may lead to various types of changes:
Rate adjustments:
Carbon tax rates may need to increase if emissions are not falling fast enough, or the trajectory may be accelerated.
Cap trajectory changes:
ETS caps may be tightened or extended further into the future based on long-term targets.
Scope expansion:
Additional sectors or gases may be brought into coverage.
Allocation updates:
Free allocation benchmarks may be updated to reflect new best practices.
Price mechanism changes:
Floors, ceilings, or stability reserves may be adjusted based on market experience.
Offset rule changes:
Quality standards or quantitative limits for offsets may evolve.
The Feedback Loop
Effective continuous improvement requires a complete feedback loop:
Step 1: Collect data Gather emissions, market, economic, and stakeholder data continuously.
Step 2: Analyze Compare outcomes to expectations. Identify what is working and what is not.
Step 3: Diagnose Understand why outcomes differ from expectations. Is it the policy or external factors?
Step 4: Design changes Develop options for addressing identified issues.
Step 5: Consult Engage stakeholders on proposed changes.
Step 6: Implement Make changes with appropriate transition periods.
Step 7: Monitor Watch how changes affect outcomes.
Continuous improvement in carbon pricing is like tuning a car engine. You set initial parameters based on engineering principles, but you need to monitor performance, listen for problems, and make adjustments based on how the engine actually runs. The best mechanics are constantly learning from the engine's performance.
Common Adjustment Triggers
Several situations commonly trigger design adjustments:
Price too low: If prices are consistently below levels needed to drive reductions, consider:
- Tightening the cap (ETS)
- Raising the rate (tax)
- Strengthening the floor price
Price too high: If prices are causing unacceptable economic harm, consider:
- Releasing reserves (ETS)
- Triggering cost containment mechanisms
- Reviewing allocation provisions
Leakage concerns: If covered entities are losing market share to uncovered competitors:
- Review carbon leakage provisions
- Adjust free allocation
- Consider border adjustments
Windfall profits: If covered entities are profiting excessively from free allocation:
- Shift toward auctioning
- Tighten benchmarks
- Review allocation methodology
Low liquidity (ETS): If markets are thin and price discovery is poor:
- Consider market design changes
- Evaluate banking and borrowing rules
- Assess participant requirements
Governance for Adaptation
Who makes decisions about changes?
Legislative changes: Major changes (rate levels, scope, fundamental design) typically require legislation.
Regulatory changes: Implementation details (benchmarks, offset protocols) can often be updated through regulation.
Administrative changes: Operational procedures can be adjusted by the implementing agency.
Automatic adjustments: Some mechanisms (like stability reserves) operate automatically within preset rules.
Design the governance structure to enable necessary changes without requiring new legislation for every adjustment. But ensure that fundamental policy direction remains under democratic control.
Independent Review Bodies
Some jurisdictions use independent bodies to strengthen review:
Climate councils: Independent advisory bodies that assess policy effectiveness and recommend changes.
Technical committees: Expert groups that evaluate specific design elements.
Academic partnerships: Universities conducting ongoing research on policy effects.
International peer review: Learning from other jurisdictions' experiences.
Transparency in Evaluation
Evaluation should be transparent:
Public reporting: Regular public reports on system performance.
Data access: Making evaluation data available to researchers.
Stakeholder input: Formal processes for stakeholder feedback.
Explanation of changes: Clear communication about why changes are made.
Learning from Other Jurisdictions
Carbon pricing operates globally. Learn from others:
What to watch:
- How other systems handle similar challenges
- What design innovations emerge elsewhere
- What mistakes to avoid
Mechanisms for learning:
- International Carbon Action Partnership (ICAP) for ETS
- Carbon Pricing Leadership Coalition
- PMI/PMR knowledge sharing
- Academic literature
Learning from the EU ETS Phase 1:
The EU ETS Phase 1 (2005-2007) saw price collapse due to overallocation. This experience led to changes worldwide:
- EU tightened caps in subsequent phases
- Other jurisdictions designed more conservative initial caps
- Banking restrictions were reconsidered
- Better data collection was prioritized before cap-setting
The EU's early difficulties improved carbon pricing design globally.
Building Institutional Capacity
Continuous improvement requires institutional capacity:
Skilled staff: Personnel who understand both the technical and policy dimensions.
Data systems: IT infrastructure for collecting, managing, and analyzing data.
Research capability: Ability to conduct or commission evaluation studies.
Stakeholder relationships: Ongoing engagement with affected parties.
International connections: Networks for learning from other jurisdictions.
Long-term Planning
While adapting to circumstances, maintain long-term direction:
Signal predictability: Even as rates or caps adjust, maintain clear long-term trajectories.
Align with targets: Ensure adjustments support, not undermine, long-term emissions goals.
Avoid frequent changes: Adapt when necessary, but not so frequently that uncertainty undermines investment.
Communicate the vision: Help stakeholders understand how short-term adjustments serve long-term goals.
Module Summary
This module examined advanced and global topics:
- Linking carbon markets expands efficiency but requires compatible designs
- Article 6 creates new frameworks for international cooperation
- Companies increasingly use internal carbon pricing to prepare for regulation
- Continuous improvement keeps systems effective as circumstances change
Carbon pricing is not a set-and-forget policy. The most successful systems are those that learn, adapt, and improve over time while maintaining consistent long-term direction. Build evaluation and review into the design from the start.
Looking Ahead
The final module of this course turns to practical application: how to synthesize what you have learned into recommendations and decisions about carbon pricing for your jurisdiction.