Synthesizing Evidence for Decision-Makers
Models and analysis generate vast amounts of information. Decision-makers need synthesis: clear, actionable insights that inform choices. This lesson examines how to bridge the gap between technical analysis and policy decisions.
The Synthesis Challenge
Decision-makers face constraints:
Time: They have limited time to absorb complex analysis.
Background: They may not have technical training in economics or modeling.
Multiple priorities: Carbon pricing is one issue among many.
Political context: Decisions involve more than technical optimization.
Need for clarity: They need to understand implications, not just numbers.
The analyst's job is not just to do good analysis, but to communicate it effectively. A brilliant analysis that decision-makers cannot understand is not useful.
Structuring the Synthesis
A useful synthesis typically includes:
Context: Why is carbon pricing being considered? What are the objectives?
Options: What policy options are being compared?
Key findings: What does the evidence say about each option?
Trade-offs: What are the pros and cons of each option?
Uncertainties: What do we know and what remains uncertain?
Recommendation: What does the evidence suggest?
From Numbers to Insights
Translate technical outputs into meaningful statements:
Raw output: "Model shows 12.4% emissions reduction by 2030 under Scenario A."
Synthesized insight: "A $30 carbon tax would put us roughly on track for our 2030 target, reducing emissions by about 12%. This is meaningful progress, though additional measures may be needed to fully meet the target."
Key principles:
- Round numbers appropriately (12%, not 12.37%)
- Provide context (is 12% good? compared to what?)
- Connect to objectives (does this meet our goal?)
- Acknowledge uncertainty (roughly, about)
Synthesis example: distributional impacts
Technical output:
- Bottom quintile: +2.1% household expenditure
- Second quintile: +1.8% household expenditure
- Middle quintile: +1.5% household expenditure
- Fourth quintile: +1.2% household expenditure
- Top quintile: +0.9% household expenditure
Synthesized insight: "The carbon price is regressive without recycling. Lower-income households would pay proportionally more of their income. However, if we return revenue through equal per-capita dividends, the bottom 40% of households would actually come out ahead on average. Revenue recycling transforms a regressive tax into a progressive policy."
Handling Uncertainty
Uncertainty is inherent in policy analysis. Handle it honestly:
Communicate ranges: "Emissions reductions are projected at 10-15%, depending on how quickly firms adopt new technologies."
Distinguish types:
- Things we know well (current emissions)
- Things we can estimate (short-term responses)
- Things that are highly uncertain (technology costs in 2040)
Scenario approach: "Under the optimistic technology scenario, costs are modest. Under the conservative scenario, costs are higher but still manageable."
What-if analysis: "If the global economy enters recession, these projections would change significantly."
Addressing Trade-offs
Most policy choices involve trade-offs. Present them clearly:
Efficiency vs distributional equity: "Free allocation protects affected workers but reduces revenue for dividends."
Environmental ambition vs economic cost: "A higher price achieves more reductions but at higher cost."
Simplicity vs precision: "A simpler design is easier to administer but may miss some emissions."
Near-term vs long-term: "Starting lower reduces short-term disruption but requires steeper increases later."
Decision matrices can help compare options across multiple criteria:
Example matrix:
| Option A: $20 Tax | Option B: $40 Tax | Option C: ETS | |
|---|---|---|---|
| Emissions reduction | Moderate | High | Moderate-High |
| Economic cost | Low | Moderate | Variable |
| Revenue certainty | High | High | Low |
| Political feasibility | Higher | Lower | Moderate |
| Administrative ease | Higher | Higher | Lower |
How to use:
Decision-makers can see at a glance how options compare across dimensions. This does not make the decision automatic, but it structures the conversation.
Cautions:
- Criteria are not equally important
- Some factors resist scoring
- Qualitative judgments underlie the matrix
- Use as a starting point, not a formula
Visual Communication
Good visuals convey insights quickly:
Emissions trajectories: Show baseline vs policy scenarios over time.
Cost-benefit summary: Side-by-side comparison of costs and benefits.
Distributional charts: Who gains, who loses, by how much.
Revenue flow diagrams: Where does money come from and go to?
Comparison tables: Options side by side on key dimensions.
Key principles:
- Keep it simple
- Use consistent scales
- Label clearly
- Highlight key messages
Anticipating Questions
Prepare for the questions decision-makers will ask:
"What does this cost?" Be ready with clear cost figures, appropriately contextualized.
"How does it affect [specific sector/region]?" Have sector-specific and regional analysis available.
"What are other countries doing?" Provide international comparisons.
"What if the price goes too high/too low?" Explain price management mechanisms.
"How will people react?" Discuss likely political and behavioral responses.
"Can we start small?" Discuss phase-in options.
The Executive Summary
For many decision-makers, the executive summary is the only part they read:
Length: One page maximum, often less.
Structure:
- Context (1-2 sentences)
- Key findings (3-5 bullets)
- Bottom line recommendation
- Key uncertainty or caveat
Tone: Clear, direct, action-oriented.
Example executive summary:
Context: Cabinet requested analysis of carbon pricing options to meet our 2030 emissions target.
Key findings:
- A carbon tax of $40-60/ton would deliver approximately 75% of needed reductions
- Complementary policies are required for remaining reductions
- Revenue of $3-4 billion annually could offset other taxes or support affected workers
- Competitiveness impacts are manageable with targeted allocation for trade-exposed sectors
- Similar carbon prices are now in place in 5 of our 7 major trading partners
Recommendation: Proceed with a carbon tax starting at $30/ton, rising $10/year to $50/ton by 2027, with revenue returned through payroll tax reduction and a border adjustment study.
Key uncertainty: Global energy prices could significantly affect impacts.
Balancing Completeness and Clarity
There is tension between being comprehensive and being clear:
Too detailed: Decision-makers get lost in the weeds.
Too simple: Important nuances are missed.
Solution: Layer the communication.
- Executive summary (1 page)
- Main findings (5-10 pages)
- Technical appendix (as long as needed)
Decision-makers read what they need. Technical reviewers can dig into details.
Maintaining Analytical Independence
Synthesizing for decision-makers creates pressure to deliver the "right" answer:
Risks:
- Overstating certainty to seem decisive
- Downplaying inconvenient findings
- Shaping analysis to support predetermined conclusions
Safeguards:
- Clear separation between analysis and advocacy
- Transparent methods and assumptions
- Independent review where possible
- Presenting range of options, not just preferred one
- Explicit discussion of uncertainties
The analyst's role is like a doctor presenting treatment options. Present the diagnosis clearly, explain the options honestly, discuss the trade-offs, but let the patient (decision-maker) make the choice. Do not hide information because you think you know best.
From Synthesis to Decision
Good synthesis enables decision, but does not guarantee it:
What synthesis can do:
- Clarify trade-offs
- Reduce unnecessary uncertainty
- Frame choices clearly
- Anticipate consequences
What synthesis cannot do:
- Make value judgments for decision-makers
- Eliminate political considerations
- Guarantee outcomes
- Remove genuine uncertainty
Decision-makers must weigh analysis against other factors: political feasibility, timing, values, strategic considerations. The analyst's job is to ensure they do so with the best available evidence.
Looking Ahead
Synthesis provides the analytical foundation. The next lesson examines how to write the actual recommendation document that brings analysis to decision-makers.