Scenario Analysis

Lecture

Lecture
Author

Dr. James Doss-Gollin

Published

Mon., Feb. 12

Context and recap

Notation

Let’s tighten our notation just a little bit

Figure 1: Notation for our system dynamics.
  • State of the world: encapsulates all inputs to our model.
  • Decisions: can be very simple (how high do we elevate a house right now?) or very complex (spatial and/or temporal optimization problems)
  • Outcomes: can be a single number (scalar) or a vector if there are multiple outcomes we care about.

Cost-benefit analysis

  • Do this for a single state of the world
  • Emphasis on discounted cash flow to define “outcomes”

Uncertainty

Uncertainty commonly divided into two broad classes:

  • Aleatory uncertainty, or uncertainties resulting from randomness;
  • Epistemic uncertainty, or uncertainties resulting from lack of knowledge.

We can also categorize uncertainty based on the source of the uncertainty:

  • Parameter uncertainty
  • Model structure uncertainty
  • External / boundary condition / scenario uncertainty

Uncertainty is represented in models in many different ways. For example:

  • Deterministic: hold some things fixed (we always do this!)
  • Probabilistic with expectations (lab)
  • Probabilistic with sampling

These are all assumptions, and these assumptions can be varied.

Scenario analysis

Scenario analysis is a broad class of methods that are used in many fields. They fall into two very broad categories:

  1. Stress-testing: pick a few scenarios and make sure the system performs acceptably
    1. Financial stress testing (Condon, 2021)
    2. Design storms for flooding
  2. Traditional scenario analysis: explore several scenarios and see how the system performs
    1. Optimizing energy systems (see Doss-Gollin et al., 2023 for a critical review 😉)
    2. Climate science (where RCP scenarios are a key input)
    3. Often a focus on scenarios that are difficult to put probabilities on
Key point

Scenario analysis is a way to explore the consequences of different assumptions. However, decisions that perform well on some scenarios may not perform well on others. Scenario analysis does not attempt to quantify the likelihood of different scenarios. Recall that estimating expectations requires a probability distribution.

Examples

Let’s return to our house elevation problem. What are some things we could consider?

  • Sea-level rise: could consider a few different scenarios of sea-level rise (e.g., Sweet et al., 2022)
  • Discount rate

Experiment design

  1. Number of scenarios
    1. A few = interpretable
    2. Many = more systematic analysis. Interactions between different sources of uncertainty are important.
  2. What is a scenario?
    1. Parameter values
    2. Model structure
  3. How to generate / sample scenarios

Wednesday

Grant will lead a discussion of Bankes (1993).

  • Emphasis on the “exploratory” nature of the work
  • Key insight: iteratively re-frame the problem and generate insight
  • Discussion questions are posted.

References

Bankes, S. (1993). Exploratory modeling for policy analysis. Operations Research, 41(3), 435–449. https://doi.org/c7rgcr
Condon, M. (2021). Market myopia’s climate bubble. Utah Law Review, 63(2022). https://doi.org/10.2139/ssrn.3782675
Doss-Gollin, J., Amonkar, Y., Schmeltzer, K., & Cohan, D. (2023). Improving the representation of climate risks in long-term electricity systems planning: A critical review. Current Sustainable/Renewable Energy Reports. https://doi.org/10.1007/s40518-023-00224-3
Sweet, W. V., Hamlington, B. D., Kopp, R. E., Weaver, C. P., Barnard, P. L., Bekaert, D., et al. (2022). Global and regional sea level rise scenarios for the United States (NOAA Technical Report No. NOS 01) (p. 111). Silver Spring, MD: National Oceanic and Atmospheric Administration, National Ocean Service. Retrieved from https://oceanservice.noaa.gov/hazards/sealevelrise/sealevelrise-tech-report-sections.html