Scarcity-to-Innovation Lens
Treat rising scarcity as a signal that substitution and invention will follow
- Difficulty
- Moderate
- Time to result
- ~months to results
- Steps
- 6
- Confidence
- 95%
This lens reframes scarcity as a dynamic signal rather than a permanent condition. When a resource, service, or market privilege becomes scarce, its price rises and creates incentives for entrepreneurs to expand supply, improve productivity, or develop substitutes. Analysts then examine not only the direct technological response but also how people alter where they live, work, consume, and invest after adoption. The approach counters static forecasts such as Malthusian projections that hold technology and behavior constant. Its output is a scenario map showing which innovations could relax the constraint, how quickly adoption might occur, and which incumbent assets could lose scarcity value.
Origin
Yardeni developed the argument while challenging economics textbooks that define the discipline primarily as allocating scarce resources. He uses agricultural innovation and Uber's effect on taxi scarcity as examples. Extracted from Masters in Business.
Core principles
- 01High prices attract entrepreneurial problem-solving
- 02Technology can expand supply or replace a scarce input
- 03Human behavior changes in response to technological progress
- 04Static scarcity forecasts often miss adaptation
- 05Innovation can destroy the value of regulated scarcity
How to run it
- 1
Define the scarcity
Specify what is constrained, who experiences the constraint, and whether it reflects physical limits, regulation, distribution, or information.
Pro tip Distinguish true resource scarcity from an artificially restricted market.
Watch out A vague definition makes it impossible to identify viable substitutes.
- 2
Read the price signal
Measure how scarcity affects prices, waiting times, margins, or access. Determine whether the reward for solving the problem is large enough to attract entrants.
Pro tip Include nonfinancial costs such as inconvenience and delay.
Watch out Low observed prices may be misleading when regulation suppresses them.
- 3
Map expansion and substitution
Identify technologies that could produce more of the scarce item, use it more efficiently, or replace it altogether.
Pro tip Look beyond the incumbent industry for solutions using different infrastructure.
Watch out Do not assume the technically best solution will be economically adoptable.
- 4
Find the incentive holders
Identify entrepreneurs, customers, and investors who benefit from removing the constraint and assess their ability to act.
Pro tip Prioritize actors whose business model improves as scarcity falls.
Watch out Incumbents may profit from scarcity and resist change.
- 5
Model behavioral adaptation
Estimate how adoption changes consumer behavior, employment, settlement patterns, and demand for adjacent products.
Pro tip Include second-order effects rather than stopping at increased supply.
Watch out Technology forecasts fail when they hold human behavior constant.
- 6
Revalue the incumbents
Assess which assets derive value from the old constraint and how quickly that value could erode.
Pro tip Watch regulated licenses, distribution monopolies, and scarcity premiums.
Watch out A formerly valuable privilege can collapse before the incumbent's revenue fully declines.
In the wild
Malthus expected population growth to outrun food supply. Agricultural innovation increased the ability to feed people with fewer farm workers, while urbanization subsequently contributed to smaller families. Technology changed both production capacity and human behavior, undermining the static scarcity forecast.
→ Food production rose while the demographic assumptions behind the shortage projection also changed.
New York taxi availability was constrained by the medallion system. A software platform connected riders with a wider pool of cars, making rides easier to obtain and sharply eroding the value attached to the regulated medallion.
→ Technological substitution reduced access scarcity and destroyed much of the incumbent scarcity premium.
Common mistakes
Extrapolating scarcity unchanged
Projecting current supply and demand indefinitely ignores the incentive that rising prices create for innovation and substitution.
Ignoring behavioral responses
A technology may change fertility, migration, work, or consumption, making the original demand forecast obsolete.
Looking only inside the incumbent industry
The strongest substitute may come from a platform or technology that incumbents do not recognize as a direct competitor.
Is it for you?
Best for
It is best for long-term investors, strategists, and entrepreneurs evaluating constrained markets or pessimistic supply forecasts.
Not ideal for
It is not ideal for acute shortages where innovation cannot arrive within the decision horizon.
From the transcript
“When when something is scarce, guess what entrepreneurs come in and they figure out new technologies to make things less scarce or to substitute for…”
“That scarcity led to a technological innovation.”
“technology cured the problem.”
From the episode
Ed Yardeni Discusses Global Investment Strategy