Wisdom-of-Crowds Conditions Test
Test crowd intelligence before deciding whether consensus deserves trust
- Difficulty
- Moderate
- Time to result
- ~weeks to results
- Steps
- 5
- Confidence
- 96%
Evaluate a crowd by testing three conditions: diversity, aggregation, and incentives. Diversity supplies heterogeneous, independently formed perspectives; aggregation combines those perspectives into a collective signal; and incentives reward correct judgments while penalizing mistakes. When all three are present, consensus can be highly informative. When one condition fails—especially diversity—the same crowd can become unstable because participants begin copying and reinforcing one another. The danger is nonlinear: a system may appear healthy after diversity has deteriorated, then react violently to one additional change. The framework therefore does not assume that consensus is inherently wise or foolish. It asks whether the mechanism that normally produces collective intelligence is still operating.
Origin
Extracted from Masters in Business, where Michael Mauboussin explains market efficiency through the conditions that produce either the wisdom or madness of crowds.
Core principles
- 01Crowds are intelligent only under specific conditions
- 02Diverse independent views protect collective judgment
- 03Aggregation must combine dispersed information effectively
- 04Incentives should reward accuracy and penalize error
- 05A loss of diversity can produce sudden nonlinear failure
How to run it
- 1
Map the Crowd
Identify whose views constitute the apparent consensus and what information each participant contributes.
Pro tip Include dissenting or less visible participants rather than examining only prominent commentators.
Watch out A loud narrative may not represent the actual positioning of the broader market.
- 2
Test Diversity
Determine whether participants hold heterogeneous views formed through independent analysis or have correlated their thinking by copying one another.
Pro tip Compare assumptions and information sources, not merely final forecasts.
Watch out Superficially different forecasts can still share the same underlying thesis.
- 3
Inspect Aggregation
Check whether the system has a reliable way to combine dispersed information into an observable result, such as an exchange price.
Pro tip Prefer aggregation mechanisms that reflect committed decisions over informal opinion polls.
Watch out Poor aggregation can conceal useful minority information.
- 4
Examine Incentives
Assess whether participants benefit from being correct and bear meaningful costs for being wrong.
Pro tip Look for reputational, financial, and career incentives that may conflict with accuracy.
Watch out Incentives may reward conformity or asset gathering rather than good judgment.
- 5
Watch for Nonlinear Risk
If diversity is deteriorating, assume instability can emerge abruptly rather than through a smooth decline.
Pro tip Monitor one-sided positioning and increasingly uniform explanations as early-warning indicators.
Watch out The absence of an immediate price reaction does not prove the crowd remains healthy.
In the wild
In a hypothetical case, an investor finds that analysts, fund managers, and online commentators all forecast uninterrupted growth using the same management guidance. Prices aggregate their enthusiasm, but the views are no longer independent and career incentives favor owning the popular sector. The investor classifies the consensus as fragile rather than automatically wrong and reduces exposure instead of making an unbounded short bet.
→ The investor recognizes crowd vulnerability while avoiding contrarianism for its own sake.
In a hypothetical commodity market, producers, industrial buyers, speculators, and hedgers use different data and face real financial consequences. Their trades are aggregated continuously on an exchange. Because diversity, aggregation, and incentives remain intact, an investor gives the resulting price substantial weight despite disagreeing with it personally.
→ The investor avoids rejecting a well-formed consensus merely to appear independent.
Common mistakes
Assuming Consensus Is Always Wrong
Crowds are often right when diversity, aggregation, and incentives remain intact. Contrarian positioning without diagnosing those conditions is merely reflexive opposition.
Measuring Diversity by Headcount
Many participants do not create genuine diversity when they rely on the same sources, models, and assumptions.
Expecting a Gradual Breakdown
Loss of diversity can remain invisible until a small additional change triggers a disproportionate market reaction.
Is it for you?
Best for
It is best for investors evaluating popular narratives, crowded trades, and apparent market consensus.
Not ideal for
It is not ideal when participant views, incentives, or positioning cannot be observed even approximately.
From the transcript
“You need three conditions diversity so heterogeneous points of view, aggregation, some way to bring that information together. Exchanges do that perfectly, and incentives, which…”
“By far the most likely to be violated is diversity.”
“So this wisdom of crowds, of madness of crowd is not like a straight line. It's sort of a sort of a nonlinear function, which…”
From the episode
At the Money: Contrarian Investing