Evidence-and-Client Reality Check
Test controversial claims against market facts and real client outcomes
- Difficulty
- Easy
- Time to result
- ~days to results
- Steps
- 6
- Confidence
- 88%
The reality check uses two primary lenses: observable facts and the experience of clients. First, translate a criticism into measurable propositions about scale, concentration, pricing, liquidity, or another claimed mechanism. Compare those propositions with market data and credible third-party research rather than the intensity of the rhetoric. Second, assess whether clients actually receive transparent products, fair value, integrity, and reliable performance. The two lenses constrain each other: client demand cannot disprove every systemic risk, while abstract criticism should not outweigh contrary evidence without a credible mechanism. The final discipline is intellectual reversibility—retain the current conclusion only while the evidence supports it, and explicitly remain willing to change when new facts point elsewhere.
Origin
Extracted from Masters in Business during Salim Ramji's response to claims that index investing distorts markets and concentrates capitalism.
Core principles
- 01Separate measurable criticism from fringe speculation
- 02Check scale and market-share facts before accepting systemic claims
- 03Look for independent evidence about the proposed mechanism
- 04Use client outcomes as a practical validation test
- 05Change the conclusion if the facts change
How to run it
- 1
Make the claim testable
Translate rhetoric into a concrete prediction about market share, pricing, concentration, liquidity, or client harm.
Pro tip Ask what observable evidence would make the claim true or false.
Watch out Do not argue against an exaggerated version of the criticism.
- 2
Check market facts
Measure the product or institution relative to the full relevant market. Use denominators that reveal actual scale rather than isolated large numbers.
Pro tip Check multiple market lenses when the claim spans different asset classes.
Watch out A large absolute figure can still represent a small market share.
- 3
Seek external evidence
Look for independent studies or observations that test the proposed mechanism, such as whether a product harms or improves price discovery.
Pro tip Prefer sources with transparent methods and direct relevance.
Watch out Provider-sponsored evidence should not be the only support.
- 4
Inspect client outcomes
Evaluate whether clients receive transparency, value, integrity, and reliable implementation. Use outcomes rather than popularity alone.
Pro tip Distinguish repeat usage based on value from demand created by misunderstanding.
Watch out Client demand does not automatically rule out externalities.
- 5
Reach a provisional conclusion
Compare the criticism with both factual and client evidence, then state what remains uncertain.
Pro tip Attach the conclusion to evidence thresholds rather than identity or ideology.
Watch out Avoid turning a provisional judgment into permanent institutional dogma.
- 6
Stay willing to reverse
Define what new facts would cause a different conclusion and revisit the issue when those facts emerge.
Watch out Selective updating can make an evidence framework merely performative.
In the wild
A regulator claims a rapidly growing investment product has become the dominant force in price discovery. An analyst measures its share of equity and bond markets, reviews independent studies of stressed trading, and examines execution quality for users. The evidence shows meaningful growth but a smaller footprint and a more constructive price-discovery role than the rhetoric suggests.
→ The analyst rejects the strongest version of the claim while continuing to monitor concentration and market structure.
Common mistakes
Dismissing every critic as fringe
A provocative presentation does not prove the underlying concern is false; the mechanism still needs to be tested.
Treating popularity as proof
Customer adoption can support a value proposition, but it cannot by itself disprove systemic harm or externalities.
Refusing to update
The framework fails if the conclusion remains fixed after material contrary evidence appears.
Is it for you?
Best for
It is best for leaders assessing broad claims about an industry, product, or institution that can be tested against data and customer outcomes.
Not ideal for
It is not ideal when harms are difficult to quantify or when affected stakeholders cannot be represented by customer behavior alone.
From the transcript
“What I look at is two things. Look at the facts, and then I look at our clients.”
“We always look at the facts, but every time we look at the facts on things like pricing and things like concentration, it's kind of…”
“if the facts say something different, we'll come to a different conclusion”
From the episode
Salim Ramji on ESG Investing (Podcast)
Salim Ramji