Full-Cycle Skill Test
Separate skill from luck by testing performance across market regimes
- Difficulty
- Advanced
- Time to result
- ~ongoing to results
- Steps
- 5
- Confidence
- 97%
Schwager says individual trades and short streaks cannot cleanly separate luck from skill because luck is always present. The useful test lengthens the observation window and asks whether performance survives different market regimes. Review year-to-year profitability, the size and recovery of drawdowns, and whether the trader protected the account when conditions turned hostile. A strategy that only went long during a bull market has demonstrated exposure to that bull market, not necessarily trading skill. The strongest evidence arrives after a full cycle, especially a bear phase, because adverse conditions expose hidden dependence on one regime. The output is a cautious classification grounded in persistence and risk control rather than headline returns.
Origin
Extracted from Masters in Business
Core principles
- 01Every short record contains luck
- 02Time reduces the explanatory power of luck
- 03Bull-market gains do not prove adaptability
- 04Drawdown control is part of skill
- 05A full market cycle reveals hidden dependence
How to run it
- 1
Extend the sample
Gather performance across years rather than relying on days, weeks, or a few strong months.
Watch out A hot streak can last for months.
- 2
Label the regimes
Identify whether the record includes bull, bear, volatile, and quiet conditions relevant to the strategy.
Watch out Do not call a one-sided record a full test.
- 3
Assess consistency
Check whether profitability persists across years and whether the process remains stable.
Pro tip Look beyond the cumulative return to the path that produced it.
- 4
Inspect drawdowns
Measure losses and determine whether the trader ever placed the account in serious danger.
Watch out A strategy that eventually recovers can still carry unacceptable failure risk.
- 5
Require adversity
Delay a confident skill judgment until the trader has operated through a materially adverse phase.
Pro tip A bear phase is especially informative for a strategy built during a bull market.
In the wild
Schwager selected stock traders near the end of a long bull market and believed they would survive a bear market. Some did, but quite a few did not, showing that strong records formed in one favorable regime were not enough to establish durable skill.
→ The subsequent bear phase differentiated adaptable traders from records dependent on the prior bull market.
Common mistakes
Annualizing a hot streak
Short-term returns can be generated by luck and say little about survival through changing conditions.
Ignoring the market regime
Being long during a bull market does not reveal what the same approach will do in a bear market.
Is it for you?
Best for
Evaluating traders, strategies, or managers with enough history to span changing conditions.
Not ideal for
New strategies with too little evidence to include an adverse market regime.
From the transcript
“luck is is the longer you go, the less luck will win out.”
“You have no idea what's gonna happen when you have a bear market.”
“you can't tell if anybody is good or not, uh without you know, out really seeing them through through a bare phase.”
From the episode
Interview With Jack Schwager: Masters in Business (Audio)
Jack Schwager