Backtests Are Not Inherently Bad—Marketing Abuse Is the Problem
Hoffstein argues that a carefully constructed backtest can help investors understand how a strategy might have behaved during past stress. The danger arises when optimized or misleading historical results become marketing instruments rather than bounded evidence for due diligence.
- Backtests can reveal hypothetical stress behavior
- Optimized index histories helped fuel the smart-beta boom
- Regulatory restrictions reduce abuse but can impede due diligence
- Historical simulations should not be presented as expected returns
“I don't think there's anything implicitly wrong with back tests if done well.”
“I think the problem is back test became a marketing.”