Small-Scale Test and Scale
Run cheap experiments, scale winners, and quickly replace failures
- Difficulty
- Moderate
- Time to result
- ~weeks to results
- Steps
- 7
- Confidence
- 97%
The method starts by accepting that a smaller player may lose in direct competition with stronger incumbents. Instead of copying them head-on, the business generates different goals or different routes to the same goal. Each idea is tried on a small enough scale that failure remains affordable. Results, rather than convention or internal opinion, determine the next move: working experiments receive more resources, while failed ones are stopped and replaced. Successful approaches are not frozen; they continue to be tested and adapted as conditions change. Fisher used this pattern across direct mail, email, internet banners, computerization, sales, and client service. The output is cumulative innovation built through many controlled trials rather than one heroic, irreversible bet.
Origin
Fisher links the method to being the youngest brother competing against older, stronger siblings. That taught him to seek different objectives or different ways of obtaining what he wanted. He later applied the pattern to building Fisher Investments. Extracted from Masters in Business.
Core principles
- 01Avoid direct competition when stronger incumbents hold the advantage
- 02Test uncertain ideas cheaply before committing substantial resources
- 03Scale evidence, not enthusiasm
- 04Treat failed experiments as prompts to try the next option
- 05Borrow proven practices from other industries
How to run it
- 1
Avoid the head-on contest
Identify where established competitors possess overwhelming advantages and reframe the problem around an alternative route.
Pro tip Ask what adjacent industries do that your own industry considers unusual.
Watch out Being contrarian is not enough; the alternative still has to serve the customer.
- 2
Generate testable alternatives
Turn unconventional ideas into specific experiments with a clear audience, action, and expected result.
Pro tip Test one important uncertainty at a time.
Watch out Vague pilots produce ambiguous evidence.
- 3
Limit the downside
Run each experiment at a scale small enough that failure will not materially damage the business.
Pro tip Cap money, time, customers, and reputational exposure before launch.
Watch out Never use small-scale testing to bypass legal or ethical safeguards.
- 4
Measure what happened
Compare results against predefined success criteria and distinguish a promising signal from random variation.
Pro tip Include customer-quality and retention measures, not just immediate response.
Watch out Do not redefine success after seeing the outcome.
- 5
Scale winners
Increase investment gradually when an experiment works, confirming that performance survives at larger volumes.
Pro tip Scale in stages so declining effectiveness appears early.
Watch out A channel may become less productive as its best opportunities are exhausted.
- 6
Replace failures
Stop experiments that fail and redirect resources to the next plausible approach without treating the result as a personal defeat.
Pro tip Record what the failed test ruled out before moving on.
Watch out Do not keep weak experiments alive because of sunk costs.
- 7
Keep adapting
Continue testing variations within successful approaches as markets, technology, and customer behavior evolve.
Pro tip Maintain a rolling experiment portfolio rather than waiting for growth to stall.
Watch out Past success does not guarantee that an unchanged tactic will remain effective.
In the wild
Fisher Investments tested direct mail, then direct email, then internet banners, continually rolling forward with new marketing experiments. Direct mail remained useful, but the firm changed how it used the channel as the opportunity pool became less productive and its own knowledge improved.
→ Repeated experiments produced scalable acquisition capabilities that were unusual in the advisory industry.
A small firm pilots a client education session with twelve customers before building a national events program. It measures attendance, questions, satisfaction, and retention signals, revises the format, and expands only after repeated positive results.
→ The firm validates demand and delivery economics without funding a full program upfront.
Common mistakes
Scaling before learning
A large launch turns a correctable hypothesis into an expensive commitment before evidence exists.
Copying incumbents head-on
Smaller firms often lose when they compete on the dimensions where established rivals possess superior resources and experience.
Leaving winners unchanged
Even successful channels lose effectiveness as markets saturate, so continued testing and adaptation remain necessary.
Is it for you?
Best for
It is best for entrepreneurs and teams exploring new acquisition channels, services, or operating models.
Not ideal for
It is not ideal where even a small experiment creates unacceptable legal, safety, or reputational risk.
From the transcript
“I had to figure out either different things I wanted or going about getting them a different way.”
“you can do a huge amount of things on a small scale and testament and see if they work, and then if they work, do…”
“we just kept rolling in marketing tests over time, over a long period of time.”
From the episode
Interview With Ken Fisher (Part 2): Masters in Business (Audio)