Audience-Tested Repertoire Loop
Test every candidate live, keep the winners, and refine the set.
- Difficulty
- Easy
- Time to result
- ~weeks to results
- Steps
- 5
- Confidence
- 96%
The Audience-Tested Repertoire Loop replaces intuition-only selection with repeated live evidence. Instead of deciding in advance which songs, stories, or offerings will work, the creator tests several candidates in realistic settings. Audience attention, emotional response, and consistency across appearances reveal which pieces connect. Strong performers remain in the core repertoire; weak ones are revised or removed. New experiments are then introduced alongside proven material, allowing the portfolio to evolve without becoming unstable. The loop is especially valuable because audience reactions often contradict the creator's expectations. It does not mean obeying every isolated response: the creator looks for repeated patterns and considers whether context, setup, or sequencing affected the result.
Origin
Pizzarelli explained that when promoting an album he tried performing all its songs, observed what audiences liked, and kept the successful pieces in his live repertoire. Extracted from Masters in Business.
Core principles
- 01Real audience behavior outranks personal prediction.
- 02Test candidates before permanently excluding them.
- 03Retain proven material while continuing to explore.
- 04Treat surprises as useful evidence.
- 05Judge individual pieces within the wider experience.
How to run it
- 1
Assemble candidates
Choose several pieces or ideas that could plausibly serve the same audience need.
Pro tip Include at least one choice you are uncertain about.
Watch out Testing only personal favorites produces biased evidence.
- 2
Run realistic trials
Present each candidate in an actual show, campaign, or customer setting with enough context for it to succeed.
Pro tip Keep surrounding conditions reasonably consistent.
Watch out A poorly introduced piece has not received a fair test.
- 3
Observe response
Note attention, emotional reaction, follow-up questions, and other relevant audience behavior.
Pro tip Look for behavioral signals rather than relying only on compliments.
Watch out One unusually enthusiastic or hostile audience can distort conclusions.
- 4
Keep or revise
Retain pieces that repeatedly connect, revise promising but weak pieces, and remove persistent failures.
Pro tip Diagnose whether the material or its placement caused the result.
Watch out Do not discard an experiment after a single ambiguous trial.
- 5
Refresh the portfolio
Continue introducing new candidates alongside the proven core. Repeat the loop as audiences and contexts change.
Pro tip Limit the proportion of untested material in any one appearance.
Watch out A fully static repertoire eventually stops generating useful learning.
In the wild
Pizzarelli performed songs from an album in live shows rather than choosing only a few in advance. Audience response revealed that the Tom Waits and “Lush Life” combination connected, while other tracks were less effective.
→ The successful material remained in the live set and weaker choices made room for better ones.
A trainer rotates six new exercises through recurring workshops, tracking completion, discussion quality, and post-session recall. Three exercises consistently outperform the others and become the standard core.
→ The workshop improves through evidence while retaining space for future experiments.
Common mistakes
Predicting instead of testing
Creators are often surprised by what audiences value, so confidence before exposure is weak evidence.
Following one noisy reaction
A single audience may respond unusually because of context, sequencing, or composition.
Changing everything at once
Replacing the entire proven portfolio makes it difficult to identify which experiment caused the result.
Is it for you?
Best for
It is best for performers, speakers, marketers, and product teams with repeated access to representative audiences.
Not ideal for
It is not ideal when feedback is unavailable or each trial carries irreversible reputational risk.
From the transcript
“I try to do all of them and then see what happens.”
“you keep the good ones in”
“Okay, that one didn't seem to go over so well, but everybody seemed to like the Lush Life and the Tom Waits things, so we…”
From the episode
Jazz Guitarist John Pizzarelli: Masters in Business (Audio)
John Pizzarelli