Structured Independent Hiring
Assess candidates dimension by dimension before combining independent judgments
- Difficulty
- Moderate
- Time to result
- ~weeks to results
- Steps
- 6
- Confidence
- 96%
Structured Independent Hiring replaces an enjoyable but unreliable holistic interview with systematic evidence collection. The organization first defines the candidate characteristics relevant to the role and creates consistent prompts and scoring criteria for each. Interviewers gather and assess evidence dimension by dimension instead of immediately forming a general impression. Multiple evaluators then record independent judgments before seeing colleagues' ratings or entering a panel discussion. Their assessments are combined, after which the group examines the aggregate and any consequential disagreements. Independence preserves information that would otherwise disappear when an influential interviewer speaks first. Structure also makes candidates more comparable and limits the halo effect. The method does not guarantee that a selected employee will succeed, because workplace outcomes still contain chance, interpersonal fit, and changing circumstances.
Origin
Extracted from Masters in Business as Kahneman contrasted common impression-based interviews with state-of-the-art structured selection.
Core principles
- 01Holistic interviews create unreliable impressions.
- 02Candidate characteristics should be assessed systematically.
- 03Interviewers should form judgments independently.
- 04Aggregation should precede open discussion.
- 05Better processes improve odds but cannot remove real-world uncertainty.
How to run it
- 1
Define Success Characteristics
Identify the capabilities, experience, behaviors, and constraints that genuinely predict performance in the role.
Pro tip Limit the list to characteristics that interview evidence can meaningfully assess.
Watch out Vague traits such as general likability invite subjective reinterpretation.
- 2
Structure the Evidence
Prepare consistent questions, work samples, and rating anchors for every candidate. Map each item to a defined characteristic.
Pro tip Use behavioral questions that request specific past actions and outcomes.
Watch out Different questions for different candidates undermine comparability.
- 3
Assess Dimensions Separately
Evaluate each characteristic from the relevant evidence before forming a general view of the candidate.
Pro tip Record supporting evidence beside every rating.
Watch out A powerful first impression can spill into all scores if dimensions are not kept distinct.
- 4
Preserve Independence
Have several interviewers record their impressions without seeing one another's ratings. Prevent senior participants from framing the candidate first.
Pro tip Require score submission before the panel meeting begins.
Watch out Sequentially announced opinions create conformity rather than additional evidence.
- 5
Aggregate the Ratings
Combine the independent assessments to obtain a more stable view. Review the average alongside meaningful disagreement and missing evidence.
Pro tip Use a predetermined aggregation rule so the panel cannot change it for a favored candidate.
Watch out Averaging can reduce noise but cannot correct a bias shared by every interviewer.
- 6
Discuss and Decide
Let the panel deliberate after the aggregate is visible, focusing on evidence, trade-offs, and unresolved discrepancies.
Pro tip Ask dissenting interviewers to explain the evidence behind unusually high or low ratings.
Watch out Do not mistake a refined process for a guarantee against future bad luck or poor fit.
In the wild
Several interviewers evaluate the same finalist using common dimensions. Each forms an independent impression and submits ratings before discussion. The panel then averages the assessments and discusses both the combined result and the largest disagreements.
→ The organization gains more independent information and a less noisy selection than it would from one unstructured conversation.
A software company evaluates finalists on technical judgment, coaching, delivery, communication, and values-based scenarios. Interviewers use shared anchors and submit evidence-backed ratings independently. The panel reviews the aggregate only after all scores are locked.
→ A charismatic but weak operator no longer wins solely through an interviewer's global impression.
Common mistakes
Hiring by General Impression
An enjoyable free-form conversation produces a coherent feeling about the candidate but gathers inconsistent and weakly comparable evidence.
Allowing Early Anchors
When interviewers reveal judgments sequentially, later participants adapt to the first opinion and sacrifice independence.
Expecting Certainty
Even an excellent selection process cannot remove chance, changing circumstances, or conflict with a future manager.
Is it for you?
Best for
It is best for organizations making recurring hiring or promotion decisions through multi-person interview panels.
Not ideal for
It is not ideal for informal exploratory conversations that are not being used to select or rank candidates.
From the transcript
“A much better way of doing it is what it's called the structured interview, the structured process where you accumulate information systematically about different characteristics…”
“better yet is having several in several people do the hiring, each of them forming an independence impression, and then they discuss, then they average,…”
“Hiring doesn't mean that you're guaranteed the perfect sit There's so much there's so much luck in the world.”
From the episode
Daniel Kahneman on Behavioral Economics (Podcast)
Daniel Kahneman