Impact-First Science Story Selection
Choose consequential science, validate it with experts, and explain its limits
- Difficulty
- Advanced
- Time to result
- ~weeks to results
- Steps
- 6
- Confidence
- 96%
Begin with candidate research that addresses an important or fundamental question, then determine whether it genuinely advances its field or opens productive new directions. Editors should not rely solely on their own judgment or the claims of a paper's authors; they should consult several independent experts and look for broader research-community interest. The reporting must preserve both the excitement and the limitations of the work, including unresolved questions and competing interpretations. Accessibility is treated as an editorial challenge rather than a reason to reject difficult material. After publication, success is assessed through a balanced scorecard: scientific importance, explanatory clarity, audience reach, and whether knowledgeable experts regard the account as accurate and useful. Traffic informs reach but never justifies selecting a story by itself.
Origin
Extracted from Masters in Business, where Thomas Lynn described how Quanta Magazine selects, validates, explains, and evaluates stories about fundamental science and mathematics.
Core principles
- 01Prioritize ideas that advance their research field.
- 02Pursue fundamental questions even when the material is difficult.
- 03Use independent experts rather than personal taste to establish significance.
- 04Explain caveats and limitations alongside exciting findings.
- 05Judge success through impact, accessibility, reach, and expert trust.
How to run it
- 1
Find the fundamental question
Identify the large scientific or mathematical question the work attempts to answer. Prefer research that advances understanding rather than merely producing an isolated novelty.
Pro tip State the underlying question in language that an interested nonspecialist can understand.
Watch out Do not confuse an attention-grabbing result with a consequential one.
- 2
Test field-level importance
Determine whether the idea is regarded as important by the relevant research community and whether it could lead to further discoveries.
Pro tip Look for evidence that the work is pushing other researchers toward new questions or methods.
Watch out An author's confidence in a personal theory is not independent validation.
- 3
Consult multiple experts
Speak with several knowledgeable researchers, including people independent of the work. Use their combined views to estimate significance, reliability, and genuine excitement.
Pro tip Include experts likely to identify weaknesses or competing interpretations.
Watch out Do not infer consensus from one prestigious source.
- 4
Map caveats and limitations
Record what the evidence establishes, what remains uncertain, and what cannot yet be tested. Make those boundaries part of the story rather than burying them.
Pro tip Ask each expert what would change their interpretation of the result.
Watch out Removing uncertainty may make a story simpler but scientifically misleading.
- 5
Build the accessible explanation
Translate the key insight into a compelling narrative while preserving its technical meaning. Treat abstraction and difficulty as problems to solve, not reasons to abandon the subject.
Pro tip Anchor the explanation in the central insight before introducing technical detail.
Watch out Avoid analogies that create a false mental model.
- 6
Measure multidimensional impact
Assess whether the story covered important science, reached interested readers, conveyed the key insight, and earned the confidence of experts.
Pro tip Collect feedback separately from general readers and domain specialists.
Watch out Do not let page views become the sole definition of impact.
In the wild
An editor finds a preprint proposing a new account of spacetime. Rather than publishing because the claim sounds revolutionary, the team asks several independent physicists whether the mechanism is credible, identifies what remains untested, and builds an explanation around the real advance rather than the most dramatic implication.
→ The resulting article is accessible and exciting without presenting a speculative proposal as established fact.
A small study is attracting large audiences online, but independent researchers identify methodological weaknesses and little lasting relevance. The editor declines a conventional hype story and instead considers a broader piece explaining why the evidence is inconclusive.
→ Editorial resources move toward work with greater scientific and public value.
Common mistakes
Selecting by difficulty alone
Hard material is not automatically important. Difficulty should not disqualify a subject, but significance must still be established independently.
Trusting a single advocate
Researchers can be understandably invested in their own theories. Consulting multiple independent experts reduces the risk of amplifying a pet idea.
Equating traffic with impact
Reach matters, but a widely viewed article can still be scientifically trivial or inaccurate. Impact must include importance, accessibility, and expert trust.
Is it for you?
Best for
It is best for editors, research communicators, and technical content teams choosing among complex or emerging subjects.
Not ideal for
It is not ideal for commodity breaking news that must be published before meaningful independent validation is possible.
From the transcript
“We actually talked to a lot of the true experts out in the field.”
“never use traffic as a justification for doing a story.”
“what we're really looking at is impact, right broader impact.”
From the episode
Thomas Lin Discusses Deep Science (Podcast)