4 builders who never spoke to each other
Count only payment as validation
Signatures on a waitlist, an accelerator place, a directory ranking and one excited beta user are all mistaken for evidence, and none of them is. The substitutes people reach for when they are afraid to ask for money are polling friends, posting the idea publicly and carrying on building in private.
The method
- 01
Count only payment as validation - not an accelerator acceptance, not the top spot on Product Hunt, not one excited beta user.
- 02
Recognise the three substitutes people reach for when scared of asking for money - polling friends, posting the idea on startup forums, and continuing to build in private - and refuse all of them.
- 03
Do not count a waitlist as validation: signatures are not the same signal as a payment.
- 04
Do not wait for statistical significance in a viability test; a handful of conversions is enough to justify moving to the next test.
- 05
Assess an early idea on two measures: the number of people who react at all, and how strongly they react.
What it returned
- 41
Zue had 41 visitors and 7 conversions, granted the rate was untrustworthy, and treated it as sufficient grounds to continue.
- 14
Adam Wathan took 14 orders the night before he officially opened sales, from buyers who worked out how to pay early.
Justin notes it was seeing how much audiences loved his cartoons that carried Walt Disney through ten years before the money arrived; ConvertKit took Nathan Barry three years, and MailChimp ran six years as a side project.
Samples went to juice enthusiasts, health conscious people and people at risk of diabetes. Reactions ran from mild approval to refusal to touch it again even at no cost.
Sources
- Fish where the fish areJustin Jackson · justinjackson.ca · Next, hang out where there are lots of fish · undated
- Find a good partyJustin Jackson · justinjackson.ca · Finding a strong market is like showing up to a good party · undated
- When should you quit?Justin Jackson · justinjackson.ca · But how do you know when to give up? · undated
- Ultimate validationJustin Jackson · justinjackson.ca · How do you validate your idea? · undated
- Presales: Saving Time, Money, EffortDru Riley · trends.vc · 😠 Haters · 2020-12-14
- Testing an MVP with Google Ads and AnalyticsCory Zue · coryzue.com · Is any of this statistically significant? · 2017-05-17
- Validating an Idea is HardCory Zue · coryzue.com · Validation! ...or is it? · 2017-05-12
- A Juicy $3,000 Mistake: Starting Without Market ValidationWit Sumathavanit · failory.com · What were your key levers to start growing it? · undated
- How to find a $1M SaaS ideaTibo Louis-Lucas · tmaker.io · The validation · 2026-06-18
the second source
Three plays a week, for the phase you are in
No roundup of links, no news. Three tactics more than one builder arrived at separately, with the numbers each one returned and the disagreements left in.
More in product
- Give away a tool that pulls its own audience7 unconnected
- Take many small shots instead of one big bet6 unconnected · contested
- Get it into real hands, or shape it first6 unconnected · contested
- Cap the hours and let the ceiling design the business6 unconnected · contested
- Set the bar for writing code deliberately high6 unconnected
- Buy nothing until there is revenue6 unconnected