Skip to content

Debates

Should startups assume they already know how their product delivers value, or must they discover the granular, customer-specific job it is being used for?

10 recorded positions from 7 people, first said Sep 21, 2022. They do not agree — the readings below are what each one actually argued.

Open ended discovery questions beat leading validation questions

David Lieb · Sep 21, 2022

Good customer discovery is repeatedly asking why and situating the question in context — when did you last have this problem, what did you do without our product — rather than asking pointed questions about a screen

Users are real human beings with holistic lives, and their answer to a narrow question may depend on unrelated things happening that morning, so you need to understand their problems holistically

19:41 20 Product: The No 1 Metric You Need To Look at When Building Product | Why the Best in Product Have No Domain Experience | Why You Should Not Hire From Incumbents & The Difference Between Good vs Great PMs with David Lieb, Visiting Group Partner @ Y Comb

Marty Cagan · Dec 7, 2022

Qualitative research should hunt for all the reasons customers would not use the product rather than seek affirmation, because that is far more useful for accelerating to something that resonates

Reasons for rejection are more helpful input to the team's model than validation; naive founders do the opposite and look for affirmation

Scope: it doesn't directly tell you what to do; there is no guarantee you ever get there

22:12 20 Product: Marty Cagan on The Four Questions of Great Product Management, Product Lessons from Marc Andreessen, Ben Horowitz and eBay's Pierre Omidyar & The Difference Between Truly Great Product Teams and the Rest

Jag Duggal · Mar 29, 2023

Good customer research questions explore the customer's life around a problem area rather than asking about the problem or pitching a solution directly

Customers don't realize when they're using workarounds or making do; you have to observe around the problem and synthesize it yourself

8:44 20Product: Nubank's CPO on Why Product is 90% Science and 10% Art, Why Execution is Overrated and Strategic Clarity is Under-Appreciated, Why You Should Never Fall in Love With Your Own Ideas & Nubank's Biggest Product Challenges Scaling to 80M Users

Geoff Charles · Dec 6, 2023

PMs often run discovery badly because they come in with an idea and ask questions designed to validate it; they should instead ask open questions like what success looks like, what the worst part of the job is, and what takes the most time.

The idea being validated is often the wrong idea, so leading questions confirm a false premise.

3:16 20VC: Ramp's Product Playbook: How To Hire Product Teams, How to Run Sprints, How to Increase Product Velocity, When and How to Go Multi-Product with Geoff Charles, VP Product @ Ramp

Also on the record

Martin Gontovnikas · Feb 14, 2024

Horizontal products should build a template library and per-use-case content, then infer each new signup's use case from which templates and blog posts they viewed beforehand and tailor the in-product experience accordingly

The main value of templates isn't the templates themselves but that they self-servingly reveal who the user is and what they care about, letting you fine-tune the product

22:40 Infer use case from template and content engagement then tailor onboarding

David Meyer · Nov 1, 2023 · hedged

When a customer comes in with their own point of view, the approach is to interrogate them from a position of knowing nothing until you understand their job well enough to do it, and then vector their vision into yours

Customers arrive with a point of view about your product or their business; you have to understand it and the 'why' behind the steps they describe before redirecting them

5:32 Understand the customers existing point of view then vector it into your own vision

David Meyer · Nov 1, 2023

Purely open-ended questions often can't get you where you need to go, so mildly leading 'open-ish' questions are better than either pure open questions or pitching a demo

Open-ended questioning often fails to reach the area you need to explore; asking 'how would it feel if it happened this way instead' beats talking at the customer

6:35 Mildly leading open ish questions beat both pure open questions and pitching a demo

Matt Lerner · May 31, 2024

Founders don't actually know how they deliver value at the outset, because the real value is far more granular than the problem statement they started with

Ask ten SMBs how to make managing finances easier and you get ten different answers; each customer is trying to do one specific thing in a specific situation where their existing tools fall short, and you have to find that specific thing

17:34 Founders must discover granular customer specific value rather than assume their initial problem statement

Matt Lerner · May 31, 2024

The way to find messaging for a horizontal product is to interview existing signups using jobs-to-be-done technique and assume whatever they think you do for them is what customers want

Using survivorship bias on your side: people who already signed up reveal the real problem and desired outcome

26:54 Jobs to be done interviews with existing signups reveal true messaging for horizontal products

Jag Duggal · Mar 29, 2023

Product managers should enter research with sharp hypotheses but remain agnostic about them — approaching as a judge rather than a lawyer

Vague general questioning is useless, but advocacy for your own hypothesis biases the findings; the difficulty is that keeping distance from your own idea runs contrary to human nature

9:47 Enter research with sharp hypotheses held agnostically like a judge not a lawyer

Your assistant can query this graph directly — 10 positions here, 19,646 across the corpus. Add 996.fm over MCP.