Why a feedback plan beats “What do you think?”

Early adopter feedback questions are most useful when they help you make one specific decision: fix onboarding, clarify positioning, choose a workflow to improve, or learn why sign-ups did not become active users. A broad request for opinions often produces polite praise, speculative feature ideas, and little evidence about what to build next.

Decide what you need to learn before you schedule calls. For example, “Why do new users fail to create their first report?” is a research goal. “Do users like the product?” is not. The first can produce evidence about a workflow; the second invites an opinion that is difficult to act on.

In-depth interviews are intended to reveal users’ circumstances, how they use a service, and the needs behind an outcome. They can be paired with moderated usability testing, in which a participant tries a real product task while you observe. Interviews explain context, while task observation can reveal friction people may not remember or mention.

Do not treat a small set of conversations as a representative survey. Look for repeated patterns among people with comparable jobs, needs, and product exposure. Preserve contradictory evidence too: it may indicate different use cases or an assumption that needs more research.

  • Choose one decision for each research round, such as whether to simplify setup or change a landing-page promise.
  • Recruit people who encountered the relevant workflow: active users for value questions, recent drop-offs for activation questions, and paying customers for purchase questions.
  • Ask permission to record, take short notes, and tag each finding with the participant type and evidence behind it.
  • End every call by recording a one-sentence finding, the supporting quote or observed behavior, and the product decision it may affect.

Prepare the conversation around a real event

Anchor the discussion in a specific occasion when the participant tried to achieve the outcome your product addresses. Ask about the work they did, the trigger that started it, the people involved, and the result. Stories and real examples are more useful research material than broad opinions about what people think they might do.

Start with the person’s world, not your product. GOV.UK guidance on learning user needs recommends establishing what users are trying to do, how they currently do it, which channels or services they use, and the frustrations they experience. This helps you assess whether the product addresses an urgent, recurring problem or an interesting possibility.

As a practical starting format, you might reserve part of a short session for the prior workflow and trigger, part for discovery and expectations, and part for a realistic product task or a walkthrough of the latest session. Adapt the structure to the decision you need to make. If a live session is not possible, ask for a consented recording of one task and follow up about specific moments.

If your initial launch generated comments or discussions, distinguish those reactions from evidence about product use. Ask feedback participants about a workflow they have actually attempted. Builders preparing a launch can submit a product to vibecodedstartup.com, then include a clear feedback invitation in their own launch communications or consented follow-up channels.

  • “Tell me about a time you needed to solve this problem.”
  • “What happened that made it important to deal with then?”
  • “Take me through what you did, from the first step to the outcome.”
  • “Who else was involved, if anyone?”
  • “What made that process harder than it needed to be?”

Use open, neutral wording that asks for evidence

Your job is not to persuade participants that the product is useful. It is to understand what happened. Open and neutral questions make room for disappointment, indifference, and unexpected uses. Government questionnaire guidance cautions that leading questions steer respondents toward a response; wording such as “What, if anything, was difficult?” is more balanced than “What did you find difficult?”

Avoid prompts that force users to design your roadmap. “Which feature should we build next?” can produce a list of requests without the context needed to assess importance. Ask about the work, workaround, consequence, and frequency first. Then assess whether the underlying need is common, painful, and appropriate for your product.

Avoid treating future hypotheticals as pricing validation. “Would you pay $20?” asks people to predict a purchase outside the conditions in which they make one. A stated price preference is exploratory at most. More useful signals include current spending, budget ownership, existing contracts, approval steps, and concrete purchase behavior.

  • Prefer: “How do you handle that today?” Over: “Would our automation help?”
  • Prefer: “What, if anything, was unclear when you started?” Over: “Was onboarding easy?”
  • Prefer: “What did you do when that step did not work?” Over: “Would you use a feature to fix it?”
  • Use follow-ups: “Can you show me?”, “What happened next?”, “How often does that occur?”, and “Why did that matter?”

Question set 1: Problem, trigger, existing workflow, and alternatives

These early adopter feedback questions establish whether there is a durable problem beneath initial curiosity. Ask them before discussing individual screens or features. You are looking for a clear user goal, a trigger that creates urgency, and evidence of the current approach.

Listen for specifics: a recurring deadline, a handoff between teammates, a spreadsheet maintained every week, an agency process, or a workaround involving several tools. A user who has not tried to solve the problem can still offer useful discovery context, but their account is less direct evidence for prioritizing a workflow.

Alternatives are broader than direct competitors. The alternative may be doing nothing, using a template, hiring a contractor, relying on an internal process, or stitching together general-purpose tools. Understanding the baseline clarifies what change your product asks the user to make.

  • “What were you trying to accomplish when this came up?”
  • “What triggered the need to act?”
  • “How did you handle it before you found our product?”
  • “Which tools, people, documents, or channels were involved?”
  • “What was frustrating, slow, risky, or expensive about that approach?”
  • “What happened when you did not solve it?”
  • “What have you tried before, and why did you stop using it or keep using it?”

Question set 2: Discovery, expectations, onboarding, and activation

Discovery questions test whether your acquisition message matches the product experience. Ask where the participant first encountered you, what caught their attention, and what they expected after signing up. If several people expect one outcome and your product delivers another, you may have a positioning problem even if the software works as designed.

For onboarding, do not rely only on a retrospective account such as “It was straightforward.” Ask the participant to complete a realistic task that represents activation in your product: connect a data source, invite a teammate, create a first project, generate an output, or publish something. Observe quietly and note hesitation, backtracking, skipped instructions, error recovery, and points where they ask for help.

Nielsen Norman Group describes usability testing as asking participants to perform tasks while a researcher observes behavior and listens to feedback. Observed behavior and attitude are distinct: a user can say a setup flow is clear while still being unable to finish it without assistance.

When a task fails, resist the urge to explain the interface immediately. Ask what the participant expected, what they noticed, and what they would do next. Those answers help identify the source of the friction.

  • “Where did you first hear about the product?”
  • “Before signing up, what did you think it would help you do?”
  • “What made you decide to try it at that moment?”
  • “Please show me how you would use this to complete [realistic task].”
  • “What are you looking for here?”
  • “What did you expect to happen when you selected that?”
  • “At what point, if any, did you consider stopping?”

Question set 3: Value, friction, payment, and referral triggers

Once a participant has used the product enough to describe its effects, shift from features to outcomes. Look for changed behavior or a concrete consequence: a task completed sooner, an error avoided, a decision made with more confidence, a handoff removed, or a result that was otherwise difficult to obtain.

Ask about friction with the same specificity. “Anything else?” is useful at the end of a call, but it should not be the main diagnostic question. Identify the moment where effort outweighed expected value and what the person did instead. The answer can point to a product fix, better guidance, a different target audience, or a clearer promise.

For payment, investigate existing behavior rather than seeking a flattering prediction. Learn what the user currently pays for, whether spending is personal or company-funded, who approves it, and what would need to change before they could switch. A real purchase or commitment decision provides stronger evidence than a hypothetical answer alone.

Referral questions can reveal the vocabulary of people who may be a good fit. Rather than asking whether they would recommend the product in the abstract, ask who else experiences the problem and in which situation they might mention it.

  • “What, if anything, is better now than before you used the product?”
  • “Which result mattered most, and why?”
  • “What still feels like more effort than it is worth?”
  • “When that happened, what did you do next?”
  • “What do you currently spend money, time, or staff effort on to solve this?”
  • “Who decides whether to purchase a tool like this?”
  • “What would need to be true for you to start paying or switch from your current approach?”
  • “Who do you know that runs into this problem, and when would you tell them about this?”

Turn conversations into a prioritized post-launch plan

After each research round, compare what people said with behavioral and operational evidence available to you. Review onboarding completion, activation events, support conversations, cancellations, search terms, and previous research. GOV.UK advises teams to consider existing evidence such as analytics, search logs, call-centre data, and prior research rather than treating opinions or internal suggestions as proven needs.

Create a lightweight evidence table with five columns: participant type, observed or reported problem, frequency or context, consequence, and confidence. Group evidence by underlying need, not by requested feature. For example, requests for templates, an import tool, and guided setup may all point to the same need: getting a first useful result without manual configuration.

Prioritize a change when it relates to an important activation or retention step, appears repeatedly within a relevant audience, has a clear consequence, and is supported by behavior as well as words. Keep a list of assumptions that still need testing. This prevents the loudest early adopter from becoming your accidental product manager.

For a future launch, use vibecodedstartup.com to submit your product and make your feedback request explicit in the channels you control. The platform organizes launches on weekly boards and supports voting and product discussions; treat those interactions as prompts for further research, not as proof that a product decision is correct.

Choose one decision, invite relevant users or recent sign-ups through consented channels, and run the same evidence-seeking conversation before changing the roadmap. If you are preparing the next launch, you can submit your product through the platform’s submission route.

  • Do not count feature requests; count repeated evidence of a consequential user need.
  • Separate reported feedback from observed task behavior in your notes.
  • Write the proposed change as a testable hypothesis, such as “A guided first project will improve completion of the first setup task.”
  • Review whether the change improved the intended behavior before declaring the finding resolved.