· Dave Mathias · Ideas  · 7 min read

Rehearsal, Not Research: How AI Personas Make Customer Work Better

AI personas can improve customer preparation, but they cannot replace customer research. The right boundary turns simulation into useful rehearsal instead of invented evidence.

AI personas can improve customer preparation, but they cannot replace customer research. The right boundary turns simulation into useful rehearsal instead of invented evidence.

AI personas are tempting for good reasons.

They are fast, cheap, scalable, and available at midnight before a roadmap review. They never cancel an interview. They can play ten customer roles before lunch and answer the follow-up question you forgot to ask last week.

When time is tight, that can feel close enough to research.

It is not.

An AI persona can help you prepare for a customer conversation. It cannot tell you what a customer believes. That distinction is the difference between useful rehearsal and invented evidence.

The goal is not to make a synthetic customer feel real. The goal is to make the team better prepared for the real one.

Why smart teams feel the pull

Product teams rarely misuse AI personas because they stopped caring about customers. More often, they are under pressure. A decision is due Friday. The same five customers have already been called three times this quarter. Recruiting a new group will take weeks. The team wants one more signal before committing.

An interactive persona appears to solve the problem. It responds immediately. It sounds specific. It may even quote the language found in interview notes, support tickets, and survey responses.

That fluency creates the risk. The output feels like a customer conversation even though no customer took part.

The right response is not to reject the tool. It is to give it a job that matches what it can actually do.

Build a rehearsal partner from evidence

Start with what you already know. Give the AI de-identified interview findings, observed behaviors, common constraints, customer language, goals, and disagreements within a segment. Separate what is well supported from what is uncertain. Include counterexamples, not only the clean pattern the team prefers.

Then define the role and the assignment. Ask the persona to act like a skeptical operations leader reviewing a workflow, a new administrator encountering unfamiliar language, or an executive sponsor who cares about business impact more than feature detail.

Tell it to stay within the supplied evidence. Require it to label inferences and say when the research does not support an answer.

That final instruction matters.

A convincing answer is not the same as a true answer.

Here is what a useful rehearsal can sound like:

Product manager: “Would this automated activation flow make implementation frictionless for your team?”

AI persona: “You used two terms I may not understand: activation and frictionless. What would change in my work on Monday?”

Product manager: “Would completing these three setup tasks reduce the time before your team can use the product?”

AI persona: “That question is clearer. The supplied research says setup time is a concern, but it does not tell me whether these three tasks would solve it.”

The persona did not reveal customer truth. It exposed jargon, improved the question, and refused to fill a gap in the evidence. That is good rehearsal.

A growth-stage B2B SaaS example

Consider a composite example based on a common growth-stage pattern.

A VC-backed B2B SaaS company had a solid customer base and good relationships with several accounts. Those relationships became both an advantage and a constraint. The product team kept returning to the same customers because they were accessible, thoughtful, and willing to help.

The conversations were useful, but they often wandered. A session meant to test a new reporting concept could turn into a discussion about onboarding, an open support issue, or a feature the customer had wanted for months. The team left with pages of notes, yet the question that prompted the meeting was only partly answered. Familiar customers also knew the product and the team too well to react like a new buyer or a less engaged user.

The company used AI personas as a rehearsal layer before customer-facing work. The personas were grounded in de-identified interviews, survey comments, support themes, sales notes, renewal objections, and differences among administrators, daily users, and executive sponsors.

Before sending a survey, the team asked the personas to flag questions that assumed too much product knowledge, forced false choices, or combined two ideas. Before a customer presentation, they practiced with an executive sponsor who kept asking about business impact and an administrator who cared about setup effort. Before a webinar, they tested the opening, likely questions, and places where internal language might confuse a newer customer.

They also rehearsed prewritten research scripts. The AI persona flagged leading questions, suggested follow-ups the team might need, and pointed out where a script could not answer the decision in front of them. Teams used the same approach to preview onboarding instructions, practice renewal and objection conversations, challenge release messaging, prepare prototype walkthroughs, and identify where different customer roles might pull a conversation in different directions.

The gain was not synthetic insight. It was better use of scarce customer time.

The team entered real sessions with a clearer learning goal, cleaner language, planned follow-ups, and a deliberate way to bring a drifting conversation back to the question that mattered. They could still make room for what the customer had on their mind without losing the purpose of the session.

They did not ask the personas what customers wanted. They asked the personas to show where the team was unprepared to learn.

When rehearsal becomes counterfeit evidence

The line is easy to cross because the output looks so usable.

Imagine a product manager creating a persona from six interview summaries and asking whether a new analytics package is worth an extra $99 per month. The persona gives a detailed answer: yes, if it saves two hours a week. The statement is copied into the research repository, shortened into a quote, and later appears in a roadmap deck as evidence of willingness to pay.

No customer said it. No one tested the price. The specificity came from the model, not the market.

The eventual pricing decision might fail, but the deeper failure happened earlier. A rehearsal artifact quietly changed categories and became customer evidence.

A safer boundary is positive and explicit. Use an AI persona to find weak questions, hidden assumptions, missing branches, confusing language, and situations the team should be ready to handle. Use real customers to learn behavior, constraints, priorities, preferences, demand, and willingness to pay.

Keep the two kinds of material separate. Label every transcript and artifact. Do not let a simulated statement enter a customer repository as a quote. Do not count a persona response as a vote. Do not use the convenience of simulation as a reason to avoid customer contact.

Which boundary may move first

These boundaries will change as the technology improves, but they should move because of validation, not enthusiasm.

The first shift is unlikely to be a model predicting demand or willingness to pay. A more credible early shift is narrower: a simulation becoming weak evidence that certain language will confuse a well-studied role, or that a discussion guide consistently misses a known concern.

Even then, the standard should be high. The simulation would need a traceable evidence base, recent source material, clear limits, and repeated comparison with held-out customer responses. Teams would need to know where it performs well, where it fails, and how often those failures occur. Real customer checks would remain part of the system.

Until that discipline exists, the honest label is still rehearsal, not research.

Make the label part of the practice

I would put REHEARSAL, NOT RESEARCH on every AI persona and every transcript it produces.

Then I would update the persona whenever real conversations challenge the source material. If the simulation and a customer disagree, the customer wins and the model gets revised.

Used carelessly, an AI persona gives assumptions a voice and calls it insight. Used well, it helps a team find those assumptions before a customer has to.

One Good Question

What would you need to observe in the next real customer conversation to know the AI persona improved your preparation instead of merely confirming what you already believed?

  • Artificial intelligence
  • Customer research
  • Product management
  • Human judgment
Share:
Back to Blog

Related Posts

View All Posts »
A Score Is Not a Strategy

A Score Is Not a Strategy

How product teams can make better tradeoffs, choose the right prioritization framework, and use AI without outsourcing judgment.