Why participant quality matters

Anyone commissioning qualitative research usually thinks first about moderation, analysis, and reporting. Recruitment feels like an administrative step in between. In reality, it decides whether the later analysis stands on solid ground or on sand.

A perfectly prepared discussion guide helps little if the person on the other side of the camera doesn't truly belong to the target group or can't articulate their experience.

What quality actually means

Quality doesn't mean packing as many criteria as possible into a screener. Quality means the people in the room really display the relevant behaviour, reflect on it, and can talk about it.

What happens when quality is missing

Bad casting is rarely loud. It shows up in interviews that are polite but yield little new insight, in focus groups that drag, in reports that use the right words but can't support real decisions.

That's why the decisive question before every study is not: how quickly can we find participants? It's: how will we know these participants actually move the research forward?

How to recognise quality before fieldwork

Participant quality cannot only be judged in the interview. Some signals are visible beforehand – if you ask for them:

• The person can describe a concrete, recent situation in which the behaviour under study occurred.
• Screener answers and phone answers match, even when the question is phrased differently.
• They speak in their own words rather than marketing or research vocabulary.
• They want to take part because the topic concerns them – not solely for the incentive.

Illustrative example

Illustrative example (not a client case): a study looks for people who ‘regularly order groceries online’. Many tick ‘weekly’ in the screener. On the phone we ask about the last order: when was it, with which provider, what was in the basket, what was annoying? How fluently or extensively someone answers is not proof of honesty or eligibility – some people are brief, others talkative. If relevant points remain unclear, we follow up specifically (for example on frequency, services used or the order history in the app) and document which criteria are still open. If a criterion relevant to the study cannot be adequately verified, we do not confirm the person – however convincing the conversation seemed.

Checklist for clients

• Is the core behaviour described in a way that can be checked in conversation?
• Are there ‘nice to have’ criteria that narrow the search unnecessarily?
• Is it clear which information about participants you really need – and which you don't?
• Does your recruitment partner know what the results will be used for?