A new feature seems convincing in meetings, but often fails with real users during testing. User research methods close the gap between assumption and reality: They show before launch how people actually use a product and not just how a team imagines it. That's why they are an integral part of our UX/UI Design process.
This article systematically categorizes the most important methods such as interviews, card sorting and A/B tests. You'll learn when which method is worthwhile and how qualitative and quantitative approaches complement each other effectively.
Why user research methods come before design
A design draft is always based on assumptions. User research methods replace these assumptions with actual user behavior before development time and budget are invested. Errors that only become apparent after launch cost significantly more than those identified beforehand.
Designers often know their product better than any user. However, this can become a disadvantage. Those who use a product daily overlook hurdles that immediately stand out to new users.
Bitkom therefore classifies usability and user experience as central building blocks of successful digital products.[^1] Those who employ user research methods early therefore not only save costs, but also make more informed design decisions. User-centered design fundamentally places people at the center of the process.
What qualitative user research methods exist?
Qualitative methods provide understanding instead of numbers. They show why people decide for or against an action, not just that they do it.
1. Interviews and contextual inquiries
In interviews, users describe their experiences in their own words. Open questions uncover problems that nobody had thought of before.
Contextual interviews go one step further. They take place directly in the usage environment, such as at the interviewee's workplace.
2. Eye-tracking
Eye-tracking records where users actually look, not where they think they look. Heat maps emerge from this data, making attention visually apparent.
Heat map analysis can therefore reveal, for example, whether a call-to-action is actually perceived. Especially with complex interfaces, this method provides insights that interviews alone cannot deliver.
3. Usability research
In a thinking-aloud test, test subjects verbalize what they are currently thinking while solving a task. This allows confusion or hesitation to be identified directly.
The W3C recommends involving real users with different abilities, especially when evaluating accessibility.[^2] Our article on UX Testing explains how you can prepare such tests in a structured way.
4. Card sorting
In card sorting, test subjects organize terms or content into groups that make sense to them. This reveals how users mentally structure information.
The results flow directly into the information architecture of a website or app. Without this step, navigation structures often orient themselves to the company's internal logic, not to the users.
5. Focus groups
In a focus group, several users discuss a product or concept together. Different opinions clash directly. This makes controversies visible that individual interviews conceal.
Moderation is particularly important here. Otherwise, individual participants quickly dominate the discussion.
6. Diary studies
In a diary study, users document their experiences themselves over days or weeks. This makes rare or long-term usage patterns visible that a single test could not show.
This method is particularly suitable for products with irregular use, such as travel or health apps.
What quantitative user research methods exist?
Quantitative methods provide numbers instead of opinions. They show how many users are affected by a problem, not just that it exists.
1. Surveys and analytics data
Surveys capture the opinion of many users simultaneously, but in less detail than an interview. Analytics data, on the other hand, shows actual behavior, regardless of what users later report.
The article on Data Driven Design shows how real usage data can be analyzed for better design decisions.
2. A/B tests
An A/B test compares two variants directly against each other, under identical conditions. The variant with the better metric wins, regardless of personal preferences in the team.
However, the prerequisite is sufficient traffic so that the results are statistically reliable.
3. Tree tests
A tree test shows test subjects only the text structure of a navigation, without design or images. If they quickly find the desired destination, the structure will also work later on the finished page.
The card sorting concept from the previous step can thus be directly verified.
4. Standardized questionnaires
Standardized questionnaires such as the System Usability Scale or the User Experience Questionnaire provide comparable metrics. Bitkom recommends such scales to continuously observe usability over longer periods.[^4]
How both types of methods can be meaningfully combined
Qualitative user research methods explain the why. Quantitative methods provide the how many. Only together do they provide a complete picture.
| Type | Methods | Primarily answers |
|---|---|---|
| Qualitative | Interviews, eye-tracking, usability research, card sorting, focus groups, diary studies | Why |
| Quantitative | Surveys, analytics, A/B tests, tree tests, standardized questionnaires | How many |
A proven approach starts qualitatively to form hypotheses. Subsequently, quantitative methods such as analytics, A/B tests or tree tests verify whether these hypotheses also apply on a large scale.
DIN EN ISO 9241-11 describes usability precisely through this combination of effectiveness, efficiency and satisfaction.[^3] No single method covers all three aspects alone.
Conclusion
User research methods provide the foundation for design decisions that actually fit the users. Which method is worthwhile when depends on the project phase, budget and question. The combination of multiple methods usually delivers more reliable results than a single method alone.
Would you like to find out which research methods suit your project? Schedule a free initial consultation. Together we'll determine where the greatest leverage for your product lies.
Footnotes and sources
[^1]: Bitkom e. V., topic page "Usability & User Experience". https://www.bitkom.org/Themen/Technologien-Software/Software/Usability-User-Experience.html [^2]: W3C Web Accessibility Initiative (WAI), "Involving Users in Evaluating Web Accessibility". https://www.w3.org/WAI/test-evaluate/involving-users/ [^3]: DIN EN ISO 9241-11:2018, "Ergonomics of human-system interaction – Part 11: Usability: Definitions and concepts". https://www.dinmedia.de/de/norm/din-en-iso-9241-11/279590417 [^4]: Bitkom Akademie, seminar description "UX Tools: Measuring & optimizing usability and user experience", classification of standardized questionnaires such as UEQ for continuous usability measurement. https://bitkom-akademie.de/live-online-seminar/user-experiences-messen-und-optimieren
