Research & Strategy

Lessons from users: Embracing the value of mistakes

  • Kamila Rodzinka

  • Nov 25, 2024

  • 12 min read

  • Nov 25, 2024

  • 12 min read

If you've ever conducted user research, you know how unpredictable these sessions can be. Even the most carefully planned interviews and meticulously crafted scripts can't guarantee a smooth and predictable flow of conversation. Let's explore several common mistakes and unexpected reactions from participants that our research team at Flying Bisons regularly encounters.

No time to explain: The speedy clicker chronicles

Imagine you are preparing for an application usability test. You have designed a research scenario with several critical questions about a specific screen. As the user slowly navigates to that screen, you prepare for valuable insights. Suddenly, in an instant, the respondent clicks several buttons. Before you can react, they are already several screens ahead – far from where you expected them to be. This rapid navigation often leaves researchers scrambling to catch up.

Such situations are common and entirely natural. Whether in research settings or daily life, people tend to rush and lack patience. Their primary goal is often to save time and achieve tasks with minimal effort. This behaviour manifests in users skimming over text or instructions, relying on intuition, and clicking randomly, hoping to find their desired outcome.

While these moments can be frustrating – especially when you've set your heart on a specific research trajectory – they often reveal critical insights. Users may act in ways that seem chaotic or counterintuitive to us. Yet, these behaviours usually reflect genuine interactions with products in real life.

For example, users might skip necessary prompts or help sections simply because they already know what they need. This instinctive behaviour demonstrates that users often prioritise speed over thoroughness, which can result in misunderstandings about how a product is meant to be used.

Instead of making assumptions or setting rigid expectations, we should observe, ask questions, engage in conversation, and keep an open mind. This approach will help us create more valuable and intuitive products. By embracing the unpredictable nature of user behaviour, researchers can gather richer data that accurately reflects how people interact with their designs. Ultimately, the goal is to create experiences that resonate with users – including all the chaotic clicks.

Overthinking simple tasks: The "Wait… what?" moment

Emotions play a significant role in our daily lives and can be particularly intense in new and unfamiliar situations. For many individuals, user interviews and tests represent such uncertainty. As a result, these sessions can elicit a wide range of emotions – from excitement and curiosity to fear of judgment and stress. Unfortunately, strong emotions often cloud logical thinking, leading users to make seemingly "silly" mistakes or irrational decisions.

For instance, when asked to complete a simple action like logging into an app, some users may hesitate excessively or second-guess themselves despite clear instructions. They might overanalyse each step, worrying about making the "wrong" choice, which can lead to unnecessary confusion and frustration.

This behaviour can be especially irritating when it occurs during processes that seem straightforward from a researcher's perspective. However, it's essential to remember that making mistakes is part of being human. Our respondents are not foolish – they find themselves overwhelmed at times.

As researchers, it is crucial to create an environment where users feel comfortable making mistakes without fear of judgment. This encourages genuine interactions and fosters more accurate feedback. By acknowledging the emotional landscape of user testing, we can better support participants and gain richer insights into their experiences.

The cycle of User Research insights

Small talk, significant insights: The chit-chat effect

Sometimes, respondents may deviate from the main topic and start sharing personal anecdotes, which can unintentionally reduce the distance between themselves and the researcher. This is entirely normal! Regardless of how well it is planned, the research setting also allows new acquaintances to build rapport. Just like in everyday life, some individuals find it easier than others to form connections. This desire for mutual understanding often arises from the need to create a friendly and safe atmosphere.

When participants feel comfortable, they are more likely to let their guard down and share genuine thoughts and feelings. Embracing these off-topic discussions can yield valuable insights. For example, a casual comment about a recent vacation might reveal a user's preferences or pain points related to a product. Moreover, small talk can serve as a bridge to deeper conversations.

Research indicates that people enjoy discussing meaningful topics but often hesitate to start conversations because of fear of awkwardness or judgment. By first engaging in light-hearted banter, researchers can create an environment that makes participants feel more comfortable transitioning into deeper discussions. This approach enhances the quality of the collected data and cultivates a sense of partnership between the researcher and the respondent.

As long as we stay focused on our primary research objectives and manage our time wisely, these friendly exchanges can enhance the experience for everyone involved.

It's crucial to balance informal conversations with targeted questions to ensure that we gather valuable insights and maintain focus.

Ultimately, small talk is not just filler – it plays a vital role in building trust and rapport, leading to more prosperous and authentic feedback. By recognising the significance of these interactions, researchers can turn seemingly trivial conversations into powerful tools for understanding user experiences.

Pronunciation puzzles: The linguistic laughter

How often during user studies have you been surprised by how respondents pronounce certain words or names – especially foreign brands? It might seem obvious because you're familiar with the language or have heard others pronounce it correctly. Yet, hearing a participant confidently mispronounce 'Huawei' as 'Wah-way' instead of 'Hwah-way' can be both amusing and enlightening.

Correcting participants is usually unnecessary, particularly when pronunciation accuracy does not significantly impact our research findings or conclusions. Doing so can disrupt the conversation flow and make respondents self-conscious about their language skills. Instead, embracing these quirks can lead to a more relaxed atmosphere where participants feel valued for their input rather than scrutinised for their speech.

Moreover, adapting to the respondent's language fosters rapport by creating a sense of understanding and belonging within the same group. When researchers mirror participants' language style or pronunciation, it can bridge gaps and facilitate a more comfortable dialogue. This mutual understanding encourages respondents to share their thoughts more freely, leading to richer insights.

Ultimately, while we may chuckle at these linguistic fumbles, they provide an opportunity to connect on a human level. By valuing the unique ways individuals express themselves, researchers can cultivate an inclusive atmosphere that invites honest feedback and fosters deeper discussions about user experiences. So next time you hear a creative pronunciation, embrace it – it might just lead to your next great insight!

Pros and cons of embracing mistakes in user research

The social desirability bias: "I'm totally cool" syndrome

One common issue during user research is the social desirability bias – respondents provide answers they believe are more acceptable rather than their true feelings or behaviours. This phenomenon often occurs when users feel pressured to conform to perceived societal norms or expectations. It's like a game of "who can appear the most composed," where participants might prioritise looking good over being honest.

For instance, if asked about their usage of social media apps during an interview, respondents might downplay their actual usage due to concerns about appearing overly reliant on technology. They may say things like, "Oh, I only check Instagram a couple of times a day," when they might be scrolling through their feeds every spare moment. This tendency to present an idealised version of oneself can lead to skewed data and hinder research.

Recognising this bias allows researchers to design questions that encourage honesty by framing them non-judgmentally. Instead of asking, "How often do you use social media?" which may prompt defensiveness, researchers could ask, "What role does social media play in your daily life?" This subtle shift invites participants to share more freely without fear of judgment.

Creating a safe space is crucial in mitigating social desirability bias. Researchers can foster an environment where honesty is valued by emphasising confidentiality and the importance of genuine feedback. For example, reassuring participants that their responses will remain anonymous can help alleviate concerns about judgment and encourage them to share their habits and opinions. Additionally, using indirect questioning techniques can also be effective. Asking participants how they think others use social media or what they perceive as typical behaviour can provide insights into their habits without directly putting them on the spot.

This approach allows respondents to reflect on societal norms while revealing their authentic experiences. Addressing social desirability bias is essential for obtaining accurate and meaningful data. By understanding this phenomenon and employing strategies to counteract it, researchers can gain deeper insights into user behaviours and attitudes – leading to more informed design decisions and, ultimately, better products.

Summary

With projects, deadlines, and business goals looming over us, it's easy to get lost in the formal aspects of work. Yet sometimes, our users remind us of the less formal, friendly side of our jobs – after all, we do what we do for them and with their involvement. Mistakes, blunders, funny stories, and anecdotes are part of our daily lives and ultimately help us improve our work.

By embracing mistakes as valuable lessons rather than setbacks, we cultivate an environment where creativity thrives, and innovation flourishes – a testament to the fact that everyone is human, after all!

Kamila Rodzinka

Kamila Rodzinka

UX Researcher

Unleash Your
Digital Potential

- Today.

Join our list of clients. You’ll be in good company.

  • AMG logo.
  • KFC logo.
  • Booksy logo.
  • Ikea logo.
  • Bank Pekao logo.
One last step to join
our newsletter!
Thank you!

We’ve sent you a confirmation e-mail.