Join us for the 15th international MEX in London in March 2015. 2 days where 100 creative thinkers learn, network and define the future of digital user experience.

A failure of insight?

An abundance of research tools and techniques enables design teams to understand the most complex of consumer needs. Yet so many apps and devices on the market today are difficult to use or just plain undesirable. How do user-insights become so disconnected from the eventual product?

We need to find ways to ensure that the voice of the consumer is interpreted correctly and championed throughout product development.

Let’s go back to the beginning of the process and consider the context in which user research is commissioned. All too often, the fate of research is decided before it has even been conducted. Internal attitudes and politics can bias the themes being explored and the eventual application of the insights that emerge. Add this to time and budget pressures and you start to see a more complex picture.

We should now consider the methods that are available to help learn more about users and the challenges these approaches present. The most appropriate techniques of course depend on the stage of product development:

(adapted from Nielsen Norman, 2008).

Witnessing day-to-day product and service usage in context can be very revealing, not just of existing problems and workarounds, but the subtle attitudes and beliefs that underpin a lot of user behaviour. Alternatively, deep analysis of data can reveal trends that indicate an opportunity. Using inductive approaches like these for idea generation can be very time consuming and does not guarantee a successful outcome. As a result, consultancies are often reluctant to adopt truly inductive approaches, preferring instead to “validate hunches”.

Field testing prototypes or acting out future product/service scenarios with props relies heavily on having “good participants”: disciplined enough to provide their thoughts throughout, creative enough to “get” a new scenario, but not over-eager to please (for free pizza). Back in the lab, one-to-one interviews and focus groups can generate great insights, but must also be carefully designed to minimise the influence and agenda of the researcher.

Quantified testing methods, such as eye tracking and time-to-complete benchmarking, make it easier to compare your product with competitors and make incremental improvements to an existing design. Analytics offer a quick, tangible justification for design decisions that have been made subjectively.

So what’s new in user research? Recent technological developments are making richer user research more accessible to all:

A sketch of techniques used at different stages of the product development process.

A sketch of techniques used at different stages of the product development process.

Regardless of the techniques used, research is an inherently human process, conducting it well requires the researcher to be aware of their own influence on the outcome. As soon as research findings are separated from the people who conducted that research they start to lose their original meaning and can be further warped by other factors like technology push, feature creep and management politics.

One way around this is to ensure that members of the design team take part in the research, regardless of whether it is in-house or external. This ensures those who are involved in the research have an active role in translating their knowledge of user behaviour into the product design. Furthermore, it would give them a feeling of ownership of the process and motivate them to keep looking for hidden answers.

These issues are at the heart of MEX Pathway #17, entitled ‘Improve understanding of user behaviour and enhance how that insight drives design decisions’ and will be explored at the next MEX in London on 26th – 27th March 2013. Some of the questions to be considered include:

I’d love to hear views from anyone working in this area. Feel free to add your comments to the article, get involved at MEX or get in touch by email or by twitter.

1 comment - join the debate

  1. Marek Pawlowski replied:

    There’s an interesting thread on the IxDA discussion board on this topic:

    February 19th, 2013 at 7:20 pm. Permalink.

Post a comment

Trackback URI

Spread the word


Read related articles

About the author
Andrew Muir Wood Andrew Muir Wood is the co-chair of MEX. Andrew is particularly interested in how technology intersects with the human aspects of design. He brings a new perspective to MEX from his work in user experience strategy at Plan in London and his academic background at Cambridge University’s Institute for Manufacturing, where his PhD thesis drew together perspectives from fashion and technology to understand the patterns and drivers of change in the design of consumer products. Web | Email
Posted on
15 February 2013
Opinions, ideas and new thinking
Pathway #17. Insight