Overview
•Observation involves watching someone perform an activity.
•Think-aloud involves someone thinking aloud during an activity.
•Observation lets you see things the people can’t tell you about.
•Think-aloud gives insights into what people are noticing during a task.
Advantages
•Inexpensive
•Useful for seeing what really happens
•Good for finding out the reasons for what happens
Disadvantages
•Give fragmented insights, not a clear overview
A transcript from a think-aloud session
Well, this looks like… it’s not a bad design overall for a watering can, but they’ve used bronze for the sprinkler part here, which is… it’s a sensible choice in terms of corrosion, of avoiding corrosion, but you need to think about galvanic corrosion here, where you, it’s steel, so that would cause problems. Maybe not a big problem for a small domestic item like this, but it’s something that would be a problem in a big industrial application.
What you need:
•An activity for the participant to perform
•The tools, materials etc needed for the task
•A recording device and/or paper for notes
•You won’t be able to keep accurate handwritten notes in real time while also observing what’s happening.
•People are usually OK with being audio recorded, and quickly stop paying attention to an audio recording device.
•People are usually self-conscious about being video recorded, and this usually lasts through the recording session.
•Explain what you would like the participant to do.
•Give them a quick demonstration involving an activity from an area that’s very different from the one they’ll be doing, to avoid bias.
•Make it clear that there are no right or wrong answers.
•If it’s a think-aloud session, tell them that if they’re silent for more than a specified time (e.g. 5 seconds) you’ll prompt them to say what they’re thinking about.
Tip: Don’t let them see the material until you’ve finished your demonstration, or they’ll start doing the task before you’ve finished explaining.
•Resist the temptation to talk, make suggestions, or help; you’re trying to find out about the participant’s knowledge, with as little bias or steering as possible.
•Make a note on paper or mental note of any significant actions that would not appear on the recording.
*If they are silent for more than the agreed time, use a non-directive prompt, such as: “Could you tell me what you’re thinking about?”
•Once you have identified the key actions and concepts, you can collect quantitative data using various approaches.
•Timelines let you see what is happening when; for instance, how often people hesitate or swear when they try to use a particular feature.
You can use the outputs from these methods (e.g. concepts identified as important) as inputs for other methods, for instance within visual analogue scales.
These approaches can be used to identify places where hesitations and errors often occur, so that the causes can be designed out of the system (whether the system is a software, bureaucratic, or physical system).
Copyleft Hyde & Rugg 2021