How to conduct a “real” usability test

A crash course for juniors & non-designers. 

Thinking back to my early days as a design student; I knew what usability testing was, but I always felt like I couldn’t quite pull off a “real” one.

It seemed like some kind of secretive process  -  like there was a hidden method that everyone else knew but me. And I was too afraid to admit it. But guess what? Despite the countless fancy techniques out there (and trust me, there’s a lot), usability testing doesn’t have to be complicated at all. 

In fact, when I entered the workforce and got to see the “real designers” in action, I was surprised to see just how simple it could actually be.

Literally me witnessing a “real” test for the first time

So… let me tell you what I’ve learned! 💪

I’ll walk you through my three most frequently used usability testing methods — moderated, remote moderated, and unmoderated — and share my personal go-to Notion and Figjam templates to make your life a lil’ bit easier.

 

The OG method: Moderated Usability Testing

First up, the classic: moderated usability testing. This is a personal favourite amongst many designers  -  myself included. It’s as simple as it gets  -  all you need is yourself, a participant, a prototype, some place to write notes, and a location to test. Hand over a device with your prototype, give them some tasks you’ve defined beforehand, and watch them interact. This method let’s you catch every frown, smile, and moment of confusion. 

Here’s the kicker; the test doesn’t need to be “perfect”. 

… Ok, don’t get me wrong - you should still study best practises. But what I’m saying is that moderated test don’t need to follow a rigid set of steps and rules and result in a sterile & monotone conversation. The session can, in fact, be a delightful conversation! Which also makes the experience so much more enjoyable for both parties.

But do you know what could make this test even better? testing in the participant’s usual working environment 🏥🚕✈️

It usually makes the participant more comfortable and leads to more natural feedback. So bring your prototype with you and visit your users at their place of work.

  • Are you designing an app for taxi-drivers? join them on a ride.

  • Are you designing an app for healthcare providers? Visit them at the hospital.

  • Are you designing an app for travelers? Join them on their travels.


Oh, and by the way. You can give the tasks verbally 🤣 My first ever “real” test, i spent hours printing up all the tasks on A4 paper sheets, cutting them out one by one, and just sliding the question awkwardly across the table over to the participant (while maintaining eye contact). Why did I do it? Because I thought that was what “real” designers did. It was super awkward. 10/10 will not do again.

 

Remote Moderated Testing: The same, But Digital

Next, we have remote moderated testing. It’s basically the OG but over a screen. You hop on a call (Google Meet, Teams, Zoom, whatever), send a prototype link, and let the participant share their screen while you give them tasks to complete.

This method lets you connect with users worldwide, making it easier and cheaper to gather diverse feedback. However, you might miss some body language, and testing mobile prototypes on a desktop isn’t ideal. Still, it’s a great way to keep testing frequent without blowing your budget. My target audience is located in another part of the country than where I am, so I’ve used (and loved) this a lot!

 

The Wild Card: Unmoderated Testing

Finally, there’s unmoderated usability testing. Here, participants interact with your prototype on their own, guided by tasks set up through software (e.g. https://maze.co/). You won’t be there to observe the act, but you can gather tons of data quickly, which is great for spotting patterns like common misclicks or navigation issues.

However, you lose out on those qualitative insights — no follow-up questions, no body language, just raw data. So, while it’s a fantastic way to gather volume, don’t rely on it as your only testing method.

 

Final words

Remember, usability testing can be as easy or as hard as you make it out to be.

Yes, learn best practises. But don’t forget that we’re all just humans on this tiny little ball of earth in a ginormous universe. It’s not the end of the world if you asked a leading question one time. Or two. And one mistake doesn’t make you a “fake” designer. Just make sure to do better next time. Keep your chin up, cause everything will be ok 💡🫶

 

Some resources for you

Do you need some help to streamline and keep track of all your usability testing setup-tasks? ⬆️

Then you can take a look at the template I often use myself.

Link to free Notion template here 

 

Want an easy way to take notes during remote moderated usability test? ⬆️

Check out my free FigJam note-taking template.

Julie Amalie Karlsen

Just a UX designer with her head in the (Figma) clouds

Next
Next

The “perfect” design process isn’t always the best process