UX News Feed  |  Usability testing

UX Magazine

Combining In-Person and Remote Research

Usability testing. In the early 90’s, Jakob Nielsen declared in-person user research as state of the art. “User testing with real users is the most fundamental usability method and is in some sense irreplaceable, since it provides direct information about how people use computers [.

By Sabina Idler, 8 May 2012

Featured

Measuring Usability:...

How to Conduct a Usability test on a Mobile Device

Usability testing. When it comes to testing websites there are many unmoderated and moderated solutions. But if you've ever tried to evaluate an app or website on a mobile phone or tablet there are fewer options. Usertesting. com offers a new mobile testing service which recruits users and records their mobile devices while they interact with your app or website.

1 May 2012

UIE Brain Sparks

Discovering the Right Tasks Using an Interview-based Approach

Usability testing. The other day, I wrote about how choosing the right words in your tasks makes a critical difference to the outcome of your user research. Mike Pauley wrote a comment, asking how to make sure you’ve got the right words: Great timing on this, as I am dealing with the same issue with a test I’m currently running.

By Jared Spool, 30 April 2012

Featured

UIE Brain Sparks

Guess What?!? Task Design is Critically Important! – A hard-learned lesson

Usability testing. Years ago, we were watching people try to find products on IKEA. com. (Not for IKEA, but for our other nefarious purposes. ) We took several stabs at our study because, well, the first ones seemed fishy to us.

By Jared Spool, 27 April 2012

Good Usability

Usability testing – what needs fixing?

Usability testing. Usability testing is too often used innapropriately in my opinion. Compared to other research techniques, it’s fairly cheap and easy to organise. But this leads to it being used to answer research questions it often can’t answer. In this post I’ll discuss how I think the UX community is losing touch with some of the basics.

By David Hamill, 18 April 2012

Measuring Usability:...

6 Proportions to Compare when Improving the User Experience

Usability testing. One of the simplest ways to measure any event is a binary metric coded as a 1 or 0. Such a metric represents the presence or absence of just about anything of interest: Yes/ No,  Pass/ Fail, Purchase/No Purchase, On/Off. Fundamentally the binary system is at the heart of computing as we know it. It also plays a critical role in user research.

18 April 2012

UIE Brain Sparks

UIE Tips: What to Expect When You’re Not Expecting It

Usability testing. Even the best of plans can go awry. We role play in our head how a usability test will proceed, understand the objectives at hand, and do a rigorous job of screening the participants. But what do you do when something totally unexpected occurs? Life circumstances among the participants can throw a curveball at our testing plan.

By Jared Spool, 11 April 2012

Measuring Usability:...

20 Tips for your Next Moderated Usability Test

Usability testing. Despite the rise in unmoderated usability testing, the bulk of evaluations are still done with a facilitator. Whether you are sitting next to the user in a lab or sharing screens with someone thousands of miles away, here are 20 practical tips for your next moderated usability test. Shut up and listen:  You need to talk to moderate a session but don't let the talking get in the way of discovering.

10 April 2012

Measuring Usability:...

8 Advantages of Standardized Usability Questionnaires

Usability testing. In a usability evaluation it's good practice to measure both how users perform on realistic tasks and what they think about the usability of the interface.  But what exactly DO you ask the users? "Is this usable?" … "Is the interface easy to use?" .

28 March 2012

Forum One News

A Better Approach to Usability Testing

Usability testing. Forum One's user experience philosophy has long been "test early and often. " However, we often find that usability testing is seen as a rather expansive mini-project at a particular point in the development lifecycle. Too often, we’ve found ourselves writing usability testing scripts and recruiting letters that require approval of the client before testing.

By Brian Verhoeven, 21 March 2012

Measuring Usability:...

10 Things to know about Confidence Intervals

Usability testing. You don't need a PhD in statistics to understand and use confidence intervals. Because we almost always sample a fraction of the users from a larger population, there is uncertainty in our estimates. Confidence intervals are an excellent way of understanding the role of sampling error in the averages and percentages that are ubiquitous in user research.

21 March 2012

Measuring Usability:...

7 S's of User Research Sampling

Usability testing. You can't conduct user research without users. But rarely can we talk to all users in the population we're studying, whether they be consumers, lawyers, doctors or iPhone users. Instead, we need to select a subset of the population and use this sample of users to make general inferences about the unknown total user population.

13 March 2012

Featured

Measuring Usability:...

Nine misconceptions about statistics and usability

Usability testing. There are many reasons why usability professionals don't use statistics and I've heard most of them. Many of the reasons are based on misconceptions about what you can and can't do with statistics and the advantage they provide in reducing uncertainly and clarifying our recommendations.   Here are nine of the more common misconceptions. Misconception 1: You need a large sample size to use statistics.

7 March 2012

Measuring Usability:...

20 Questions Answered about Unmoderated Usability Testing

Usability testing. If you've considered using unmoderated remote usability testing with video here are answers to several questions you might have. On February 28th 2012, I hosted a live webinar sponsored by the folks at Userzoom and Usertesting. com.   The topic was best practices for remote unmoderated usability testing and in it I walked through the results of a comparative usability benchmark analysis I conducted.

29 February 2012

cxpartners

Relax this isn’t a test – 12 ways to learn more about your mobile product

Usability testing. It might sound dumb but testing handheld devices is different to testing websites on desktops. The single most important way to learn more about your app or mobile website is to RELAX. Relax the participant, provide a relaxed environment, relax don’t try and emulate desktop user testing.

By Walt Buchan, 24 February 2012

Measuring Usability:...

Managing the Right Customer Experience Measure

Usability testing. If you can't measure the customer experience, you can't manage it. Improving the customer experience starts with measuring. But you've got to be sure you're getting the right measure (or usually measures) to manage.

21 February 2012

Measuring Usability:...

The high cost of task failure on websites

Usability testing. It's often called web surfing or web browsing, but it probably should be called web doing.   While there is still plenty of time to kill using the web, in large part, we're all trying to get things done. Purchasing, reserving, comparing and communicating—Internet behavior is largely a goal directed activity. If a website doesn't help users accomplish their goals then it's unlikely users will return and refer their friends.

8 February 2012

Measuring Usability:...

Comparison of Usability Testing Methods

Usability testing. There was a time when we spoke of usability testing it meant expensive labs and one-way mirrors. Not anymore. There are three core ways of running usability tests. Each has their advantages and disadvantages.

17 January 2012

Featured

90 Percent of Everyt...

Why I never use panels provided by remote usability testing services

Usability testing. User research. It’s right there in the name. A user is someone who actually uses your service. Equally valid is the idea of a “target user” – someone who doesn’t yet use your service, but has a genuine need that it would fulfil.

By Harry Brignull, 17 January 2012

UXmatters

A Plethora of Participant Personalities

Usability testing. By Adina Klein Published: January 9, 2012 “When your role requires you to deliver valuable and actionable information to a client, the pressure is on—especially when a client is observing your usability testing sessions.

9 January 2012

Measuring Usability:...

Predicting Net Promoter Scores from System Usability Scale Scores

Usability testing. Introduced in 2003 by Fred Reichheld, the Net Promoter Score (NPS)® has become a popular metric of customer loyalty in industry.   The NPS uses a single Likelihood to Recommend question ("How likely is it that you would recommend our company to a friend or colleague?") with 11 scale steps from 0 (Not at all likely) to 10 (Extremely likely), as shown below.

3 January 2012

UX Magazine

Usability Testing Includes Users as Stakeholders

Usability testing. There has been a lot of debate and confusion about how many participants should be included in usability testing. Sometimes business teams think sample size in usability testing is just a matter of personal preference, and may request dozens of participants for “a good sample set.

By Mary Brodie, 21 December 2011

UIE Brain Sparks

UIEtips: Bending the Protocols – Useful Variations on Usability Tests

Usability testing. I remember my first usability test like it was yesterday, even though it was actually more than 30 years ago. I sat in the newly built lab (first of its kind) and watched the participant through the silvered glass as they struggled with the design we were working on. What I didn’t know then was how far we’d take this basic technique and how important it would become to great design.

By Jared Spool, 20 December 2011

Measuring Usability:...

10 Ways to Measure & Manage the User Experience

Usability testing. Improving the user experience means starting with the right measure or measures to manage. Here are 10 of the more common ones I've written about in 2011. SUPR-Q: The Standardized Universal Percentile Rank-Questionnaire is a 13 item instrument for measuring website usability, credibility/trust, loyalty and appearance. Scores are based on a database of 200 websites from tens of thousands of users across dozens of industries.

20 December 2011

Measuring Usability:...

Measuring User Interface Disasters

Usability testing. Completion rates are the gateway metric. If users can't complete tasks on a website, not much else matters. The only thing worse than users failing a task is users failing a task and thinking they've completed it successfully.   This is a disaster.

14 December 2011

Measuring Usability:...

How to find the right sample size for a Usability Test

Usability testing. It's usually the first and most difficult question to answer when planning a usability evaluation:What sample size do I need?There are some who will just say it doesn't matter what the sample size is because usability is qualitative…and after all any users are better than none. Others will say that you only need to test with five users. And yet others will pick another larger number that seems about right.

7 December 2011

Featured

The Usabilla Blog

Reliable User Research and The Click of Recognition

Usability testing. The usability data that we collect from remote testing comes in two forms: quantitative and qualitative. We can express quantitative data with numbers, such as how long a user stayed on a page, how many visits a page gets, or by serving up a survey asking users to rate an aspect of a site on a numerical scale. On the other hand, qualitative data is generally expressed in words, such as answers to open ended survey questions.

By Mike Hughes, 6 December 2011

Measuring Usability:...

10 Essential Usability Metrics

Usability testing. There isn't a usability thermometer to tell you how usable your software or website is. Instead we rely on the impact of good and bad usability to assess the quality of the user experience. Here are 10 metrics you should be familiar with and ready to use in any usability evaluation. 1.

30 November 2011

UsabilityGeek - Usab...

Mainstreaming Web Site Usability Through Automated Usability Evaluation

Usability testing. I have always been intrigued by the fact that although web site usability is proven to be an essential element in web design and development, there still exist an abundance of web sites with poor usability. This paradox is the result of limitations which I have written about in an earlier article on this blog.

By Justin Mifsud, 28 November 2011

Measuring Usability:...

Click versus Clock: Measuring Website Efficiency

Usability testing. Everything should be 1 click away. It takes too many clicks !For as long as there have been websites it seems that there's been a call to reduce the number of clicks to improve the user experience. This was especially the case after Amazon released its one-click purchase button in 1999. Executives, product managers and developers at one point have all joined the call to reduce the number of clicks.

15 November 2011