Skip to content

User Testing Metrics: The System Usability Scale

 By Userlytics
 Nov 09, 2017
Home  »  Blog   »   User Testing Metrics: The System Usability Scale

Quantifying how good a user experience is, or how well a site meets the needs of its users, can be a difficult task. We can look objectively at metrics like time on task, or success/failure rates to determine user behavior, but they don’t tell the whole story. To get a more complete picture, we need to rely on usability metrics that are standardized and commonly used throughout many industries, as a means to benchmark our designs when running unmoderated and moderated user research studies.

System Usability Scale (SUS)

usability scoring

A key tool in that usability metric toolbox is the System Usability Scale. Originally developed by John Brooke in 1986, over the last 31 years it’s become an indispensable method to quickly and accurately determine how a site’s user experience compares to industry standards.

The “SUS” is a 10 question Likert Scale – each question rated from 1 to 5 – to gauge a user’s feelings on, among other things:

  • How easy the site is to navigate
  • Whether anything on the site was challenging
  • If various parts of the site work well together
  • Whether the site, overall, was difficult to use

You could evaluate each answer on its own, like a traditional survey, but the SUS goes a step further. It quantifies those results. After calculating a user’s answers, the scale generates a score. That gives you a pretty good understanding of how your site compares to an average across all industries, to an average within your industry, and against different design or production versions of the asset being user tested.

Participant Feedback Questionnaire. The System Usability Scale

Score Breakdown

At the end of the 10-question survey, the formula works like this: subtract 1 from the odd question answers, subtract the value of the even question answers from 5. Then add up the total score, and multiple it by 2.5. The result is a number on a scale of 1 – 100. While not a percentage, it gives you a clear way to understand the score.

  • 100 is a really great user experience, equivalent to an “A”
  • 68 is considered average, a “C” grade
  • Anything below 68 is considered well below average, an “F”

The Secret Weapon

On its own, the score is helpful in understanding how well your site or design does with users, and whether it needs to be improved. But the SUS packs a hidden one-two punch. It becomes even more valuable when used in combination with A/B testing.

Take, for example, two user studies run in parallel: each test using a variation of a new site concept. In both tests, users perform the same tasks, in the same order. At the end, not only can you compare the % that were successful (“conversion rate”), and the time on task, but as each group completes the SUS an average is generated of their answers and compared.

Usability Research. The System Usability Scale

When compared to one another, the scores become more meaningful. Now you have a quantifiable way to show how one concept performs compared to another, under the same conditions. The more users in each group, or multiple iterations of the same test setup, the more accurate the data overall. You can take it a step further, and test small iterations until a clear winner emerges, backing good design with good data science.

Your product, and your stakeholders, will be happier for it.

Interested in UX Testing?

Data Visualizations

Latest Posts

June 3, 2024

The 6 Best UX Testing Tools for UX Research in 2024

Discover the best UX testing tools for 2024. We've compared six options based on price and features to help you find the perfect fit.
Read More
June 20, 2024

AI in UX: The Ultimate Guide To Improve UX With AI

AI in UX. Learn from industry experts about the latest AI technologies and their applications in UX research and design.
Read More
March 5, 2024

The State of UX in 2024

Discover 'The State Of UX In 2024' report: Key insights on UX research evolution, roles of product managers, and future trends.
Read More
August 22, 2023

The Value of Inclusive Digital Experiences

The Value of Inclusive Digital Experiences. Inclusive and accessible products are not just "nice to haves", they are absolutely a MUST.
Read More

Didn’t find what you were searching for?

Ready to Elevate Your UX Game?