All Methods
Implementation

Usability Benchmarking — SUS / UMUX-Lite

Implementation TrackScope KnownFinal Stage

What it is

Measuring perceived usability with a standardized questionnaire, repeated over time or across versions or alternatives. The System Usability Scale (SUS) has ten statements on a five-point scale, scored 0 to 100. UMUX-Lite has two statements and was developed with a seven-point scale (five-point variants exist, so state which). They are different instruments and their results should not be treated as interchangeable; a SUS-equivalent converted from UMUX-Lite is an estimate, not a measured SUS score. Both measure perception only, not task success, time, or behavior, which can disagree with perception.

Why use it

A consistent, standardized measure shows whether perceived usability is improving across releases and how it compares with a reference, complementing task-based and behavioral findings.

Use this when

  • You need a repeatable measure of perceived usability across releases or alternatives
  • Stakeholders want a simple indicator alongside qualitative findings
  • You want a baseline before a redesign
  • CSAT or satisfaction measures do not isolate usability

You may not need this when

  • You need to know which problems to fix, or results per task (these are whole-product scores)
  • Few participants are available and the score would be read as precise
  • You cannot keep instrument, wording, and administration consistent

Dependencies — what you need

  • A chosen instrument, with exact wording and scale, identical at every measurement
  • Representative users who have used the product, asked right after use and before discussing it
  • Survey tooling (e.g., Qualtrics, Typeform, Google Forms) or an in-product prompt
  • Enough responses and a plan to report uncertainty, such as a confidence interval
All dependencies by type

People involved

  • Design
  • Research
  • Product
  • Analytics

Typical outputs

  • Scores as measured (0 to 100 is not a percentage), with sample size and uncertainty
  • A baseline before changes, and later measurements on the same instrument
  • Like-for-like comparisons; a published average is a reference, not a pass mark
  • Follow-up questions for testing, interviews, or analytics

Template

Usability Benchmarking template

A fill-in structure for running this method: what to prepare, what to do, what to record, and how to read the result.

Preview

How AI can help

AI as augmentation — not replacement

  • Draft the administration script, for the researcher to check against the published wording
  • Help check a scoring spreadsheet built from the published rule, using made-up test answers
  • Draft a plain-language note on what the score does and does not show
  • Summarize open-text comments, for the researcher to review

AI prompt

A prompt for any AI assistant. It works only from material you paste in, keeps assumptions apart from findings, and leaves the decisions to you.

Preview

What might come next