Learning pathResearch

Measuring UX with Numbers: Metrics and Statistics

For intermediate to advanced researchers who want to measure user experience with numbers. You will be able to run quantitative usability tests, judge statistical evidence and choose metrics that match product goals.

10 lessons · 2 hr 7 min, plus 2 optional (2 hr 36 min more with the optional lessons)

  1. Beginner (not covered)
  2. Intermediate
  3. Advanced

What you’ll learn

  • Measure perceived usability with the SUS and post-task or post-test questionnaires
  • Report small-sample results honestly using confidence intervals and plain counts
  • Choose analytics, quantitative testing or qualitative methods for a design question
  • Select UX metrics that match product goals and explain them to stakeholders
  • Judge whether a difference between two designs is statistically significant

Lessons

  1. HighMonkey4000 2 min Intermediate

    Start here: learn the SUS, the simplest standard score for perceived usability, which later videos build on.

    Explains the System Usability Scale (SUS), a survey that measures how easy a site is to use according to its users. It shows how the SUS can be used on its own or alongside task-based usability testing, as part of a series of SharePoint usability tips.

  2. 1UX1 Academy 9 min Intermediate

    Widens the SUS into UX KPIs, adding Net Promoter Score and showing how metrics fit inside a usability study.

    Explains how to measure UX key performance indicators using metrics such as Net Promoter Score and the System Usability Scale within usability testing. Aimed at UX designers and researchers who want to track design performance.

  3. NNgroup 6 min Intermediate

    Shows when to ask post-task versus post-test questionnaires, and how combining both pinpoints where usability problems sit.

    Explains when and why to use post-task and post-test questionnaires in quantitative usability testing, and how combining both helps pinpoint usability issues. Intended for UX researchers and designers who run usability tests.

  4. David Travis 5 min Intermediate

    Turns small-sample task results into honest reporting, with a confidence interval for completion rates.

    David Travis answers whether usability test results should be reported as '3 of 5 users' or 'the majority of users', and points to a confidence interval calculator for completion rates. It is aimed at people who report usability test findings.

  5. Judgy Designer 5 min Advanced

    Steps up to advanced by framing when quantitative methods beat qualitative ones for a research question.

    A lesson in a free UX research course that compares quantitative and qualitative research methods, covering the types of each, why teams run quantitative research, and how the two differ for choosing research for a product.

  6. NNgroup 2 min Advanced

    Separates analytics from quantitative usability testing so you can pick the right numerical method.

    Kate Meyer Moran explains how analytics and quantitative usability testing both give numerical insight into user behaviour. She shows that the two methods yield different information and lead to different design actions.

  7. NNgroup 3 min Advanced

    Introduces statistical significance so you can tell real differences between designs from chance results.

    Explains what statistical significance means in UX research and why designers need it to tell real differences between design options from chance results. Aimed at people working on digital products who run or read quantitative tests.

  8. UXDX 18 min Advanced

    Moves from methods to practice: starting success metrics and talking about analytics with stakeholders.

    The video explains how to start tracking success metrics for a product at any stage of its lifecycle, how to talk about analytics with stakeholders, and how to interpret UX data. It offers a step-by-step approach to starting UX analytics practices in a team.

  9. The Fountain Institute 51 min Advanced

    A longer framework session on choosing metrics such as happiness, engagement, adoption, retention and task success.

    A senior UX researcher explains which UX metrics are commonly used, such as happiness, engagement, adoption, retention and task success, and how to choose them through a goals-signals-metrics process. It is aimed at designers and researchers who want to show the value of UX work.

  10. Cascade SF YouTube 27 min Advanced

    An applied example of combining qualitative and quantitative feedback with success metrics in a product team.

    A talk by Ran Liu, a UX designer at Amplitude Analytics, on designing with data. It covers evaluating success metrics, combining qualitative and quantitative feedback, and product strategies for measuring success and converting more customers.

  11. True Ventures 68 min Advanced

    Optional: separates vanity metrics such as traffic and clicks from measures that show whether UX is working.

    Kate Rutter of Intelleto explains how to measure whether a product's UX is working, using measures, metrics and KPIs that track user behaviour rather than easy-to-count traffic or clicks. It is aimed at product builders and startup teams who want actionable UX insight.

  12. TorCHI 87 min Advanced

    Optional capstone: sample sizes, subjective scales and benchmarking, the most technical video, so it comes last.

    A recorded TorCHI AMA in which UX researcher Jim Lewis answers audience questions on quantitative UX research, including sample sizes, subjective measurement scales such as perceived usability, benchmarking, and applying quantitative methods to qualitative data.

When you've finished

Next path: Leading and scaling a UX research practice (Advanced)

Want an easier start? Learning UX Research: Methods, Interviews and Testing

All paths in Research

All paths
  • Learning pathIntermediateResearch

    Intermediate Research: Testing to Stakeholder Influence

    For researchers who already run studies and want sharper interviews and tests, plus ways to get findings acted on. You will be able to plan, run and present research that shapes product decisions.

    10 lessons · 5 hr 10 min, plus 1 optional

  • Learning pathBeginner → IntermediateUX

    Hands-on UX Research Methods and Analysis

    For beginners and early intermediate designers who want to run UX research themselves. You will learn to plan studies, run interviews and field observations, build empathy maps and personas, and analyse what you find.

    10 lessons · 2 hr 36 min, plus 2 optional

  • Learning pathBeginner → IntermediateResearch

    Using AI in UX Research, Beginner to Intermediate

    For researchers and designers who want to use AI in interviews, analysis and testing, and who need to know where human judgment still matters. You will be able to plan AI-assisted studies and check their output.

    8 lessons · 5 hr 41 min, plus 2 optional

  • Learning pathIntermediate → AdvancedResearch

    Studying Users in Context with Field Research Methods

    For intermediate researchers ready to study people in their own settings. You will learn to choose between diary studies, field studies and contextual inquiry, then plan and run each one.

    10 lessons · 79 min, plus 2 optional

Search and sort within Measuring UX with Numbers: Metrics and Statistics

Sign in to mark lessons complete and see how far through you are.