For intermediate to advanced researchers who want to measure user experience with numbers. You will be able to run quantitative usability tests, judge statistical evidence and choose metrics that match product goals.
10 lessons · 2 hr 7 min, plus 2 optional (2 hr 36 min more with the optional lessons)
Beginner (not covered)
Intermediate
Advanced
What you’ll learn
✓Measure perceived usability with the SUS and post-task or post-test questionnaires
✓Report small-sample results honestly using confidence intervals and plain counts
✓Choose analytics, quantitative testing or qualitative methods for a design question
✓Select UX metrics that match product goals and explain them to stakeholders
✓Judge whether a difference between two designs is statistically significant
Start here: learn the SUS, the simplest standard score for perceived usability, which later videos build on.
Explains the System Usability Scale (SUS), a survey that measures how easy a site is to use according to its users. It shows how the SUS can be used on its own or alongside task-based usability testing, as part of a series of SharePoint usability tips.
Widens the SUS into UX KPIs, adding Net Promoter Score and showing how metrics fit inside a usability study.
Explains how to measure UX key performance indicators using metrics such as Net Promoter Score and the System Usability Scale within usability testing. Aimed at UX designers and researchers who want to track design performance.
Shows when to ask post-task versus post-test questionnaires, and how combining both pinpoints where usability problems sit.
Explains when and why to use post-task and post-test questionnaires in quantitative usability testing, and how combining both helps pinpoint usability issues. Intended for UX researchers and designers who run usability tests.
Turns small-sample task results into honest reporting, with a confidence interval for completion rates.
David Travis answers whether usability test results should be reported as '3 of 5 users' or 'the majority of users', and points to a confidence interval calculator for completion rates. It is aimed at people who report usability test findings.
Steps up to advanced by framing when quantitative methods beat qualitative ones for a research question.
A lesson in a free UX research course that compares quantitative and qualitative research methods, covering the types of each, why teams run quantitative research, and how the two differ for choosing research for a product.
Separates analytics from quantitative usability testing so you can pick the right numerical method.
Kate Meyer Moran explains how analytics and quantitative usability testing both give numerical insight into user behaviour. She shows that the two methods yield different information and lead to different design actions.
Introduces statistical significance so you can tell real differences between designs from chance results.
Explains what statistical significance means in UX research and why designers need it to tell real differences between design options from chance results. Aimed at people working on digital products who run or read quantitative tests.
Moves from methods to practice: starting success metrics and talking about analytics with stakeholders.
The video explains how to start tracking success metrics for a product at any stage of its lifecycle, how to talk about analytics with stakeholders, and how to interpret UX data. It offers a step-by-step approach to starting UX analytics practices in a team.
A longer framework session on choosing metrics such as happiness, engagement, adoption, retention and task success.
A senior UX researcher explains which UX metrics are commonly used, such as happiness, engagement, adoption, retention and task success, and how to choose them through a goals-signals-metrics process. It is aimed at designers and researchers who want to show the value of UX work.
An applied example of combining qualitative and quantitative feedback with success metrics in a product team.
A talk by Ran Liu, a UX designer at Amplitude Analytics, on designing with data. It covers evaluating success metrics, combining qualitative and quantitative feedback, and product strategies for measuring success and converting more customers.
Optional: separates vanity metrics such as traffic and clicks from measures that show whether UX is working.
Kate Rutter of Intelleto explains how to measure whether a product's UX is working, using measures, metrics and KPIs that track user behaviour rather than easy-to-count traffic or clicks. It is aimed at product builders and startup teams who want actionable UX insight.
Optional capstone: sample sizes, subjective scales and benchmarking, the most technical video, so it comes last.
A recorded TorCHI AMA in which UX researcher Jim Lewis answers audience questions on quantitative UX research, including sample sizes, subjective measurement scales such as perceived usability, benchmarking, and applying quantitative methods to qualitative data.
For researchers who already run studies and want sharper interviews and tests, plus ways to get findings acted on. You will be able to plan, run and present research that shapes product decisions.
For beginners and early intermediate designers who want to run UX research themselves. You will learn to plan studies, run interviews and field observations, build empathy maps and personas, and analyse what you find.
For researchers and designers who want to use AI in interviews, analysis and testing, and who need to know where human judgment still matters. You will be able to plan AI-assisted studies and check their output.
For intermediate researchers ready to study people in their own settings. You will learn to choose between diary studies, field studies and contextual inquiry, then plan and run each one.