Product Thinking: Metrics, Experiments and Shipping
This path is for designers who already know the basics and want to make product decisions with evidence. You will learn to judge ideas, link design to outcomes, run experiments and see how real teams ship.
10 lessons · 4 hr 16 min, plus 2 optional (1 hr 42 min more with the optional lessons)
Beginner (not covered)
Intermediate
Advanced (not covered)
What you’ll learn
✓Explain product stages and judge ideas for feasibility, viability and desirability
✓Link design decisions to a North Star Metric and product outcomes
✓Turn design assumptions into testable hypotheses and run an A/B test
✓Diagnose where users drop off in a funnel and plan one fix
✓Describe how real product teams choose problems and ship, using Config case studies
Start here: this sets out the product stages, problem, solution and product-market fit, that later videos refer to.
A podcast conversation between a product designer and a product manager on the stages of a product: problem-market fit, solution-market fit and product-market fit. They discuss the strategy for each stage, how they relate to Lean Startup and Design Thinking, and why product designers should understand them.
Downtown Orlando UX Meetup · 36 min · Intermediate
Adds a simple lens of feasibility, viability and desirability for judging any product idea before the metrics talks.
A talk from a Downtown Orlando UX meetup that explains how feasibility, viability and desirability work together in successful products. It looks beyond user desirability, the focus people often associate with UX, and shows how to apply the framework to your own product.
Optional: shows how product stages become roadmaps and how ICE scoring helps prioritise the work.
A podcast episode in which a product designer and a product manager discuss what roadmaps are, the types that can be defined, and how to use the ICE (Impact, Confidence, Effort) framework to prioritise problems. They also cover how a well-communicated roadmap shapes team outcomes, systems thinking, scalable solutions and legacy work.
Design for Change with Jagadeesh · 6 min · Intermediate
Introduces the North Star Metric, linking design decisions to user behaviour and business outcomes.
Episode 55 of SHIFT 100 explains how product designers can link UX decisions to a North Star Metric through a chain running from design decisions and user behaviour to product metrics and business outcomes. It covers breadth, depth and frequency, using Amplitude Analytics, and separating measured results from hypotheses, with a challenge to apply this to a portfolio case study.
Applies a growth mindset and quick validation to find and test growth opportunities with measurable outcomes.
A talk by Dropbox product designer Paolo Ertreo on combining UX methods with product management techniques to find and test growth opportunities. It covers building a growth mindset, product frameworks for meeting KPIs, and validating ideas quickly through iterative experiments.
Goes deeper on experimentation, turning assumptions into testable hypotheses and avoiding common A/B test mistakes.
Adrian Andrade, Product Design Lead at Eventbrite, shares lessons from running A/B tests and experiments on digital products. The talk covers techniques for putting an experimentation strategy into practice, along with the dos and don'ts of A/B testing.
Design for Change with Jagadeesh · 6 min · Intermediate
Shows how to adapt with the OODA Loop when experiment results are unexpected, separating facts from assumptions.
The video shows how to apply the OODA Loop (Observe, Orient, Decide, Act) to UX and product design decisions when experiments fail or results are unexpected. It covers separating facts from assumptions, running small experiments and the role of data quality in product analytics.
Puts the metrics and experiments into practice with a funnel case: finding a conversion drop and designing one fix.
A product design method for finding where free users drop off on the way to becoming paying customers, diagnosing the blocker and designing and measuring one fix. It covers mapping the signup-to-paid journey in actions, locating the first major drop using analytics, and gathering qualitative and quantitative evidence.
Downtown Orlando UX Meetup · 45 min · Intermediate
Optional: the Amazon future press release technique for defining the customer and problem before building.
A meetup talk by Jake Parks of AAA on Amazon's 'future press release' technique, in which teams write a mock launch announcement to define the customer, problem and benefit before building a product. It is aimed at product and UX practitioners who want to apply the process in their own organisation.
First real-team case study: how Instagram and Artifact chose the right problem to solve.
A conversation between Ellen McGirt of Design Observer and Kevin Systrom, CEO of Artifact and former CEO of Instagram, on how teams identify the right problems to solve. They discuss how a relentless focus on user needs drives product development.
Shows how Stripe's design team works through guiding principles and two product case studies, from idea to launch.
An inside look at how Stripe's design team works, covering the team, four ideas that guide its design, a 'Cardless' UI case study and a redesign of the dashboard, from idea to final product. The talk is aimed at designers interested in how a product team navigates design complexity.
Closes with a hands-on walkthrough of a feedback-driven redesign of notifications, shipped by Figma's product team.
An interview-style project walkthrough in which Figma product designer Tammy Taabassum shows how she redesigned notifications, covering handling critical user feedback, early explorations, iterations and button design. It is aimed at designers who want to see a real design process from inside a product team's files.
For intermediate designers who want to see how culture, language and market context change product decisions. You will be able to read regional design patterns and plan a product for a new market.
For designers and engineers new to hardware who want to follow a physical product from concept to validation, and understand minimalism, medical constraints and AI-era devices.