Your AI Metrics Could Be Lying to You: The Vanity vs Sanity Problem in UX Measurement

UXChange Podcast on YouTubeWatch on YouTube

SaveMark complete

Sign in to save videos and track what you’ve finished.

IntermediateUX17 min

About this video

A podcast episode on why vanity metrics can mislead when UX teams measure AI features, and which measures better reflect how people collaborate with AI. It is aimed at designers and evaluators of AI features.

What you’ll learn

  • Distinguish vanity metrics from sanity metrics in UX measurement
  • Identify why traditional UX metrics fall short for AI systems
  • Consider how collaborating with AI changes what a team should measure