logo
episode-header-image
Mar 2025
16m 16s

#105 AI UX is Broken – How Do We Measure...

PATRICIA REINERS
About this episode

In this episode, we’re tackling a huge question: How do we measure a “good” AI experience?

AI is shaping everything—from hiring decisions to medical diagnoses, from content recommendations to self-driving cars. But here’s the issue: we don’t even have clear UX standards for AI.

💡 If we don’t measure UX in AI properly, we risk building products that are functional but untrustworthy, accurate but unethical, powerful but frustrating to use.

We dive into:

〜 Why traditional UX metrics fail in AI-driven products
〜 The Amazon hiring AI scandal—how biased algorithms create bad UX
〜 The problem of explainability—why we often don’t understand AI decisions
〜 The future of AI UX standards—should there be a universal AI UX certification?

📌 Core Question: Can we trust AI to deliver great user experiences if we don’t even know how to measure them?

Let’s explore what’s missing in AI UX—and what needs to change.


Other resources

💻 ✨Waiting list for the AI Academy: 6-week Bootcamp to Learn How to Master AI as a Designer

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Get notified when doors are opening again⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠


👉 0€ AI mini Training for Designers 👈

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Learn 3 strategies to leverage gen AI as a designer in just 30 min⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠


💌 Newsletter

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Free Weekly UX insights and updates: UX Newsletter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠


Follow the Future of UX:

🎨 Linkedin: ⁠Future of UX Podcast⁠

📸 Instagram: ⁠Future of UX Podcast⁠

🍏 Apple Podcast: ⁠Future of UX⁠

💚 Spotify: ⁠Future of UX⁠



Find Patricia on Socials

📸 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Instagram @ux.patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎨 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Linkedin Patricia Reiners⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🐦 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Twitter @ux_Patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

📝 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠My UX Design Blog ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎥 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Youtube ⁠⁠⁠⁠

Up next
Today
#127 How ChatGPT Apps Could Redefine UX Design: When Apps Go Invisible:
What happens to UX design when apps disappear or rather, move inside ChatGPT?Please share your thoughts with me on LinkedinIn this episode of Future of UX, Patricia explores OpenAI’s latest update: ChatGPT’s new app ecosystem. With integrations from Canva, Figma, Booking.com, and ... Show More
16m 51s
Oct 2
#126 Synthetic Users in UX Research: Hype, Reality, and the Future of Design
Curious to hear your thoughts .Please share them here: LinkedinIn this episode of Future of UX, we dive into one of the most controversial topics in design right now: synthetic users.These AI-generated “users” promise fast, cheap, scalable insights — but can they really replace t ... Show More
20m 47s
Sep 25
#125 Ray-Ban Meta Glasses: UX Wins, Fails, and What’s Next
Smart glasses are back and this time, they actually look good. In this episode of Future of UX, Patricia Reiners breaks down Meta’s brand-new Ray-Ban Meta Glasses and what they mean for designers, technology, and the future of human-computer interaction.We’ll explore the UX lesso ... Show More
13m 23s
Recommended Episodes
Aug 15
Measuring AI code assistants and agents with the AI Measurement Framework
In this episode of Engineering Enablement, DX CTO Laura Tacho and CEO Abi Noda break down how to measure developer productivity in the age of AI using DX’s AI Measurement Framework. Drawing on research with industry leaders, vendors, and hundreds of organizations, they explain ho ... Show More
41m 14s
Sep 8
68: Using AI at Work Without Being Replaced with Steff Vanhaverbeke
Chris Daigle sits down with Steff Vanhaverbeke, author of Being Replaced: The Five Human Skills AI Cannot Automate, to explore how professionals and businesses can thrive in an AI-powered world. Steff introduces her Cognitive Agility Framework, highlighting the uniquely human ski ... Show More
53m 13s
Jan 2025
Navigating the AI Landscape: Google's Strategy
In this episode, Jaeden Schafer discusses Google's current position in the AI landscape, focusing on the significance of the Gemini project for the company's future. He highlights the urgency expressed by CEO Sundar Pichai regarding the need for rapid innovation and adaptation in ... Show More
7m 46s
Feb 2025
OpenAI researcher on why soft skills are the future of work | Karina Nguyen (Research at OpenAI, ex-Anthropic)
Karina Nguyen leads research at OpenAI, where she’s been pivotal in developing groundbreaking products like Canvas, Tasks, and the o1 language model. Before OpenAI, Karina was at Anthropic, where she led post-training and evaluation work for Claude 3 models, created a document up ... Show More
1h 14m
Sep 7
How AI is reshaping the product role | Oji and Ezinne Udezue
Ezinne and Oji Udezue have over 50 years of combined product leadership experience at Microsoft, Twitter, Atlassian, WP Engine, Typeform, and Calendly. They’ve witnessed every major shift in product management, and, despite their seniority, they’re taking beginner AI courses and ... Show More
1h 18m
Apr 2025
Co-Intelligence — Using AI to Think Better, Create More, and Live Smarter
The era of artificially intelligent large language models is upon us and isn't going away. Rather, AI tools like ChatGPT are only going to get better and better and affect more and more areas of human life.If you haven't yet felt both amazed and unsettled by these technologies, y ... Show More
57m 46s
Sep 4
Is Google Now the AI Leader?
Google’s AI comeback is turning into something bigger. Today’s AI Daily Brief covers whether Google has taken the lead in the AI race, with multimodal breakthroughs, Gemini’s surge, and a huge antitrust win around Chrome. We also dig into Anthropic’s $13B raise at a stunning $183 ... Show More
29m 23s
Sep 4
AI Career Guide: Top Jobs & Skills for the Age of Artificial Intelligence
Welcome to English Plus Podcast's deep dive into "Living in the Age of AI"! This week, we tackle one of the most pressing questions of our time: "What are the top current and future jobs related to AI, and what can you do to be qualified to do them?" Join us as we demystify the p ... Show More
32m 16s
Sep 21
From managing people to managing AI: The leadership skills everyone needs now | Julie Zhuo (Facebook VP, Sundial CEO, The Making of a Manager author)
Julie Zhuo is the former VP and Head of Design at Facebook (now Meta), author of the bestselling book The Making of a Manager, and co-founder of Sundial, an AI-powered data analysis company. Also, my first-ever podcast guest over 3 years ago!In our conversation, we discuss:1. The ... Show More
1h 36m
Feb 2025
The Ugly Truth About How AI Will Replace Graphic Designers – Are You Safe or Helping It Take Your Job?
AI is already replacing some Graphic Designers—and if you’re not paying attention, you could be next. The scary part? Most Graphic Designers are making it easy for AI to take their place. Whether it’s by ignoring it, misusing it, or pretending it’s not happening, too many are sle ... Show More
49m 56s