logo
episode-header-image
Mar 2025
16m 16s

#105 AI UX is Broken – How Do We Measure...

PATRICIA REINERS
About this episode

In this episode, we’re tackling a huge question: How do we measure a “good” AI experience?

AI is shaping everything—from hiring decisions to medical diagnoses, from content recommendations to self-driving cars. But here’s the issue: we don’t even have clear UX standards for AI.

💡 If we don’t measure UX in AI properly, we risk building products that are functional but untrustworthy, accurate but unethical, powerful but frustrating to use.

We dive into:

〜 Why traditional UX metrics fail in AI-driven products
〜 The Amazon hiring AI scandal—how biased algorithms create bad UX
〜 The problem of explainability—why we often don’t understand AI decisions
〜 The future of AI UX standards—should there be a universal AI UX certification?

📌 Core Question: Can we trust AI to deliver great user experiences if we don’t even know how to measure them?

Let’s explore what’s missing in AI UX—and what needs to change.


Other resources

💻 ✨Waiting list for the AI Academy: 6-week Bootcamp to Learn How to Master AI as a Designer

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Get notified when doors are opening again⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠


👉 0€ AI mini Training for Designers 👈

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Learn 3 strategies to leverage gen AI as a designer in just 30 min⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠


💌 Newsletter

⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Free Weekly UX insights and updates: UX Newsletter⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠


Follow the Future of UX:

🎨 Linkedin: ⁠Future of UX Podcast⁠

📸 Instagram: ⁠Future of UX Podcast⁠

🍏 Apple Podcast: ⁠Future of UX⁠

💚 Spotify: ⁠Future of UX⁠



Find Patricia on Socials

📸 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Instagram @ux.patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎨 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Linkedin Patricia Reiners⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🐦 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Twitter @ux_Patricia⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

📝 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠My UX Design Blog ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠

🎥 ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Youtube ⁠⁠⁠⁠

Up next
Aug 14
#120 The GPT-5 Upgrade: What It Really Means for UX & Product Design
AI as a Designer: 6-week Bootcamp 💻 Enrollment starts Sep 01 ✨ → ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sign up for the ⁠waiting listIn this episode of Future of UX, I share my honest review of the new GPT 5 after testing it intensively for a week.If you have been on LinkedIn, X, or Instagram l ... Show More
14m 51s
Aug 7
#119 5 AI Shifts UX Designers Can’t Ignore
💻 ✨Waiting list for the AI Academy: 6-week Bootcamp to Learn How to Master AI as a Designer. Opening in September.→ ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠Sign up for the waiting listToday, I’m breaking down the five biggest tech shifts from the past month that every designer should understand.T ... Show More
17m 44s
Jul 31
#118 Designing for AI Agents: UX Patterns, Ethics & Tools
In this episode, we're diving into one of the biggest shifts happening in digital product design right now: AI agents.AI agents are no longer just answering questions – they’re planning, making decisions, and acting on behalf of users. This fundamentally changes how we design exp ... Show More
22m 43s
Recommended Episodes
Nov 2024
44. AI & UX Research (feat. Savina Hawkins & Caleb Sponheim)
To explore how is AI shaping UX research and analysis, host Therese Fessenden shares two interviews on the topic; one with Savina Hawkins, Co-founder of Altis, and one with Caleb Sponheim, UX Specialist at NN/g. In this episode we explore the opportunities AI presents for enhanci ... Show More
39m 26s
Jan 2021
6. Ethics in UX (feat. Maria Rosala, UX Specialist at NN/g)
Aren't all "user-centered" designs ethical by default if we're giving people what they want? Not exactly. Maria Rosala, UX Specialist at NN/g, shares her thoughts about how we can be better researchers and designers by asking critical questions about our research and design decis ... Show More
27m 9s
Mar 2025
AI is Taking UX Design Beyond the Screen
🎧 Step into the future of design with me, Katya Boudjelloud, as we explore how AI is transforming UX beyond traditional screens. In this episode of UX AHEAD, we’ll dive into the world of immersive, context-aware experiences — where interfaces blend seamlessly with physical space ... Show More
9m 35s
May 2021
10. On Delight, Emotion, and UX - Flipping the Script with UX Specialists Therese Fessenden & Rachel Krause
To celebrate our first podcast milestone, we flipped the script. NN/g UX Specialist Rachel Krause guest-hosts this episode, and interviews host Therese Fessenden about the concept of "delight" in user experience: what it is, why the pursuit of delight can often be a short-sighted ... Show More
29m 27s
Jun 20
The Lean Product Playbook 10 Years Later: Product Management in the Age of AI
Product management fundamentals are timeless. But the tools? Completely transformed.Every PM needs to master new workflows in 2025:AI Prototyping - From text to live prototype in minutesDesign Collaboration - Working with designers in the AI ageUser Research - Systematic validati ... Show More
1h 19m
Feb 2025
47. Designing AI Experiences: What to Consider (feat. Caleb Sponheim PhD, NN/g)
As AI continues to evolve, designers are increasingly finding themselves tasked with creating AI-powered experiences—often without prior experience in the space. In this episode, NN/g UX Specialist Caleb Sponheim discusses the current state of AI tools, what’s working (and what’s ... Show More
39m 39s
Nov 2024
Making Sense of Agentic AI | ThoughtWorks Birgitta Boeckeler
There’s AI agents. There’s AI tooling. Do either drive business impact or are they just more things your dev team is supposed to stay on top of? Birgitta Boeckeler, Global Lead for AI Assisted Software Delivery at ThoughtWorks, joins the show to discuss the practical applications ... Show More
47m 40s
Jul 2020
Episode 180: AI in UX with Tony Beltramelli
AI is disrupting multiple industries, and UX design is no exception. What if UX designers could leverage AI in their workflow? Our guest today is Tony Beltramelli, CEO and co-founder of Uizard Technologies. You’ll learn how AI powers products and interfaces, along with Tony’s ins ... Show More
21m 52s
Mar 2025
48. What is Object-Oriented UX (feat. Sophia Prater, Rewired UX)
UX practitioners often struggle with shifting requirements and increasing product complexity, making it difficult to design intuitive experiences. Object-Oriented UX (OOUX) offers a structured approach to simplify digital products by focusing on core objects rather than pages or ... Show More
41m 31s
Feb 2024
35. Wireframing & Prototyping (feat. Leon Barnard, Content Manager, Balsamiq)
Wireframing is an incredibly useful design technique to flesh out conceptual ideas and communicate them to others. However, with the advent of powerful prototyping tools, some designers may think of these as irrelevant or outdated practices. Leon Barnard, Content Manager at Balsa ... Show More
37m 11s