logo
episode-header-image
Apr 2025
39m 52s

Episode 233 - Generative UI & Fine-Tunin...

Mark and Allen
About this episode

Following up on last week's captivating discussion, Allen Firstenberg and Noble Ackerson dive deeper into the world of Generative UI. Explore real-world examples of its potential pitfalls and discover how Noble is tackling these challenges through innovative approaches.


This episode unveils the power of dynamically adapting user interfaces based on preferences and intent, ultimately aiming for outcome-focused experiences that seamlessly guide users to their goals. Inspired by the insightful quotes from Arthur C. Clarke ("Any sufficiently advanced technology is indistinguishable from magic") and Larry Niven ("Any sufficiently advanced magic is indistinguishable from technology"), we explore how fine-tuning Large Language Models (LLMs) can bridge this gap.


Noble shares a practical demonstration of a smart home dashboard leveraging Generative UI and then delves into the crucial technique of fine-tuning LLMs. Learn why fine-tuning isn't about teaching new knowledge but rather new patterns and vocabulary to better understand domain-specific needs, like rendering accessible and effective visualizations. We demystify the process, discuss essential hyperparameters like learning rate and training epochs, and explore the practicalities of deploying fine-tuned models using tools like Google Cloud Run.


Join us for an insightful conversation that blends cutting-edge AI with practical software engineering principles, revealing how seemingly magical user experiences are built with careful technical considerations.


Timestamps:


0:00:00 Introduction and Recap of Generative UI

0:03:20 Demonstrating Generative UI Pitfalls with a Smart Home Dashboard

0:05:15 Dynamic Adaptation and User Intent

0:11:30 Accessibility and Customization in Generative UI

0:13:30 Encountering Limitations and the Need for Fine-Tuning

0:17:50 Introducing Fine-Tuning for LLMs: Adapting Pre-trained Models

0:19:30 Fine-Tuning for New Patterns and Domain-Specific Understanding

0:20:50 The Role of Training Data in Supervised Fine-Tuning

0:23:30 Generalization of Patterns by LLMs

0:24:20 Exploring Key Fine-Tuning Hyperparameters: Learning Rate and Training Epochs

0:30:30 Demystifying Supervised Fine-Tuning and its Benefits

0:33:30 Saving and Hosting Fine-Tuned Models: Hugging Face and Google Cloud Run

0:36:50 Integrating Fine-Tuned Models into Applications

0:38:50 The Model is Not the Product: Focus on User Value

0:39:40 Closing Remarks and Teasing Future Discussions on Monitoring


Hashtags:


#GenerativeUI #AI #LLM #LargeLanguageModels #FineTuning #MachineLearning #UserInterface #UX #Developers #Programming #SoftwareEngineering #CloudComputing #GoogleCloudRun #GoogleGemini #GoogleGemma #HuggingFace #AIforDevelopers #TechPodcast #TwoVoiceDevs #ArtificialIntelligence #TechMagic

Up next
Jul 31
Episode 250 - Five Years Up, Up, and Away in Voice & AI
Join Mark and Allen for a very special 250th episode as they celebrate five years of Two Voice Devs! You won't want to miss the unique, AI-animated opening that takes them to new heights, or the special closing that brings it all home, both created with the help of Veo 3. In betw ... Show More
36m 14s
Jul 24
Episode 249 - Cracking Copilot and the Mysteries of Microsoft 365
In this episode, guest host Andrew Connell, a Microsoft MVP of 21 years, joins Allen to unravel the complexities of Microsoft's AI strategy, particularly within the enterprise. They explore the world of Microsoft 365 Copilot, distinguishing it from the broader AI landscape and co ... Show More
52m 7s
Jul 17
Episode 248 - AI Showdown: Gemini CLI vs. Claude Code CLI
Join Allen Firstenberg and guest host Isaac Johnson, a Google Developer Expert with a deep background in DevOps and SRE, as they dive into the world of command-line AI assistants. In this episode, they compare and contrast two powerful tools: Anthropic's Claude Code CLI and Googl ... Show More
41m 31s
Recommended Episodes
Nov 2024
Making Sense of Agentic AI | ThoughtWorks Birgitta Boeckeler
There’s AI agents. There’s AI tooling. Do either drive business impact or are they just more things your dev team is supposed to stay on top of? Birgitta Boeckeler, Global Lead for AI Assisted Software Delivery at ThoughtWorks, joins the show to discuss the practical applications ... Show More
47m 40s
Sep 2023
Meta’s Quest 3, AI chatbots and Ray-Ban smart glasses
This week, it’s Meta’s turn to highlight AI during its device event. In this episode, Devindra and Cherlynn dive into all of the news from Meta’s Connect 2023 event, where it unveiled Meta AI and accompanying celebrity-powered chatbots. Oh yah, and it introduced the Meta Quest 3 ... Show More
1h 6m
Sep 2024
Study Reveals Vulnerabilities in Alexa, Siri, and Google Assistant to Malicious Commands
In this episode, we explore a recent study that uncovers how popular voice assistants like Alexa, Siri, and Google Assistant are susceptible to malicious commands. We discuss the potential risks and what users can do to protect their devices. Get on the AI Box Waitlist: ⁠⁠⁠https: ... Show More
6m 17s
Nov 2024
SN 1001: Artificial General Intelligence (AGI) - Gmail Temp Addresses, Russia's Internet Off Switch
How Microsoft lured the US Government into a far deeper and expensive dependency upon its cybersecurity solutions. Gmail to offer native throwaway email aliases like Apple and Mozilla. Russia to ban several additional hosting companies and give its big Internet disconnect switch ... Show More
2h 26m
Sep 2024
AI is more than GenAI
GenAI is often what people think of when someone mentions AI. However, AI is much more. In this episode, Daniel breaks down a history of developments in data science, machine learning, AI, and GenAI in this episode to give listeners a better mental model. Don’t miss this one if y ... Show More
40m 3s
Jul 2019
AWS’ new text-to-speech engine sounds like a newscaster
Thanks to modern machine learning techniques, text-to-speech engines have made massive strides over the last few years. It used to be incredibly easy to know that it was a computer that was reading a text and not a human being. But that’s changing quickly. Amazon’s AWS cloud comp ... Show More
2m 48s
Jan 2021
How Salesforce will make Einstein smarter in 2021
Salesforce launched Einstein, its artificial intelligence tool, in 2016. It was memorable because of the marketing materials, featuring a cute cartoon of the world's most misquoted-scientist. It was also memorable because of the unique capabilities Einsten brought to the table. T ... Show More
27m 46s
May 2021
397: Customer Feedback vs. Team Intuition
This week, we talk about the tension between building what customers explicitly ask for versus building towards a team’s internal vision. In The Sidebar, we talk about the lack of public software critique: Why isn’t there an MKBHD equivalent for software design?Golden Ratio Suppo ... Show More
23m 29s