logo
episode-header-image
Apr 2025
29m 10s

The AI adoption playbook: Lessons from M...

DX
About this episode

Brian Houck from Microsoft returns to discuss effective strategies for driving AI adoption among software development teams. Brian shares his insights into why the immense hype around AI often serves as a barrier rather than a facilitator for adoption, citing skepticism and inflated expectations among developers. He highlights the most effective approaches, including leadership advocacy, structured training, and cultivating local champions within teams to demonstrate practical use cases. 

Brian emphasizes the importance of honest communication about AI's capabilities, avoiding over-promises, and ensuring that teams clearly understand what AI tools are best suited for. Additionally, he discusses common pitfalls, such as placing excessive pressure on individuals through leaderboards and unrealistic mandates, and stresses the importance of framing AI as an assistant rather than a replacement for developer skills. Finally, Brian explores the role of data and metrics in adoption efforts, offering practical advice on how to measure usage effectively and sustainably.

Where to find Brian Houck: 

• LinkedIn: https://www.linkedin.com/in/brianhouck/ 

• Website: https://www.microsoft.com/en-us/research/people/bhouck/ 


Where to find Abi Noda:

• LinkedIn: https://www.linkedin.com/in/abinoda 


In this episode, we cover:

(00:00) Intro: Why AI hype can hinder adoption among teams

(01:47) Key strategies companies use to successfully implement AI

(04:47) Understanding why adopting AI tools is uniquely challenging

(07:09) How clear and consistent leadership communication boosts AI adoption

(10:46) The value of team leaders ("local champions") demonstrating practical AI use

(14:26) Practical advice for identifying and empowering team champions

(16:31) Common mistakes companies make when encouraging AI adoption

(19:21) Simple technical reminders and nudges that encourage AI use

(20:24) Effective ways to track and measure AI usage through dashboards

(23:18) Working with team leaders and infrastructure teams to promote AI tools

(24:20) Understanding when to shift from adoption efforts to sustained use

(25:59) Insights into the real-world productivity impact of AI

(27:52) Discussing how AI affects long-term code maintenance

(29:02) Updates on ongoing research linking sleep quality to productivity


Referenced:

Up next
Aug 15
Measuring AI code assistants and agents with the AI Measurement Framework
In this episode of Engineering Enablement, DX CTO Laura Tacho and CEO Abi Noda break down how to measure developer productivity in the age of AI using DX’s AI Measurement Framework. Drawing on research with industry leaders, vendors, and hundreds of organizations, they explain ho ... Show More
41m 14s
Aug 8
How to cut through the hype and measure AI’s real impact (Live from LeadDev London)
In this special episode of the Engineering Enablement podcast, recorded live at LeadDev London, DX CTO Laura Tacho explores the growing gap between AI headlines and the reality inside engineering teams—and what leaders can do to close it.Laura shares data from nearly 39,000 devel ... Show More
23m 26s
Aug 1
Unpacking METR’s findings: Does AI slow developers down?
In this episode of the Engineering Enablement podcast, host Abi Noda is joined by Quentin Anthony, Head of Model Training at Zyphra and a contributor at EleutherAI. Quentin participated in METR’s recent study on AI coding tools, which revealed that developers often slowed down wh ... Show More
43m 45s
Recommended Episodes
Nov 2024
Making Sense of Agentic AI | ThoughtWorks Birgitta Boeckeler
There’s AI agents. There’s AI tooling. Do either drive business impact or are they just more things your dev team is supposed to stay on top of? Birgitta Boeckeler, Global Lead for AI Assisted Software Delivery at ThoughtWorks, joins the show to discuss the practical applications ... Show More
47m 40s
Jun 3
Now is the time to rethink engineering productivity
Are your teams feeling the intense pressure to "produce more" in an era increasingly dominated by AI?Join hosts Ben Lloyd Pearson and Dan Lines as they unpack a major shift in how engineering organizations must now approach productivity. Dan reveals the urgent challenges he hears ... Show More
40m 20s
Oct 2024
Zoom CTO Xuedong "XD" Huang on How AI Revolutionizes Productivity - Ep. 235
Zoom, a company that helped change the way people work during the COVID-19 pandemic, is continuing to reimagine the future of work by transforming itself into an AI-first communications and productivity platform. In this episode of NVIDIA’s AI Podcast, Zoom CTO Xuedong (XD) Huang ... Show More
36m 35s
Jul 2024
38: Are we vastly underestimating AI? with Dwarkesh Patel
A couple hundred people in San Francisco may be on the cusp of inventing artificial general intelligence (AGI). Yet most people are not paying close attention, are skeptical, and are certainly not in the room. Dwarkesh pulls back the curtain so that the broader public can underst ... Show More
53m 26s
Dec 2024
841: Andrew Ng on AI Vision, Agents and Business Value
In this special episode recorded live at ScaleUp:AI in New York, Jon Krohn speaks to Andrew Ng in response to his conference talk on smart agentic AI workflows. Jon follows up with Andrew about smart agentic workflows and when to use them, how businesses should direct their effor ... Show More
26m 21s
Aug 2024
Metrics Driven Development
How do you systematically measure, optimize, and improve the performance of LLM applications (like those powered by RAG or tool use)? Ragas is an open source effort that has been trying to answer this question comprehensively, and they are promoting a “Metrics Driven Development” ... Show More
42m 12s
Aug 3
Where AI Is Right Now: 15 Charts in 15 Minutes
In today’s episode, we take a rapid-fire tour through 15(ish) charts that capture the current state of artificial intelligence across consumer use, enterprise adoption, agents, and infrastructure. From skyrocketing usage metrics and token consumption to the rise of agentic workfl ... Show More
22m 24s
Apr 2024
Measuring The Speed of AI Through Benchmarks
David Kanter, Executive Director at MLCommons, discusses the work they’re doing with MLPerf Benchmarks, creating the world’s first industry standard approach to measuring AI speed and safety. He also shares ways they’re testing AI and LLMs for harm, to measure—and, over time, red ... Show More
31m 45s
Apr 2025
#224 Bret Taylor: A Vision for AI’s Next Frontier
What happens when one of the most legendary minds in tech delves deep into the real workings of modern AI? A 2-hour long masterclass that you don’t want to miss. Bret Taylor, current chairman of OpenAI, unpacks why AI is transforming software engineering forever, how founders can ... Show More
2h 11m
Aug 2024
What You Need to Know About AI to Use it Effectively
Do you need to understand backpropagation, K-means clustering, or hyperparameter tuning to lead an AI transformation in your business? Probably not. So, what should you focus on instead? In this episode, David DeWolf and Mohan Rao explore how to think strategically about AI adopt ... Show More
31m 53s