logo
episode-header-image
Jul 2025
44m 56s

Successfully coding with AI in large ent...

Claire Vo
About this episode

Zach Davis is a product-minded engineering leader and builder at heart, with over 12 years of experience building high‑performing teams and crafting developer tools at companies like Atlassian and LaunchDarkly. In this episode, he shares how he’s helping his 100-plus-person engineering team successfully adopt AI tools by creating centralized documentation, using agents to tackle technical debt, and improving hiring processes—all while maintaining high quality standards in a mature codebase.


What you’ll learn:

1. How to create a centralized rules system that works across multiple AI tools instead of duplicating documentation

2. A systematic approach to using AI agents like Devin and Cursor to analyze and reduce test noise in large codebases

3. How to leverage AI tools to document your codebase more effectively by extracting knowledge from existing sources

4. Why “what’s good for humans is also good for LLMs” should guide your documentation strategy

5. A custom GPT workflow for improving interview feedback quality and coaching interviewers

6. How to approach tech debt reduction with AI by creating prioritized task lists that both humans and AI agents can work from

Brought to you by:

WorkOS—Make your app enterprise-ready today

Lenny’s List on Maven—Hands-on AI education curated by Lenny and Claire

Where to find Zach Davis:

LaunchDarkly: https://www.launchdarkly.com

LinkedIn: https://www.linkedin.com/in/zach-davis-28207195/

Where to find Claire Vo:

ChatPRD: https://www.chatprd.ai/

Website: https://clairevo.com/

LinkedIn: https://www.linkedin.com/in/clairevo/

X: https://x.com/clairevo

In this episode, we cover:

(00:00) Introduction to Zach Davis

(02:44) Overview of AI tools used at LaunchDarkly

(04:00) The importance of having someone responsible for driving AI adoption

(05:44) Why vibe coding isn’t acceptable for enterprise development

(06:42) Making engineers successful with AI on their first attempt

(07:55) Creating centralized documentation for both humans and AI agents

(10:19) Using feature flagging rules to improve AI outputs

(12:33) Advice for getting started with rules

(14:28) Demo: Setting up Devin’s environment in a large codebase

(24:33) Devin’s plan overview

(27:55) Demo: Creating a prioritized tech debt reduction plan

(36:40) Demo: Using AI to improve hiring processes and interview feedback

(40:34) Summary of key approaches for integrating AI into engineering workflows

(42:08) Lightning round and final thoughts

Tools referenced:

• Cursor: https://www.cursor.com/

• Devin: https://devin.ai/

• ChatGPT: https://chat.openai.com/

• Claude: https://claude.ai/

• Windsurf: https://windsurf.com/

• Lovable: https://lovable.dev/

• v0: https://v0.dev/

• ChatPRD: https://www.chatprd.ai/

• Figma: https://www.figma.com/

• GitHub Copilot: https://github.com/features/copilot

Other references:

• Jest: https://jestjs.io/

• Vitest: https://vitest.dev/

• MCP: https://www.anthropic.com/news/model-context-protocol

• Confluence: https://www.atlassian.com/software/confluence

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

Up next
Nov 19
“Farm-to-table software”: How I built a Thanksgiving party hub using Lovable for managing invites, dishes, shared recipes, and photos
<p>In today’s pre-Thanksgiving episode, I walk you through how I vibe coded my very own “Thanksgiving party hub” using Lovable—and how I transformed it from AI-generated slop into something warm, personal, and genuinely useful. I show you exactly how I upleveled the typography, v ... Show More
34m 28s
Nov 17
“Nobody wanted to do this work”: How Emmy Award–winning filmmakers use AI to automate the tedious parts of documentaries
<p><strong>Tim McAleer</strong> is a producer at Ken Burns’s Florentine Films who is responsible for the technology and processes that power their documentary production. Rather than using AI to generate creative content, Tim has built custom AI-powered tools that automate the mo ... Show More
47m 36s
Nov 10
How this CEO turned 25,000 hours of sales calls into a self-learning go-to-market engine | Matt Britton (Suzy)
Matt Britton is the founder and CEO of Suzy, a consumer insights platform that has raised over $100 million in venture capital and works with top brands like Coca-Cola, Google, Procter & Gamble, and Nike. Matt is also the bestselling author of YouthNation, a blueprint for underst ... Show More
42m 53s
Recommended Episodes
Jun 2025
The Lean Product Playbook 10 Years Later: Product Management in the Age of AI
Product management fundamentals are timeless. But the tools? Completely transformed.Every PM needs to master new workflows in 2025:AI Prototyping - From text to live prototype in minutesDesign Collaboration - Working with designers in the AI ageUser Research - Systematic validati ... Show More
1h 19m
Nov 2024
Making Sense of Agentic AI | ThoughtWorks Birgitta Boeckeler
<p>There’s AI agents. There’s AI tooling. Do either drive business impact or are they just more things your dev team is supposed to stay on top of?<br/><br/>Birgitta Boeckeler, Global Lead for AI Assisted Software Delivery at ThoughtWorks, joins the show to discuss the practical ... Show More
47m 40s
Jun 2025
AI PM Crash Course: Prototyping → Observability → Evals + Prompt Engineering vs RAG vs Fine-Tuning
Every PM has to build AI features these days. And with that means a completely new skill set:- AI prototyping- Observability, Akin to Telemetry- AI Evals: The New PRD for AI PMs- RAG v Fine-Tuning v Prompt Engineering- Working with AI EngineersSo, in today’s episode, I bring you ... Show More
2h 4m
Aug 2024
AI in Action: From Machine Learning Interpretability to Cybersecurity with Serg Masís and Nirmal Budhathoki
In this DSS Podcast, Anna Anisin welcomes Serg Masís, Climate and Agronomic Data Scientist at Syngenta. Serg, an expert in machine learning interpretability and responsible AI, shares his diverse background and journey into data science. He discusses the challenges of building fa ... Show More
25m 37s
Sep 19
AI Just Beat the World's Best Coders
AI just scored a historic win in the International Collegiate Programming Contest, with OpenAI’s GPT-5 and Google’s DeepMind outperforming nearly every human team. The discussion focuses on whether this marks a real inflection point for AI, shifting from competition success to th ... Show More
25m 3s
Sep 5
How to Be An AI Leader (According to OpenAI)
OpenAI has published a new leadership guide for executives, laying out five principles — align, activate, amplify, accelerate, and govern — designed to help organizations lead in the age of AI. This episode breaks down the most important lessons, the subtext behind OpenAI’s recom ... Show More
28m 11s
Aug 15
Measuring AI code assistants and agents with the AI Measurement Framework
In this episode of Engineering Enablement, DX CTO Laura Tacho and CEO Abi Noda break down how to measure developer productivity in the age of AI using DX’s AI Measurement Framework. Drawing on research with industry leaders, vendors, and hundreds of organizations, they explain ho ... Show More
41m 14s
Aug 2024
Metrics Driven Development
<p>How do you systematically measure, optimize, and improve the performance of LLM applications (like those powered by RAG or tool use)? Ragas is an open source effort that has been trying to answer this question comprehensively, and they are promoting a “Metrics Driven Developme ... Show More
42m 12s
Apr 2025
Steven Zgaljic, Jahnel Group, CTO: Harnessing AI for Health Insights
RSVP to the 13th CTO Colloquium on 4/17/25In this episode, Steven Zgaljic, CTO of Jahnel Group, joins host Etienne de Bruin to share a personal story about his daughter’s health challenges. Faced with the need to meticulously track symptoms and daily activities, Steven leveraged ... Show More
18m 44s
Feb 2025
OpenAI researcher on why soft skills are the future of work | Karina Nguyen (Research at OpenAI, ex-Anthropic)
<p><strong>Karina Nguyen </strong>leads research at OpenAI, where she’s been pivotal in developing groundbreaking products like Canvas, Tasks, and the o1 language model. Before OpenAI, Karina was at Anthropic, where she led post-training and evaluation work for Claude 3 models, c ... Show More
1h 14m