logo
episode-header-image
Feb 2025
1h 14m

OpenAI researcher on why soft skills are...

Lenny Rachitsky
About this episode

Karina Nguyen leads research at OpenAI, where she’s been pivotal in developing groundbreaking products like Canvas, Tasks, and the o1 language model. Before OpenAI, Karina was at Anthropic, where she led post-training and evaluation work for Claude 3 models, created a document upload feature with 100,000 context windows, and contributed to numerous other innovations. With experience as an engineer at the New York Times and as a designer at Dropbox and Square, Karina has a rare firsthand perspective on the cutting edge of AI and large language models. In our conversation, we discuss:

• How OpenAI builds product

• What people misunderstand about AI model training

• Differences between how OpenAI and Anthropic operate

• The role of synthetic data in model development

• How to build trust between users and AI models

• Why she moved from engineering to research

• Much more

Brought to you by:

Enterpret—Transform customer feedback into product growth

Vanta—Automate compliance. Simplify security

Loom—The easiest screen recorder you’ll ever use

Find the transcript at: https://www.lennysnewsletter.com/p/why-soft-skills-are-the-future-of-work-karina-nguyen

Where to find Karina Nguyen:

• X: https://x.com/karinanguyen_

• LinkedIn: https://www.linkedin.com/in/karinanguyen28

• Website: https://karinanguyen.com/

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• X: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

In this episode, we cover:

(00:00) Introduction to Karina Nguyen

(04:42) Challenges in model training

(08:21) Synthetic data and its importance

(12:38) Creating Canvas

(18:33) Day-to-day operations at OpenAI

(20:28) Writing evaluations

(23:22) Prototyping and product development

(26:57) Building Canvas and Tasks

(33:34) Understanding the job of a researcher

(35:36) The future of AI and its impact on work and education

(42:15) Soft skills in the age of AI

(47:50) AI’s role in creativity and strategy development

(53:34) Comparing Anthropic and OpenAI

(57:11) Innovations and future visions

(01:07:13) The potential of AI agents

(01:11:36) Final thoughts and career advice

Referenced:

• What’s in your stack: The state of tech tools in 2025: https://www.lennysnewsletter.com/p/whats-in-your-stack-the-state-of

• Anthropic: https://www.anthropic.com/

• OpenAI: https://openai.com/

• What is synthetic data—and how can it help you competitively?: https://mitsloan.mit.edu/ideas-made-to-matter/what-synthetic-data-and-how-can-it-help-you-competitively

• GPQA: https://datatunnel.io/glossary/gpqa/

• Canvas: https://openai.com/index/introducing-canvas/

• Barret Zoph on LinkedIn: https://www.linkedin.com/in/barret-zoph-65990543/

• Mira Murati on LinkedIn: https://www.linkedin.com/in/mira-murati-4b39a066/

• JSON Schema: https://json-schema.org/

• Anthropic—100K Context Windows: https://www.anthropic.com/news/100k-context-windows

• Claude 3 Haiku: https://www.anthropic.com/news/claude-3-haiku

• A.I. Chatbots Defeated Doctors at Diagnosing Illness: https://www.nytimes.com/2024/11/17/health/chatgpt-ai-doctors-diagnosis.html

• Cursor: https://www.cursor.com/

• How AI will impact product management: https://www.lennysnewsletter.com/p/how-ai-will-impact-product-management

• Lee Byron on LinkedIn: https://www.linkedin.com/in/lee-byron/

• GraphQL: https://graphql.org/

• Claude in Slack: https://www.anthropic.com/claude-in-slack

• Sam Altman on X: https://x.com/sama

• Jakub Pachocki on LinkedIn: https://www.linkedin.com/in/jakub-pachocki/

• Lennybot: https://www.lennybot.com/

• ElevenLabs: https://elevenlabs.io/

Westworld on Prime Video: https://www.amazon.com/Westworld-Season-1/dp/B01N05UD06

• A conversation with OpenAI’s CPO Kevin Weil, Anthropic’s CPO Mike Krieger, and Sarah Guo: https://www.youtube.com/watch?v=IxkvVZua28k

• Tuple: https://tuple.app/

• How Shopify builds a high-intensity culture | Farhan Thawar (VP and Head of Eng): https://www.lennysnewsletter.com/p/how-shopify-builds-a-high-intensity-culture-farhan-thawar

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.

Lenny may be an investor in the companies discussed.



Get full access to Lenny's Newsletter at www.lennysnewsletter.com/subscribe
Up next
Oct 5
How to find hidden growth opportunities in your product | Albert Cheng (Duolingo, Grammarly, Chess.com)
Albert Cheng has led growth at three of the world’s most successful consumer subscription companies: Duolingo, Grammarly, and Chess.com. A former Google product manager (and serious pianist!), Albert developed a unique approach to finding and scaling growth opportunities through ... Show More
1h 25m
Sep 28
A 4-step framework for building delightful products | Nesrine Changuel (Spotify, Google, Skype)
Nesrine Changuel helped build Spotify, Google Chrome, and Google Meet. Her work has helped her discover the importance of emotional connection in building successful products. At Google, she served as a dedicated “delight PM,” a role specifically focused on making products more d ... Show More
1h 24m
Sep 25
Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar (creators of the #1 eval course)
Hamel Husain and Shreya Shankar teach the world’s most popular course on AI evals and have trained over 2,000 PMs and engineers (including many teams at OpenAI and Anthropic). In this conversation, they demystify the process of developing effective evals, walk through real exampl ... Show More
1h 46m
Recommended Episodes
Nov 2024
Making Sense of Agentic AI | ThoughtWorks Birgitta Boeckeler
There’s AI agents. There’s AI tooling. Do either drive business impact or are they just more things your dev team is supposed to stay on top of? Birgitta Boeckeler, Global Lead for AI Assisted Software Delivery at ThoughtWorks, joins the show to discuss the practical applications ... Show More
47m 40s
Sep 2024
#246 AI and the Future of Art with Kent Keirsey, Founder & CEO at Invoke
AI has rapidly emerged as an incredibly transformative technology, and nowhere has its impact been felt more unexpectedly than in the creative arts. Just a decade ago, few would have predicted that AI would evolve from automating routine tasks to generating paintings, music, and ... Show More
47m 9s
Jul 2024
#229 Inside Meta's Biggest and Best Open-Source AI Model Yet with Thomas Scialom, Co-Creator of Llama3
Meta has been at the absolute edge of the open-source AI ecosystem, and with the recent release of Llama 3.1, they have officially created the largest open-source model to date. So, what's the secret behind the performance gains of Llama 3.1? What will the future of open-source A ... Show More
39m 23s
Mar 2023
How to get and ace an ML Engineer job Inteview! With RJ He (Director of Perception at Zoox) - What's AI Podcast Episode 5
Here's an interview with the Director of Perception at Zoox, Ruijie (RJ) He, with the goal of demystifying what is a good profile to get an ML engineer job and perform at the interviews. We go over many points from the current job market, the screening process, how to prepare ... Show More
26m 13s
Apr 2025
Steven Zgaljic, Jahnel Group, CTO: Harnessing AI for Health Insights
RSVP to the 13th CTO Colloquium on 4/17/25In this episode, Steven Zgaljic, CTO of Jahnel Group, joins host Etienne de Bruin to share a personal story about his daughter’s health challenges. Faced with the need to meticulously track symptoms and daily activities, Steven leveraged ... Show More
18m 44s
Sep 8
#320 The Next Industrial Revolution is Industrial AI | Barbara Humpton, CEO at Siemens USA and Olympia Brikis, Director of Industrial AI at Siemens USA
The manufacturing floor is undergoing a technological revolution with industrial AI at its center. From predictive maintenance to quality control, AI is transforming how products are designed, produced, and maintained. But implementing these technologies isn't just about installi ... Show More
44m 23s
Sep 24
AI's Next Frontier: Privacy-Preserving Neural Networks
Jimmy Secretan, CTO of JustWin, explores the latest innovations in privacy-preserving neural networks, and explains how JustWin is leveraging AI to help small businesses win government contracts. He also explores the future directions of AI, and the impact of AI on user autonomy ... Show More
36m 44s
Sep 17
AI: Copilot or Job Killer? - An Interview With Eliman Dambell
Some CEOs brag about using AI to cut jobs. But there’s another way to see it.In this episode, I sit down with Eliman Dambell, co-founder of Savvio.ai and former London finance director turned crypto analyst. He brings a unique perspective on why “AI should be a copilot, not a rep ... Show More
31m 53s
Sep 23
How Microsoft is Fixing the Biggest AI Agent Problem
Want the guide to create AI Agents? get it here: https://clickhubspot.com/fhc Episode 77: Are we nearing a future where AI agents can autonomously tackle our biggest challenges—while remaining efficient, safe, and truly aligned with human goals? Matt Wolfe (https://x.com/mreflow) ... Show More
30m 8s
Sep 29
941: Is Responsible AI Possible? with Dr. Sarah Bird of Microsoft
Scott heads to Microsoft’s campus for the VS Code Insider Summit to sit down with Dr. Sarah Bird and explore what “Responsible AI” really means for developers. From protecting user privacy to keeping humans in the loop, they dig into how everyday coders can play a role in shaping ... Show More
22m 51s