logo
episode-header-image
Sep 18
1h 6m

Why experts writing AI evals is creating...

Lenny Rachitsky
About this episode

Brendan Foody is the CEO and co-founder of Mercor, the fastest-growing company in history to go from $1M to $500M in revenue (in just 17 months!). At 22, he is also the youngest American unicorn founder ever. Mercor works with 6 of the Magnificent 7 and all top 5 AI labs to help them hire experts to create evaluations and training data that improve their models. In this conversation, Brendan explains why evals have become the critical bottleneck for AI progress, how he discovered this massive opportunity, and what the future of work might look like in an AI-driven economy.

What you’ll learn:

1. Why evals are becoming the primary bottleneck for AI progress and what this means for AI startups

2. How Mercor grew to $500M revenue in 17 months (fastest in history)

3. Brendan’s meeting with xAI that changed his company’s trajectory

4. Which skills and jobs will remain most valuable as AI continues to advance (hint: jobs with “elastic” demand)

5. Why Brendan believes AGI and superintelligence are not happening anytime soon

6. The three unique core values that drove Mercor’s success

7. How Harvard Lampoon writers are making Claude funnier

Brought to you by:

WorkOS—Modern identity platform for B2B SaaS, free up to 1 million MAUs

Jira Product Discovery—Atlassian’s new prioritization and roadmapping tool built for product teams

Enterpret—Transform customer feedback into product growth

Transcript: https://www.lennysnewsletter.com/p/experts-writing-ai-evals-brendan-foody

My biggest takeaways (for paid newsletter subscribers): https://www.lennysnewsletter.com/i/173303790/my-biggest-takeaways-from-this-conversation

Where to find Brendan Foody:

• X: https://x.com/BrendanFoody

• LinkedIn: https://www.linkedin.com/in/brendan-foody-2995ab10b/

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• X: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

In this episode, we cover:

(00:00) Introduction to Brendan Foody and Mercor

(05:38) The “era of evals”

(09:26) Understanding the AI training landscape

(17:10) The future of work and AI

(25:54) The evolution of labor markets

(29:55) Understanding how AI models are trained

(38:58) Building Mercor

(53:27) Lessons from past ventures

(56:55) The future of AI and model improvement

(01:00:41) His personal use of AI and final thoughts

References: https://www.lennysnewsletter.com/p/experts-writing-ai-evals-brendan-foody

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.

Lenny may be an investor in the companies discussed.



To hear more, visit www.lennysnewsletter.com
Up next
Oct 5
How to find hidden growth opportunities in your product | Albert Cheng (Duolingo, Grammarly, Chess.com)
Albert Cheng has led growth at three of the world’s most successful consumer subscription companies: Duolingo, Grammarly, and Chess.com. A former Google product manager (and serious pianist!), Albert developed a unique approach to finding and scaling growth opportunities through ... Show More
1h 25m
Sep 28
A 4-step framework for building delightful products | Nesrine Changuel (Spotify, Google, Skype)
Nesrine Changuel helped build Spotify, Google Chrome, and Google Meet. Her work has helped her discover the importance of emotional connection in building successful products. At Google, she served as a dedicated “delight PM,” a role specifically focused on making products more d ... Show More
1h 24m
Sep 25
Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar (creators of the #1 eval course)
Hamel Husain and Shreya Shankar teach the world’s most popular course on AI evals and have trained over 2,000 PMs and engineers (including many teams at OpenAI and Anthropic). In this conversation, they demystify the process of developing effective evals, walk through real exampl ... Show More
1h 46m
Recommended Episodes
Dec 2024
Revolutionizing Customer Success with Agency’s Elias Torres
Today on No Priors, Sarah sits down with Elias Torres, CEO and founder of Agency, an AI agent for customer success teams. Elias shares his journey from growing up in Nicaragua to founding several companies, leading engineering at HubSpot, and selling Drift for $1B. He also discus ... Show More
31m 18s
May 2025
Elad Gil: How to Spot a Billion-Dollar Startup Before the Rest of the World
What if the world’s most connected tech investor handed you his mental playbook? Elad Gil, an investor behind Airbnb, Stripe, Coinbase and Anduril, flips conventional wisdom on its head and prioritizes market opportunities over founders. Elad decodes why innovation has clustered ... Show More
1h 38m
Jun 2024
AI Entrepreneur Matthew Berman On The Power of LLMs - "It blows my mind."
Episode 10: Are closed-source or open-source AI models the future of artificial intelligence? Nathan Lands (https://x.com/mreflow) and Matt Wolfe (https://x.com/NathanLands) delve into this question with guest Matthew Berman (https://x.com/MatthewBerman), a serial entrepreneur an ... Show More
53m 42s
Sep 2024
Bringing Trust and Guardrails into Developing Enterprise AI Systems - with Steve Jones of Capgemini
Today’s guest is Steve Jones, Executive Vice President of Data Driven Business & GenAI at Capgemini. Together with Emerj Senior Editor Matthew DeMello, Steve joins us on today’s program to examine the evolving landscape of AI development and the critical need for trust and ethica ... Show More
38m 26s
Sep 15
20VC: Mercor: From $1M to $500M in 17 Months: The Fastest Growing Company in the World | How to Think About Margins and Revenue Sustainability in AI | Why Evaluation Benchmarks in AI are BS Today with Brendan Foody
Brendan Foody is the Co-Founder and CEO @ Mercor, the fastest growing company in history. The company solves talent allocation in the AI economy and they have scaled from $1M to $500M in revenue in just 17 months. With a rumoured new funding round pricing the company at a whoppin ... Show More
1h 1m
Dec 2024
AI Governance and Strategy for Long-Term Impact - with Steven Eliuk of IBM
Today’s guest is Steven Eliuk, VP & CTO for AI, Governance and Data, Product Software Development at IBM. Steven joins Emerj CEO and Head of Research Daniel Faggella on today’s episode to explore the critical barriers organizations face in operationalizing AI. Steven shares insig ... Show More
21m 53s
Jan 2025
How a 160-Year-Old Startup Uses AI: The Heineken Company’s Ronald den Elzen
After trying his luck at the stock market, Ronald den Elzen, pursued a career in technology leadership instead. Today, as the chief technology and digital officer of The Heineken Company, he encourages his team to think about the legacy beverage company as a 160-year-old startup ... Show More
28m 54s
May 2025
Is Every Company Now an AI Company?
The buzz is deafening—every company is now an AI company...or are they? Knownwell CMO Courtney Baker is joined by CEO David DeWolf and Chief Product and Technology Officer Mohan Rao to unpack whether the AI revolution is as widespread as the hype suggests. They explore what it re ... Show More
34m 5s
Sep 23
How Microsoft is Fixing the Biggest AI Agent Problem
Want the guide to create AI Agents? get it here: https://clickhubspot.com/fhc Episode 77: Are we nearing a future where AI agents can autonomously tackle our biggest challenges—while remaining efficient, safe, and truly aligned with human goals? Matt Wolfe (https://x.com/mreflow) ... Show More
30m 8s
Feb 2025
Will AI Replace SaaS? The Future of Software
Episode 46: Can AI transform the landscape of SaaS, or is it poised to become a competitor? Matt Wolfe (https://x.com/mreflow) and Nathan Lands (https://x.com/NathanLands) welcome Dan Shipper (https://x.com/danshipper), the innovative CEO of Every and an expert in the intersectio ... Show More
28m 51s