logo
episode-header-image
Sep 18
1h 6m

Why experts writing AI evals is creating...

Lenny Rachitsky
About this episode

Brendan Foody is the CEO and co-founder of Mercor, the fastest-growing company in history to go from $1M to $500M in revenue (in just 17 months!). At 22, he is also the youngest American unicorn founder ever. Mercor works with 6 of the Magnificent 7 and all top 5 AI labs to help them hire experts to create evaluations and training data that improve their models. In this conversation, Brendan explains why evals have become the critical bottleneck for AI progress, how he discovered this massive opportunity, and what the future of work might look like in an AI-driven economy.

What you’ll learn:

1. Why evals are becoming the primary bottleneck for AI progress and what this means for AI startups

2. How Mercor grew to $500M revenue in 17 months (fastest in history)

3. Brendan’s meeting with xAI that changed his company’s trajectory

4. Which skills and jobs will remain most valuable as AI continues to advance (hint: jobs with “elastic” demand)

5. Why Brendan believes AGI and superintelligence are not happening anytime soon

6. The three unique core values that drove Mercor’s success

7. How Harvard Lampoon writers are making Claude funnier

Brought to you by:

WorkOS—Modern identity platform for B2B SaaS, free up to 1 million MAUs

Jira Product Discovery—Atlassian’s new prioritization and roadmapping tool built for product teams

Enterpret—Transform customer feedback into product growth

Transcript: https://www.lennysnewsletter.com/p/experts-writing-ai-evals-brendan-foody

My biggest takeaways (for paid newsletter subscribers): https://www.lennysnewsletter.com/i/173303790/my-biggest-takeaways-from-this-conversation

Where to find Brendan Foody:

• X: https://x.com/BrendanFoody

• LinkedIn: https://www.linkedin.com/in/brendan-foody-2995ab10b/

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• X: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

In this episode, we cover:

(00:00) Introduction to Brendan Foody and Mercor

(05:38) The “era of evals”

(09:26) Understanding the AI training landscape

(17:10) The future of work and AI

(25:54) The evolution of labor markets

(29:55) Understanding how AI models are trained

(38:58) Building Mercor

(53:27) Lessons from past ventures

(56:55) The future of AI and model improvement

(01:00:41) His personal use of AI and final thoughts

References: https://www.lennysnewsletter.com/p/experts-writing-ai-evals-brendan-foody

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.

Lenny may be an investor in the companies discussed.



To hear more, visit www.lennysnewsletter.com
Up next
Nov 20
Slack founder: Mental models for building products people love ft. Stewart Butterfield
<p><strong>Stewart Butterfield</strong> is the co-founder of Slack and Flickr, two of the most influential products in internet history. After selling Slack to Salesforce in one of tech’s biggest acquisitions, he’s been focused on family, philanthropy, and creative projects. In t ... Show More
1h 30m
Nov 16
The Godmother of AI on jobs, robots & why world models are next | Dr. Fei-Fei Li
<p><strong>Dr. Fei-Fei Li </strong>is<strong> </strong>known as the “godmother of AI.” She’s been at the center of AI’s biggest breakthroughs for over two decades. She spearheaded ImageNet, the dataset that sparked the deep-learning revolution we’re living right now, served as Go ... Show More
1h 19m
Nov 13
“Dumbest idea I’ve heard” to $100M ARR: Inside the rise of Gamma | Grant Lee (CEO)
Grant Lee is the co-founder of Gamma, the AI-powered presentation tool that’s one of the hottest and most interesting AI startups in the world right now. They’re valued at over $2 billion, and they hit $100 million ARR in just over two years, with a lean team of just around 30 pe ... Show More
1h 53m
Recommended Episodes
Dec 2024
Revolutionizing Customer Success with Agency’s Elias Torres
Today on No Priors, Sarah sits down with Elias Torres, CEO and founder of Agency, an AI agent for customer success teams. Elias shares his journey from growing up in Nicaragua to founding several companies, leading engineering at HubSpot, and selling Drift for $1B. He also discus ... Show More
31m 18s
May 2025
Elad Gil: How to Spot a Billion-Dollar Startup Before the Rest of the World
What if the world’s most connected tech investor handed you his mental playbook? Elad Gil, an investor behind Airbnb, Stripe, Coinbase and Anduril, flips conventional wisdom on its head and prioritizes market opportunities over founders. Elad decodes why innovation has clustered ... Show More
1h 36m
Jun 2024
AI Entrepreneur Matthew Berman On The Power of LLMs - "It blows my mind."
Episode 10: Are closed-source or open-source AI models the future of artificial intelligence? Nathan Lands (https://x.com/mreflow) and Matt Wolfe (https://x.com/NathanLands) delve into this question with guest Matthew Berman (https://x.com/MatthewBerman), a serial entrepreneur an ... Show More
52m 42s
Sep 2024
Bringing Trust and Guardrails into Developing Enterprise AI Systems - with Steve Jones of Capgemini
<p>Today's guest is Steve Jones, Executive Vice President of Data Driven Business & GenAI at Capgemini. Together with Emerj Senior Editor Matthew DeMello, Steve joins us on today's program to examine the evolving landscape of AI development and the critical need for trust and eth ... Show More
38m 26s
Nov 11
Inside Harvey AI’s $8 billion AI lawyer app, PLUS How OpenRouter unites the LLMs | E2207
Register for Founder University Japan’s Kickoff! https://luma.com/cm0x90mkToday’s show:Find out why AI is perfectly suited to legal tasks… despite being too fast for “billable hours”On today’s TWiST, Alex takes a deep dive into LLM Law with Harvey AI co-founder/president Gabe Per ... Show More
1h 3m
Sep 15
20VC: Mercor: From $1M to $500M in 17 Months: The Fastest Growing Company in the World | How to Think About Margins and Revenue Sustainability in AI | Why Evaluation Benchmarks in AI are BS Today with Brendan Foody
Brendan Foody is the Co-Founder and CEO @ Mercor, the fastest growing company in history. The company solves talent allocation in the AI economy and they have scaled from $1M to $500M in revenue in just 17 months. With a rumoured new funding round pricing the company at a whoppin ... Show More
1h 1m
Dec 2024
AI Governance and Strategy for Long-Term Impact - with Steven Eliuk of IBM
<p>Today's guest is Steven Eliuk, VP & CTO for AI, Governance and Data, Product Software Development at IBM. Steven joins Emerj CEO and Head of Research Daniel Faggella on today's episode to explore the critical barriers organizations face in operationalizing AI. Steven shares in ... Show More
21m 53s
Jan 2025
How a 160-Year-Old Startup Uses AI: The Heineken Company’s Ronald den Elzen
After trying his luck at the stock market, Ronald den Elzen, pursued a career in technology leadership instead. Today, as the chief technology and digital officer of The Heineken Company, he encourages his team to think about the legacy beverage company as a 160-year-old startup ... Show More
26m 54s
May 2025
Is Every Company Now an AI Company?
<p class="" data-start="172" data-end="246">The buzz is deafening—every company is now an AI company...or are they?</p> <p class="" data-start="248" data-end="596">Knownwell CMO Courtney Baker is joined by CEO David DeWolf and Chief Product and Technology Officer Mohan Rao to unp ... Show More
34m 5s
Sep 23
How Microsoft is Fixing the Biggest AI Agent Problem
Want the guide to create AI Agents? get it here: https://clickhubspot.com/fhc Episode 77: Are we nearing a future where AI agents can autonomously tackle our biggest challenges—while remaining efficient, safe, and truly aligned with human goals? Matt Wolfe (https://x.com/mreflow) ... Show More
30m 8s