logo
episode-header-image
Mar 2023
1h 21m

Career frameworks, A/B testing mistakes,...

Lenny Rachitsky
About this episode

Brought to you by Public—Invest in stocks, treasuries, crypto, and more | Eppo—Run reliable, impactful experiments | Writer—Generative AI for the enterprise

Laura Schaffer is the brand-new VP of Growth at Amplitude. Prior to this role, she spent over 10 years leading product management and growth teams at Twilio, Bandwidth, and Rapid. In today’s episode, we talk about the role of experimentation and data in growth, and Laura shares stories of big wins from her time leading growth teams. She explains how customer insights helped her uplevel her career and how she (surprisingly) thinks about qualitative versus quantitative data. We wrap up our conversation by discussing where the best ideas come from and what you need to know if you’re selling to developers.

Find the full transcript here: https://www.lennysnewsletter.com/p/career-frameworks-ab-testing-counterintuitive

Where to find Laura Schaffer:

• LinkedIn: https://www.linkedin.com/in/lauraschaffer/

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• Twitter: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

Referenced:

• Elena Verna on Lenny’s Podcast: https://www.lennyspodcast.com/elena-verna-on-how-b2b-growth-is-changing-product-led-growth-product-led-sales-why-you-should-go-freemium-not-trial-what-features-to-make-free-and-much-more/

• Bandwidth: https://www.bandwidth.com/

• Twilio: https://ahoy.twilio.com/

• Jeff Lawson on LinkedIn: https://www.linkedin.com/in/jeffiel/

• The Surprising Power of Online Experiments: https://hbr.org/2017/09/the-surprising-power-of-online-experiments

• Reforge: https://www.reforge.com/

• Online Experimentation at Microsoft: https://ai.stanford.edu/~ronnyk/ExPThinkWeek2009Public.pdf

The Simple Path to Wealth: Your Road Map to Financial Independence and a Rich, Free Life: https://www.amazon.com/Simple-Path-Wealth-financial-independence/dp/1533667926

Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones: https://www.amazon.com/Atomic-Habits-Proven-Build-Break/dp/0735211299/

• James Clear on The Tim Ferriss Show: https://podcasts.apple.com/us/podcast/648-james-clear-atomic-habits-simple-strategies-for/id863897795?i=1000592431628

The Great British Baking Show on PBS: https://www.pbs.org/food/shows/great-british-baking-show/

• Hotjar: https://www.hotjar.com/

• Amplitude: https://amplitude.com/

• Builder: https://www.builder.io/

• ChatGPT: https://chat.openai.com/

• Lenny Bot: https://www.lennybot.com/

• Segment: https://segment.com/

• Senior Growth PM, Monetization, at Amplitude: https://boards.greenhouse.io/amplitude/jobs/6636704002

• Lead Growth PM at Builder: https://boards.greenhouse.io/builder/jobs/4814755004?gh_src=30cfda2d4us

• Growth PM at Rapid: https://jobs.lever.co/rapidapi/8d2611d1-6463-4919-9817-31f61e730831

In this episode, we cover:

(00:00) Laura’s background

(04:15) How to carve your own career path, and an example from Bandwidth

(05:50) Laura’s career growth framework

(10:18) The value of customer insights

(12:25) The “voice of the customer” report

(16:14) Leaning into your strengths

(18:16) The experiment that shifted the way Laura thinks about friction

(20:20) Questions that improved Twilio’s onboarding and conversion rate

(28:53) Thinking about the psyche of your users

(31:26) The hot dog analogy for burying “scary stuff”

(33:58) Why it’s better to be iterative and why experiments fail

(36:21) Saving money by validating fast

(41:58) Where the best ideas come from

(49:51) Experimentation lessons

(52:54) The amount of time a growth team needs to be successful 

(54:43) The big change at Twilio that led to tens of millions of dollars

(58:41) The need for both PLG and enterprise, and how Amplitude plans to tap into PLG

(1:05:42) What it’s like to serve developers

(1:11:16) Lightning round

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.



This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.lennysnewsletter.com/subscribe
Up next
Nov 23
A guide to difficult conversations, building high-trust teams, and designing a life you love | Rachel Lockett
<p><strong>Rachel Lockett</strong> is a sought-after executive coach and former HR leader at Stripe and Pinterest who now works with CEOs, founders, and tech leaders on emotional intelligence, resilience, and leadership skills. In this episode, Rachel shares powerful frameworks f ... Show More
1h 45m
Nov 20
Slack founder: Mental models for building products people love ft. Stewart Butterfield
<p><strong>Stewart Butterfield</strong> is the co-founder of Slack and Flickr, two of the most influential products in internet history. After selling Slack to Salesforce in one of tech’s biggest acquisitions, he’s been focused on family, philanthropy, and creative projects. In t ... Show More
1h 30m
Nov 16
The Godmother of AI on jobs, robots & why world models are next | Dr. Fei-Fei Li
<p><strong>Dr. Fei-Fei Li </strong>is<strong> </strong>known as the “godmother of AI.” She’s been at the center of AI’s biggest breakthroughs for over two decades. She spearheaded ImageNet, the dataset that sparked the deep-learning revolution we’re living right now, served as Go ... Show More
1h 19m
Recommended Episodes
Feb 2024
Ultra-Niche Positioning: How to Find Success By Going SUPER Narrow
<p></p><p><strong>I've just launched a </strong><a href="https://www.youtube.com/channel/UCdNXaHHVnVntg5gpveB-5_Q"><strong>new YouTube channel</strong></a><strong>!! The concept? </strong>I take real businesses struggling to stand the f*ck out, provide my positioning/branding/lea ... Show More
58m 5s
Feb 2024
Multi-Billionaire’s Journey In India - Leadership, Culture, and Opportunity | Odoo | TRS 386
Check out BeerBiceps SkillHouse's Video Editing Course - https://bbsh.in/bb-launch-yt Use my referral code OFF40 to get a 40% Discount on a standard membership subscription. Follow BeerBiceps SkillHouse's Social Media Handles: YouTube : https://www.youtube.com/channel/UC2-Y36TqZ5 ... Show More
1h 57m
Feb 2024
Microsoft's New Direction with Copilot, Data Management & Retention, Tech Skills Shortage
<p style="font-weight: 400;">The Transformation Ground Control podcast covers a number of topics important to digital and business transformation. This episode covers the following topics and interviews:</p> <ol><li>Microsoft’s New Direction with Copilot, Q&amp;A (Darian Chwialko ... Show More
1h 54m
Feb 2024
E167: Nvidia smashes earnings (again), Google's Woke AI disaster, Groq's LPU breakthrough & more
(0:00) Bestie intros: Banana boat! (2:34) Nvidia smashes expectations again: understanding its terminal value and bull/bear cases in the context of the history of the internet (27:26) Groq's big week, training vs. inference, LPUs vs. GPUs, how to succeed in deep tech (49:37) Goog ... Show More
1h 20m
Feb 2024
The Single Hardest Entrepreneurial Habit | Ep 677
“You can't have any kind of habitual habits or output if the one thing that starts or ends your day is variable.” Today, Alex (@AlexHormozi) emphasizes the importance of maintaining a stable sleep routine for entrepreneurs to optimize their energy levels, make better judgments, a ... Show More
13m 47s
Feb 2024
Networking Nightmares - Non-Mutual Follow Up • BEP 69
<p>⭐️ Book a 1 to 1 English Session with Rob: <a href='https://www.energeticenglish.com/coaching'>https://www.energeticenglish.com/coaching</a></p><p>📺 Watch: <a href='https://youtu.be/vmjiyf9d3fw'>Networking Nightmares</a></p><p>🔗Blog: <a href='https://www.thebusinessenglishpo ... Show More
20m 37s
Feb 2024
TIP609: Fooled by Randomness by Nassim Taleb
On today’s episode, Clay reviews Nassim Taleb’s book – Fooled by Randomness. Nassim Taleb is a Lebanon-born American mathematician and statistician whose work concerns problems of randomness, probability, and uncertainty. He’s very well known for his popular books, including The ... Show More
1 h
Feb 2024
Episode 108 - Diving into Amazon Q Builder with Clare Liguori
🚀 Dive into the world of AI with Morgan Willis, Principal Cloud Technologist for AWS, as she interviews Clare Liguori, a Senior Principal Software Engineer at AWS and one of the visionaries behind Amazon Q. Discover the secrets behind this groundbreaking Generative AI conversati ... Show More
48m 6s
Feb 2024
The Science of Generosity: Why It Makes You Happier and How To Do It Effectively (It Doesn't Need To Involve Money) | Chris Anderson
<p><em>New episodes come out every Monday, Wednesday, and Friday for free, with 1-week early access for Wondery+ subscribers.</em></p> <p><em>---</em></p> <p><br /></p> <p>How to cultivate a generosity mindset— and make a good thing less boring.</p> <p><br /></p> <p><a href="http ... Show More
1h 13m