logo
episode-header-image
Mar 2023
1h 21m

Career frameworks, A/B testing mistakes,...

Lenny Rachitsky
About this episode

Brought to you by Public—Invest in stocks, treasuries, crypto, and more | Eppo—Run reliable, impactful experiments | Writer—Generative AI for the enterprise

Laura Schaffer is the brand-new VP of Growth at Amplitude. Prior to this role, she spent over 10 years leading product management and growth teams at Twilio, Bandwidth, and Rapid. In today’s episode, we talk about the role of experimentation and data in growth, and Laura shares stories of big wins from her time leading growth teams. She explains how customer insights helped her uplevel her career and how she (surprisingly) thinks about qualitative versus quantitative data. We wrap up our conversation by discussing where the best ideas come from and what you need to know if you’re selling to developers.

Find the full transcript here: https://www.lennyspodcast.com/career-frameworks-ab-testing-mistakes-counterintuitive-onboarding-tips-selling-to-developers-laura-schaffer-vp-of-growth-at-amplitude/#transcript

Where to find Laura Schaffer:

• LinkedIn: https://www.linkedin.com/in/lauraschaffer/

Where to find Lenny:

• Newsletter: https://www.lennysnewsletter.com

• Twitter: https://twitter.com/lennysan

• LinkedIn: https://www.linkedin.com/in/lennyrachitsky/

Referenced:

• Elena Verna on Lenny’s Podcast: https://www.lennyspodcast.com/elena-verna-on-how-b2b-growth-is-changing-product-led-growth-product-led-sales-why-you-should-go-freemium-not-trial-what-features-to-make-free-and-much-more/

• Bandwidth: https://www.bandwidth.com/

• Twilio: https://ahoy.twilio.com/

• Jeff Lawson on LinkedIn: https://www.linkedin.com/in/jeffiel/

• The Surprising Power of Online Experiments: https://hbr.org/2017/09/the-surprising-power-of-online-experiments

• Reforge: https://www.reforge.com/

• Online Experimentation at Microsoft: https://ai.stanford.edu/~ronnyk/ExPThinkWeek2009Public.pdf

The Simple Path to Wealth: Your Road Map to Financial Independence and a Rich, Free Life: https://www.amazon.com/Simple-Path-Wealth-financial-independence/dp/1533667926

Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones: https://www.amazon.com/Atomic-Habits-Proven-Build-Break/dp/0735211299/

• James Clear on The Tim Ferriss Show: https://podcasts.apple.com/us/podcast/648-james-clear-atomic-habits-simple-strategies-for/id863897795?i=1000592431628

The Great British Baking Show on PBS: https://www.pbs.org/food/shows/great-british-baking-show/

• Hotjar: https://www.hotjar.com/

• Amplitude: https://amplitude.com/

• Builder: https://www.builder.io/

• ChatGPT: https://chat.openai.com/

• Lenny Bot: https://www.lennybot.com/

• Segment: https://segment.com/

• Senior Growth PM, Monetization, at Amplitude: https://boards.greenhouse.io/amplitude/jobs/6636704002

• Lead Growth PM at Builder: https://boards.greenhouse.io/builder/jobs/4814755004?gh_src=30cfda2d4us

• Growth PM at Rapid: https://jobs.lever.co/rapidapi/8d2611d1-6463-4919-9817-31f61e730831

In this episode, we cover:

(00:00) Laura’s background

(04:15) How to carve your own career path, and an example from Bandwidth

(05:50) Laura’s career growth framework

(10:18) The value of customer insights

(12:25) The “voice of the customer” report

(16:14) Leaning into your strengths

(18:16) The experiment that shifted the way Laura thinks about friction

(20:20) Questions that improved Twilio’s onboarding and conversion rate

(28:53) Thinking about the psyche of your users

(31:26) The hot dog analogy for burying “scary stuff”

(33:58) Why it’s better to be iterative and why experiments fail

(36:21) Saving money by validating fast

(41:58) Where the best ideas come from

(49:51) Experimentation lessons

(52:54) The amount of time a growth team needs to be successful 

(54:43) The big change at Twilio that led to tens of millions of dollars

(58:41) The need for both PLG and enterprise, and how Amplitude plans to tap into PLG

(1:05:42) What it’s like to serve developers

(1:11:16) Lightning round

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com.



Get full access to Lenny's Newsletter at www.lennysnewsletter.com/subscribe
Up next
Yesterday
First interview with Scale AI’s CEO: $14B Meta deal, what’s working in enterprise AI, and what frontier labs are building next | Jason Droege
Jason Droege is the CEO of Scale AI, a company that provides foundational training data to every major AI lab. He previously co-founded Scour with Travis Kalanick and built Uber Eats from idea to $20 billion in revenue. In this conversation, Jason shares lessons from getting sued ... Show More
1h 24m
Oct 5
How to find hidden growth opportunities in your product | Albert Cheng (Duolingo, Grammarly, Chess.com)
Albert Cheng has led growth at three of the world’s most successful consumer subscription companies: Duolingo, Grammarly, and Chess.com. A former Google product manager (and serious pianist!), Albert developed a unique approach to finding and scaling growth opportunities through ... Show More
1h 25m
Sep 28
A 4-step framework for building delightful products | Nesrine Changuel (Spotify, Google, Skype)
Nesrine Changuel helped build Spotify, Google Chrome, and Google Meet. Her work has helped her discover the importance of emotional connection in building successful products. At Google, she served as a dedicated “delight PM,” a role specifically focused on making products more d ... Show More
1h 24m
Recommended Episodes
Feb 2024
Ultra-Niche Positioning: How to Find Success By Going SUPER Narrow
I’m so f*cking happy to announce that ​my book, Stand The F*ck Out, is officially available for PURCHASE​! To buy the book—and more!—DIRECTLY from us and support our small business, go to: https://book.stfo.ioFree Shipping Worldwide • Ripped Apart by 70+ Marketers • Money-Back Gu ... Show More
57m 59s
Feb 2024
Multi-Billionaire’s Journey In India - Leadership, Culture, and Opportunity | Odoo | TRS 386
Check out BeerBiceps SkillHouse's Video Editing Course - https://bbsh.in/bb-launch-yt Use my referral code OFF40 to get a 40% Discount on a standard membership subscription. Follow BeerBiceps SkillHouse's Social Media Handles: YouTube : https://www.youtube.com/channel/UC2-Y36TqZ5 ... Show More
1h 57m
Feb 2024
Microsoft's New Direction with Copilot, Data Management & Retention, Tech Skills Shortage
The Transformation Ground Control podcast covers a number of topics important to digital and business transformation. This episode covers the following topics and interviews: Microsoft’s New Direction with Copilot, Q&A (Darian Chwialkowski, Third Stage Consulting) Data Management ... Show More
1h 54m
Feb 2024
E167: Nvidia smashes earnings (again), Google's Woke AI disaster, Groq's LPU breakthrough & more
(0:00) Bestie intros: Banana boat! (2:34) Nvidia smashes expectations again: understanding its terminal value and bull/bear cases in the context of the history of the internet (27:26) Groq's big week, training vs. inference, LPUs vs. GPUs, how to succeed in deep tech (49:37) Goog ... Show More
1h 20m
Feb 2024
The Single Hardest Entrepreneurial Habit | Ep 677
“You can't have any kind of habitual habits or output if the one thing that starts or ends your day is variable.” Today, Alex (@AlexHormozi) emphasizes the importance of maintaining a stable sleep routine for entrepreneurs to optimize their energy levels, make better judgments, a ... Show More
13m 47s
Feb 2024
Networking Nightmares - Non-Mutual Follow Up • BEP 69
⭐️ Book a 1 to 1 English Session with Rob: https://www.energeticenglish.com/coaching📺 Watch: Networking Nightmares🔗Blog: https://www.thebusinessenglishpodcast.com/blog-ep69Bored of lukewarm networking leads fizzling out? This episode tackles the art of the "non-mutual follow-up ... Show More
20m 37s
Feb 2024
TIP609: Fooled by Randomness by Nassim Taleb
On today’s episode, Clay reviews Nassim Taleb’s book – Fooled by Randomness.Nassim Taleb is a Lebanon-born American mathematician and statistician whose work concerns problems of randomness, probability, and uncertainty. He’s very well known for his popular books, including The B ... Show More
1 h
Oct 2023
10 Digital Transformation Questions for CIOs, Digital Strategy Case Study with the US Army, Inside the ERP Software Cartel
The Transformation Ground Control podcast covers a number of topics important to digital and business transformation. This episode covers the following topics and interviews: 10 Digital Transformation Questions for CIO’s, Q&A Digital Strategy Case Study with the US Army Inside th ... Show More
3h 17m
Feb 2024
Episode 108 - Diving into Amazon Q Builder with Clare Liguori
🚀 Dive into the world of AI with Morgan Willis, Principal Cloud Technologist for AWS, as she interviews Clare Liguori, a Senior Principal Software Engineer at AWS and one of the visionaries behind Amazon Q. Discover the secrets behind this groundbreaking Generative AI conversati ... Show More
48m 6s
Feb 2024
The Science of Generosity: Why It Makes You Happier and How To Do It Effectively (It Doesn’t Need To Involve Money) | Chris Anderson
New episodes come out every Monday, Wednesday, and Friday for free, with 1-week early access for Wondery+ subscribers. --- How to cultivate a generosity mindset— and make a good thing less boring. Chris Anderson is the curator of TED. He is the author of New York Times bestseller ... Show More
1h 13m