logo
episode-header-image
Mar 2017
27m 45s

The Thing about A/B tests — To Learn or ...

Product School
About this episode
Not all A/B tests are created equal. The most fundamental distinction is between “To Ship" tests and “To Learn" tests. It may feel like this distinction doesn’t matter, or that you can decide at any point in the project timeline. But if you believe that you’re fooling yourself and wasting your team’s precious time. Anna Marie will go over a brief ... Show More
Up next
Yesterday
Twilio CPO on Integrating AI into Product Strategy to Grow Revenue | Inbal Shani | E272
In this episode, Carlos Gonzalez de Villaumbrosia interviews Inbal Shani, Chief Product Officer at Twilio, the $18B customer engagement powerhouse trusted by over 320,000 businesses worldwide.Inbal is a trailblazer in AI-first product development. Before joining Twilio, she led t ... Show More
41m 42s
Aug 20
Grammarly CPO on Product Expansion through Acquisitions | Noam Lovinsky | E271
In this episode, Carlos Gonzalez de Villaumbrosia interviews Noam Lovinsky, Chief Product Officer at Grammarly, the AI-native productivity platform with over 40 million daily active users and $700 million in annual revenue.Grammarly began as a trusted writing assistant, but it’s ... Show More
44m 8s
Jul 16
Gamma Co-Founder on Building Profitable AI-First Products at Scale I 270
Join us for an insightful episode of The Product Podcast with Jon Noronha, Co-founder of Gamma, an AI-first platform revolutionizing how people create presentations, documents, and websites. Starting in 2020 during the height of shelter-in-place, Gamma has achieved remarkable gro ... Show More
38m 23s
Recommended Episodes
Nov 2022
DELF, DALF, TCF, TEF: Quel test de français choisir?
Tu te poses la question de passer ou non un examen en français ou alors tu ne sais pas lequel choisir entre le DELF, DALF, TEF, TCF? Aujourd’hui, je réponds à ces questions:  Dois-tu passer un test ou non? Et comment décider si tu dois passer un test? Si tu veux immigrer ou étudi ... Show More
34m 4s
Feb 2023
#126 Make Your A/B Testing More Effective and Efficient
One of the toughest parts of any data project is experimentation, not just because you need to choose the right testing method to confirm the project’s effectiveness, but because you also need to make sure you are testing the right hypothesis and measuring the right KPIs to ensur ... Show More
50m 53s
Dec 2022
Episode 22: How long should you spend preparing for the GRE? (planning your test prep journey)
Check out StellarGRE: our top-rated self-study program and the world's only empirically-validated GRE test prep system. Use the code "BITES" for 10% off all membership plans. To learn more, go to: https://www.stellargre.com. This is the million-dollar question. Unfortunately, it' ... Show More
10m 43s
Oct 2022
AACessible: Improving AAC Assessment and Trialing
This week, we share the recording of Chris and Rachel’s recent webinar with aaccessible.org in which they answer questions related to AAC assessment, the benefits of a team-based approach to assessment, selecting motivating assessment materials, and more!   Before the interview, ... Show More
1h 5m
Oct 2022
Probabilistic Thinking with James "JD" Long
In this episode, James and Q explore:The ideas of risk and uncertainty.What is "probabilistic thinking" and why is it important for data scientists?The career progression of a data analyst, and what it means to develop statistical acumen.Thinking in terms of distributions, and th ... Show More
1h 17m
Nov 2021
A Culture of Experimentation
How can organizations become more experimental? Julia Dhar, the cofounder and leader of BeSmart, BCG’s behavioral economics and insights initiative, says identify a big problem, start small, and do not overly worry that academics may criticize your experiment. As a bonus, Dhar pr ... Show More
22m 29s
Jun 2023
Throwing away the script on testing
Sofy is a no-code test automation platform for mobile apps. SofySense is their OpenAI-powered AI assistant. See what they’re up to on their blog or check out their open roles.One of the biggest challenges in testing is deciding whether to use mock or live data. Interested in read ... Show More
21m 6s
Jun 2016
Conjoint Analysis: like AB testing, but on steroids
Conjoint analysis is like AB tester, but more bigger more better: instead of testing one or two things, you can test potentially dozens of options. Where might you use something like this? Well, if you wanted to design an entire hotel chain completely from scratch, and to do it i ... Show More
18m 27s
Feb 2020
How to Set Up — and Learn — from Experiments
Stefan Thomke, professor at Harvard Business School, says running experiments can give companies tremendous value, but too often business leaders make decisions based on intuition. While A/B testing on large transaction volumes is common practice at Google, Booking.com, and Netfl ... Show More
23m 51s