logo
episode-header-image
Mar 2017
27m 45s

The Thing about A/B tests — To Learn or ...

Product School
About this episode
Not all A/B tests are created equal. The most fundamental distinction is between “To Ship" tests and “To Learn" tests. It may feel like this distinction doesn’t matter, or that you can decide at any point in the project timeline. But if you believe that you’re fooling yourself and wasting your team’s precious time. Anna Marie will go over a brief ... Show More
Up next
Jun 25
Shopify VP of Product on How to Build AI-First Products | Glen Coates | E269
In this episode, Carlos Gonzalez de Villaumbrosia interviews Glen Coates, Vice President of Product at Shopify.Shopify is one of the world’s leading commerce platforms, powering millions of businesses and helping entrepreneurs sell online and offline with ease. Since launching in ... Show More
56m 48s
Jun 4
Warner Music President on Transforming Tech from Cost Center to Revenue Generator | Ariel Bardin | E268
In this episode, Carlos Gonzalez de Villaumbrosia sits down with Ariel Ban, President of Technology at Warner Music Group, live from the ProductCon stage. Warner Music Group, home to some of the world’s most iconic artists, is undergoing a bold transformation under Ariel’s leader ... Show More
26m 2s
May 14
Roblox CPO on 10 Counterintuitive Principles for Building Software Products | Manuel Bronstein | E267
In this episode, Carlos Gonzalez de Villaumbrosia interviews Manuel Bronstein, Chief Product Officer at Roblox. Roblox is not just a video game—it's a platform that enables people to play, create, and build businesses in immersive virtual worlds. With over 85 million daily active ... Show More
55m 35s
Recommended Episodes
Nov 2022
DELF, DALF, TCF, TEF: Quel test de français choisir?
Tu te poses la question de passer ou non un examen en français ou alors tu ne sais pas lequel choisir entre le DELF, DALF, TEF, TCF? Aujourd’hui, je réponds à ces questions:  Dois-tu passer un test ou non? Et comment décider si tu dois passer un test? Si tu veux immigrer ou étudi ... Show More
34m 4s
Feb 2023
#126 Make Your A/B Testing More Effective and Efficient
One of the toughest parts of any data project is experimentation, not just because you need to choose the right testing method to confirm the project’s effectiveness, but because you also need to make sure you are testing the right hypothesis and measuring the right KPIs to ensur ... Show More
50m 53s
Dec 2022
Episode 22: How long should you spend preparing for the GRE? (planning your test prep journey)
Check out StellarGRE: our top-rated self-study program and the world's only empirically-validated GRE test prep system. Use the code "BITES" for 10% off all membership plans. To learn more, go to: https://www.stellargre.com. This is the million-dollar question. Unfortunately, it' ... Show More
10m 43s
Oct 2022
AACessible: Improving AAC Assessment and Trialing
This week, we share the recording of Chris and Rachel’s recent webinar with aaccessible.org in which they answer questions related to AAC assessment, the benefits of a team-based approach to assessment, selecting motivating assessment materials, and more!   Before the interview, ... Show More
1h 5m
Oct 2022
Probabilistic Thinking with James "JD" Long
In this episode, James and Q explore:The ideas of risk and uncertainty.What is "probabilistic thinking" and why is it important for data scientists?The career progression of a data analyst, and what it means to develop statistical acumen.Thinking in terms of distributions, and th ... Show More
1h 17m
Nov 2021
A Culture of Experimentation
How can organizations become more experimental? Julia Dhar, the cofounder and leader of BeSmart, BCG’s behavioral economics and insights initiative, says identify a big problem, start small, and do not overly worry that academics may criticize your experiment. As a bonus, Dhar pr ... Show More
22m 29s
Jun 2023
Throwing away the script on testing
Sofy is a no-code test automation platform for mobile apps. SofySense is their OpenAI-powered AI assistant. See what they’re up to on their blog or check out their open roles.One of the biggest challenges in testing is deciding whether to use mock or live data. Interested in read ... Show More
21m 6s
Jun 2016
Conjoint Analysis: like AB testing, but on steroids
Conjoint analysis is like AB tester, but more bigger more better: instead of testing one or two things, you can test potentially dozens of options. Where might you use something like this? Well, if you wanted to design an entire hotel chain completely from scratch, and to do it i ... Show More
18m 27s
Feb 2020
How to Set Up — and Learn — from Experiments
Stefan Thomke, professor at Harvard Business School, says running experiments can give companies tremendous value, but too often business leaders make decisions based on intuition. While A/B testing on large transaction volumes is common practice at Google, Booking.com, and Netfl ... Show More
23m 51s