logo
episode-header-image
Feb 2023
50m 53s

#126 Make Your A/B Testing More Effectiv...

DATACAMP
About this episode

One of the toughest parts of any data project is experimentation, not just because you need to choose the right testing method to confirm the project’s effectiveness, but because you also need to make sure you are testing the right hypothesis and measuring the right KPIs to ensure you receive accurate results.

One of the most effective methods for data experimentation is A/B testing, and Anjali Mehra, Senior Director of Product Analytics, Data Science, Experimentation, and Instrumentation at DocuSign, is no stranger to how A/B testing can impact multiple parts of any organization. Throughout her career, she has also worked in marketing analytics and customer analytics at companies like Shutterfly, Wayfair, and Constant Contact.

Throughout the episode, we discuss DocuSign’s analytics goals, how A/B testing works, how to gamify data experimentation, how A/B testing helps with new initiative validation, examples of A/B testing with data projects, how organizations can get started with data experimentation, and much more.

Up next
Jul 8
#309 What Science Fiction Can Tell Us About the Future of AI with Ken Liu, Sci-Fi Author
Technology and human consciousness are converging in ways that challenge our fundamental understanding of creativity and connection. As AI systems become increasingly sophisticated at mimicking human thought patterns, we're entering uncharted territory where machines don't just a ... Show More
1h 17m
Jul 3
Industry Roundup #5: AI Agents Hype vs. Reality, Meta’s $15B Stake in Scale AI, and the First Fully AI-Generated NBA Ad
Welcome to DataFramed Industry Roundups! In this series of episodes, we sit down to discuss the latest and greatest in data & AI. In this episode, with special guest, DataCamp COO Martijn, we touch upon the hype and reality of AI agents in business, the McKinsey vs. Ethan Mollick ... Show More
53m 2s
Jun 30
#308 A Framework for GenAI App and Agent Development with Jerry Liu, CEO at LlamaIndex
The enterprise adoption of AI agents is accelerating, but significant challenges remain in making them truly reliable and effective. While coding assistants and customer service agents are already delivering value, more complex document-based workflows require sophisticated archi ... Show More
52m 21s
Recommended Episodes
Nov 2021
A/B Testing in Plain English by eBay Product Manager
Just about anything can be A/B tested, and it can be done by just about anyone. Nicole Lau, Product Manager at eBay, is here with us to explain A/B testing in a simple way so that you can get to using it and running insightful experiments. This episode is brought to you by Though ... Show More
28m 24s
Feb 2020
How to Set Up — and Learn — from Experiments
Stefan Thomke, professor at Harvard Business School, says running experiments can give companies tremendous value, but too often business leaders make decisions based on intuition. While A/B testing on large transaction volumes is common practice at Google, Booking.com, and Netfl ... Show More
23m 51s
Jun 2016
Conjoint Analysis: like AB testing, but on steroids
Conjoint analysis is like AB tester, but more bigger more better: instead of testing one or two things, you can test potentially dozens of options. Where might you use something like this? Well, if you wanted to design an entire hotel chain completely from scratch, and to do it i ... Show More
18m 27s
Sep 2023
Using AI To Land Better Cases? Why Not?
Let’s talk about production and winning cases. It’s not only about acquiring new clients, but also acquiring new clients that can deliver results. A potential breakthrough using Artificial Intelligence, AI.How do we frame, understand, and implement the best of AI’s capabilities? ... Show More
40m 32s
Jun 2023
Throwing away the script on testing
Sofy is a no-code test automation platform for mobile apps. SofySense is their OpenAI-powered AI assistant. See what they’re up to on their blog or check out their open roles.One of the biggest challenges in testing is deciding whether to use mock or live data. Interested in read ... Show More
21m 6s
Jul 2023
ELC 080: Use Data and Analytics to Level Up Your Instructional Design
Do you hear a lot about learning data and analytics, but aren’t sure how to gather data, interpret it, and use it? I think this conversation with Megan Torrance will clarify things for you. In this episode, I give Megan a scenario and she walks through possible ways to collect da ... Show More
33m 28s
May 2022
Analytics Masterclass Part 2: Outcomes, Empathy Action & Profit
In Part II of our Analytics and Data Masterclass, shares his tips for working effectively with your analytics and analysts. Learn how to ask outcome questions rather than questions about marketing activity. These questions will  ensure your focus on the company's most important m ... Show More
17m 20s
Mar 2017
The Thing about A/B tests — To Learn or To Ship: That is the question.
Not all A/B tests are created equal. The most fundamental distinction is between “To Ship" tests and “To Learn" tests. It may feel like this distinction doesn’t matter, or that you can decide at any point in the project timeline. But if you believe that you’re fooling yourself an ... Show More
27m 45s