logo
episode-header-image
Jul 2016
30m 2s

Multiple Comparisons and Conversion Opti...

Kyle Polich
About this episode

I'm joined by Chris Stucchio this week to discuss how deliberate or uninformed statistical practitioners can derive spurious and arbitrary results via multiple comparisons. We discuss p-hacking and a variety of other important lessons and tips for proper analysis.

You can enjoy Chris's writing on his blog at chrisstucchio.com and you may also like his recent talk Multiple Comparisons: Make Your Boss Happy with False Positives, Guarenteed.

Up next
Aug 18
Recommender Systems Origin Story
Where did recommender systems come from, and how do we know when they're actually working? In part one of Data Skeptic's three-part Recommender Systems finale, Kyle traces the field from collaborative filtering and the Netflix Prize to matrix factorization and modern approaches, ... Show More
25m 32s
Jul 27
Social Choice for Fair Recommendations
Recommender systems influence nearly every aspect of our digital lives—but what does it mean for those systems to be fair? Robin Burke joins Data Skeptic to discuss the history of recommender systems, the limitations of optimizing purely for accuracy, and how ideas from social ch ... Show More
42m 56s
Jul 2
News Recommendations
News recommendation algorithms influence far more than what stories we click—they can shape our understanding of the world. In this episode, Kyle Polich speaks with Andreea Iana about responsible AI, filter bubbles, multilingual news recommendation, and her open-source NewsRecLib ... Show More
46m 6s
Recommended Episodes
May 2018
#089: Bringing Statistics to Digital Analytics Data with Matt Policastro
<p>Regression. Correlation. Normality. t-tests. Falsities of both the positive <em>and</em> negative varieties. How do these terms and techniques play nicely with digital analytics data? Are they the schoolyard bullies wielded by data scientists, destined to simply run by and kic ... Show More
58m 4s
Jun 2021
481: Performance Marketing Analytics
Kris Tait joins us to discuss the vast world of digital performance marketing and how automation, data, and optimization play an important role. In this episode you will learn: What is performance marketing? [3:29] How can advertisers take advantage of these tactics? [13:04] ... Show More
58m 48s
Aug 2017
081: Data Visualization & How to Freelance Your Passion
In this episode of the SuperDataScience Podcast, I chat with Data Visualisation Designer, Nadieh Bremer. You will hear about the relationship between algorithm and visualization, learn the top data visualization tips, and ways of creating presentable visualizations and how to pre ... Show More
1 h
Jan 2022
FPL Data Analytics: A Conversation with Sertalp B. Çay
<p>We're joined this week by operations research specialist Sertalp B. Çay to discuss and demystify FPL's current data revolution. The sheer amount of data now available for fantasy managers can be intimidating. So, if you're inexperienced with analytics, where should you begin? ... Show More
1h 3m
Feb 2023
Ep. 199: Caribou Potshots, Fake Benjamins, and AI Advocacy
This week, Cal talks about counterfeiting big bills to supplement your ill-gotten tournament winnings, important legislation, opportunistic mounties, and so much more.  Connect with Cal and MeatEater Cal on Instagram and Twitter MeatEater on Instagram, Facebook, Twitter, and Yout ... Show More
25m 57s
Oct 2023
Making Better Decisions, The Sophomore Jinx, & The Illusion of Objectivity with Dr. Richard Nisbett
In this episode we discuss the errors people make in their reasoning and how to correct them, we explain a number of statistical principles to help sharpen your thinking and make you a better decision maker, why every $1 spent on a “scared straight” program creates $400 of cost f ... Show More
50m 34s
Oct 2019
309: Learning Through Competition
A conversation between rival online educators in the data science community about the challenges of creating a worldwide community with millions of students, the trends in data science, and how education can keep up to date. Additional materials: www.superdatascience.com/309 
54m 59s