logo
episode-header-image
Nov 2024
36m 42s

Networks for AB Testing

Kyle Polich
About this episode

In this episode, the data scientist Wentao Su shares his experience in AB testing on social media platforms like LinkedIn and TikTok.

We talk about how network science can enhance AB testing by accounting for complex social interactions, especially in environments where users are both viewers and content creators. These interactions might cause a "spillover effect" meaning a possible influence across experimental groups, which can distort results.

To mitigate this effect, our guest presents heuristics and algorithms they developed ("one-degree label propagation") to allow for good results on big data with minimal running time and so optimize user experience and advertiser performance in social media platforms.

Up next
Aug 18
Recommender Systems Origin Story
Where did recommender systems come from, and how do we know when they're actually working? In part one of Data Skeptic's three-part Recommender Systems finale, Kyle traces the field from collaborative filtering and the Netflix Prize to matrix factorization and modern approaches, ... Show More
25m 32s
Jul 27
Social Choice for Fair Recommendations
Recommender systems influence nearly every aspect of our digital lives—but what does it mean for those systems to be fair? Robin Burke joins Data Skeptic to discuss the history of recommender systems, the limitations of optimizing purely for accuracy, and how ideas from social ch ... Show More
42m 56s
Jul 2
News Recommendations
News recommendation algorithms influence far more than what stories we click—they can shape our understanding of the world. In this episode, Kyle Polich speaks with Andreea Iana about responsible AI, filter bubbles, multilingual news recommendation, and her open-source NewsRecLib ... Show More
46m 6s
Recommended Episodes
Sep 2023
Networking with Technology – The Good, the Bad, and the Ugly
In an era where technology weaves intricate webs of connection, the age-old art of networking is undergoing a digital transformation. Join us in this thought-provoking episode as we delve into the world of networking enhanced by technology. From AI-powered assistants like ChatGPT ... Show More
18m 9s
Apr 2023
The Snowball Effect
<p>Why do some companies become household names, while others flame out? How do certain memes go viral? And why do some social movements take off and spread, while others fizzle? Today on the show, we revisit a favorite 2021 conversation with sociologist <a href="https://www.asc. ... Show More
48m 58s
Jun 2023
Episode 174 - Networking - Net-whiskey-ing
At a networking event, one of our listeners asked us to cover the topic of networking. In this episode, we will share our thoughts on networking and the success stories we’ve experienced from networking in our careers. Panelists: Ryan Burgess - @burgessdryan Jem Young - @JemYoung ... Show More
54m 58s
Mar 2021
The Snowball Effect
<p>Why do some companies become household names, while others flame out? How do certain memes go viral? And why do some social movements take off and spread, while others fizzle? Today on the show, we talk with sociologist <a href="https://www.asc.upenn.edu/people/faculty/damon-c ... Show More
54m 35s
May 2018
Episode 058 - User testing - Even a drunk person can do it
A lot of the work we do impacts the people using the product or application we’ve made and it’s important to understand how our users resonate with the products we create. A great way to better understand what works for a user is by doing user testing. In this episode, we’ll be d ... Show More
47m 3s
Apr 2020
Stay Social While Staying Distant - How to Strengthen Your Network During COVID-19
In this episode, we explore the science of networks and human relationships, uncover how people you’ve never met have a huge impact on your life, and look at how we can respond effectively to the COVID-19 pandemic with our guest David Burkus.See Privacy Policy at https://art19.co ... Show More
53m 6s
Jun 2024
Episode 196 - Breaking the typecast: Growing beyond frontend and backend labels
In this episode of Front End Happy Hour, we dive into the topic of being typecast as a frontend or backend engineer. Is it really a bad thing? Our panel discusses the implications of these labels, how they can limit growth, and share strategies to break free from these constraint ... Show More
51m 16s