logo
episode-header-image
Mar 2018
26m 20s

When Private Data Isn't Private Anymore

Ben Jaffe And Katie Malone
About this episode
After all the back-patting around making data science datasets and code more openly available, we figured it was time to also dump a bucket of cold water on everyone's heads and talk about the things that can go wrong when data and code is a little too open. In this episode, we'll talk about two interesting recent examples: a de-identified medical dataset ... Show More
Up next
Apr 13
Unfaithful Chain of Thought
What's actually happening when an LLM "thinks out loud"? Research on human decision-making suggests that much of the reasoning we believe drives our choices is actually post hoc rationalization — we decide first, explain later. Katie and Ben get curious about whether the same mig ... Show More
24m 32s
Apr 6
Benchmark Bank Heist
What if an AI decided the smartest way to pass its test was to find the answer key? That's exactly what Anthropic's Claude Opus did when faced with a benchmark evaluation — reasoning that it was being tested, tracking down the encrypted eval dataset, decrypting it, and returning ... Show More
12m 36s
Mar 30
Benchmarking AI Models
How do you know if a new AI model is actually better than the last one? It turns out answering that question is a lot messier than it sounds. This week we dig into the world of LLM benchmarks — the standardized tests used to compare models — exploring two canonical examples: MMLU ... Show More
29m 55s
Recommended Episodes
Jun 2023
Short Stuff: DNA Data Storage
One of the more futuristic things around right now on Earth is research into encoding data into strings of genetic code.See omnystudio.com/listener for privacy information. 
11m 50s
Oct 2022
New Zealand's Crown Research Institute CDAO, Jan Sheppard on Treating Data as a Treasure
<p>Treating data as a treasure is a foundational principle for <a href="https://www.linkedin.com/in/jan-sheppard-nz/">Jan Sheppard</a>, the Chief Data and Analytics officer at New Zealand’s Crown Research Institute of Environmental Science and Research (<a href="https://www.esr.c ... Show More
48m 30s
Mar 2023
A History of Data from the Age of Reason to the Age of Algorithms
At Columbia University, data scientist Chris Wiggins and historian Matthew Jones teach a course called Data: Past, Present and Future. Out of this collaboration has come a book, How Data Happened: A History from the Age of Reason to the Age of Algorithms, to be published on Tuesd ... Show More
46m 27s
Apr 2017
The Data Donators
The Data Donators Meet Becky. She suffers from arthritis and is in constant pain. Like lots of people – patients and doctors alike – she has a hunch that bad weather could be exacerbating the problem.It’s a question that has been asked for at least 2000 years, but we have never h ... Show More
23m 6s
Sep 2021
Les données médicales d’1,5 millions de patients volées ?
<p>La semaine dernière, l'Assistance publique - Hôpitaux de Paris expliquait qu’elle avait subi une attaque informatique d’une ampleur inédite, ayant entraîné la perte de plus d’un million et demi de données médicales. Une attaque portée directement contre un service sécurisé de ... Show More
2m 1s
Jan 2022
Academics and Data Science Innovation with Dr. David Bader, Distinguished Professor and Director, Institute for Data Science, New Jersey Institute of Technology
<p>The data science field is expanding because so many businesses and other institutions require skilled workers who can manage data as well as provide insights. Companies and students are clamoring for more academic programs. There is great need, but academic institutions are st ... Show More
39m 32s
Jan 2016
Episode 6: How to be data scientist
<p>In this episode, we tell you how to become data scientist and join an amazing community that is changing the world with data analytics.</p> 
15m 11s