logo
episode-header-image
Oct 6
58m 50s

Ultramarathons: Can vitamin D protect yo...

Regina Nuzzo and Kristin Sainani
About this episode

Ultramarathoners push their bodies to the limit, but can a giant pre-race dose of vitamin D really keep their bones from breaking down? In this episode, we dig into a trial that tested this claim – and found  a statistical endurance event of its own: six highly interchangeable papers sliced from one small study.  Expect missing runners, recycled figures, and a peer-review that reads like stand-up comedy, plus a quick lesson in using degrees of freedom as your statistical breadcrumbs.


Statistical topics

  • Data cleaning and validation
  • Degrees of freedom
  • Exploratory vs confirmatory analysis
  • False positives and Type I error
  • Intention-to-treat principle
  • Multiple testing
  • Open data and transparency
  • P-hacking
  • Salami slicing
  • Parametric vs non-parametric tests
  • Peer review quality
  • Randomized controlled trials
  • Research reproducibility
  • Statistical sleuthing

Methodological morals

  • “Degrees of freedom are the breadcrumbs in statistical sleuthing. They reveal the sample size even when the authors do not.”
  • “Publishing the same study again and again with only the outcomes swapped is Mad Libs Science, better known as salami slicing.”


References

Kristin and Regina’s online courses: 

Demystifying Data: A Modern Approach to Statistical Understanding  

Clinical Trials: Design, Strategy, and Analysis 

Medical Statistics Certificate Program  

Writing in the Sciences 

Epidemiology and Clinical Research Graduate Certificate Program 

Programs that we teach in:

Epidemiology and Clinical Research Graduate Certificate Program 


Find us on:

Kristin -  LinkedIn & Twitter/X

Regina - LinkedIn & ReginaNuzzo.com


 00:00 Intro & claim of the episode
 00:44 Runner’s World headline: Vitamin D for ultramarathoners
 02:03 Kristin’s connection to running and vitamin D skepticism
 03:32 Ultramarathon world—Regina’s stories and Death Valley race
 06:29 What ultramarathons do to your bones
 08:02 Boy story: four stress fractures in one race
 10:00 Study design—40 male runners in Poland
 11:33 Missing flow diagram and violated intention-to-treat
 13:02 The intervention: 150,000 IU megadose
 15:09 Blinding details and missing randomization info
 17:13 Measuring bone biomarkers—no primary outcome specified
 19:12 The wrong clinicaltrials.gov registration
 20:35 Discovery of six papers from one dataset (salami slicing)
 23:02 Why salami slicing misleads readers
 25:42 Inconsistent reporting across papers
 29:11 Changing inclusion criteria and sloppy methods
 31:06 Typos, Polish notes, and misnumbered references
 32:39 Peer review comedy gold—“Please define vitamin D”
 36:06 Reviewer laziness and p-hacking admission
 39:13 Results: implausible bone growth mid-race
 41:16 Degrees of freedom sleuthing reveals hidden sample sizes
 47:07 Open data? Kristin emails the authors
 48:42 Lessons from Kristin’s own ultramarathon dataset
 51:22 Fishing expeditions and misuse of parametric tests
 53:07 Strength of evidence: one smooch each
 54:44 Methodologic morals—Mad Libs Science & degrees of freedom breadcrumbs
 56:12 Anyone can spot red flags—trust your eyes
 57:34 Outro: skip the vitamin D shot before your next run 


Up next
Sep 22
P-Values: Are we using a flawed statistical tool?
P-values show up in almost every scientific paper, yet they’re one of the most misunderstood ideas in statistics. In this episode, we break from our usual journal-club format to unpack what a p-value really is, why researchers have fought about it for a century, and how that famo ... Show More
1h 13m
Sep 8
Exercise and Cancer: Does physical activity improve colon cancer survival?
Exercise has long been hailed as cancer-fighting magic, but is there hard evidence behind the hype? In this episode, we tackle the CHALLENGE trial, a large phase III study of colon cancer patients that tested whether prescribed exercise could improve cancer-free survival. We tran ... Show More
49m 4s
Aug 25
Age Gaps: How much does age matter in dating?
Are we all secretly ageist when it comes to dating? We put the stereotype that older men prefer younger women under the microscope using data from thousands of blind dates. What we found surprised us: the “age penalty” was real but microscopic, women wanted younger partners too, ... Show More
49m 42s
Recommended Episodes
Apr 2025
The Science of Conversation and the Art of Being Ourselves | Dr. Alison Wood Brooks
Award-winning behavioral scientist and leading expert on the psychology of conversation Dr. Alison Wood Brooks joins Google to discuss her book, “Talk: The Science of Conversation and the Art of Being Ourselves.” The book reveals the hidden architecture of our conversations, and ... Show More
58m 3s
Oct 2024
Decoding Academia 30: Sadistic Trolls love Dark Humour *Preview*
This is a preview episode to remind those who might be interested that we have a bonus Decoding Academia series, available at the Patreon at the Revolutionary Genius tier and above, which is now up to episode 30! On Decoding Academia we usually focus on specific papers and indulg ... Show More
33m 11s
Apr 2025
Ep 40: Kink, community, and transformation
The massive variety of human sexual interests is a little mind-boggling. As what we consider to be sexually typical continues to be expanded and shaped by the internet and popular culture, psychologists are making efforts to research kinks and members of the kink community like n ... Show More
38m 12s
Jan 2025
145 - Marginalia Episode: Erica Bailey on Authenticity
Marginalia Episode is a collaboration between the Stanford Psychology Podcast and Marginalia Science. Marginalia Science is a community committed to promoting work of scholars who are traditionally underrepresented in academia. Their mission really resonated with our values at th ... Show More
50m 29s
Feb 2025
Episode 370: The Science of Sexual Pleasure
How do you define sexual pleasure? For some people, it simply means orgasm. But orgasm isn’t the only way we derive pleasure from sex! In this episode, we’re going to dive into the many and varied forms of sexual pleasure that exist, common barriers to experiencing pleasure, and ... Show More
40m 3s
Nov 2024
154| Long COVID – A Conversation With Dr. Lucette Cysique
This episode is a conversation with Dr. Lucette Cysique about long COVID. We discuss terminology, symptom profiles, epidemiology, biological mechanisms, psychological and sociocultural factors, overlap with chronic fatigue syndrome, overlap with functional neurological disorder, ... Show More
1h 33m
Apr 2021
Sex + Intimacy | How do you know if you're enjoying sex? w. Dr Sarah Ashton
Hello friends! Today we have a very insightful and important conversation to share with you all. We are delighted to have Dr Sarah Ashton (psychologist, founder + director of SHIPS psychology in Melbourne) on this episode, who answers some of our listener questions around 'H ... Show More
59m 20s
Jul 2018
3 | Alice Dreger on Sexuality, Truth, and Justice
The human mind loves nothing more than to build mental boxes -- categories -- and put things into them, then refuse to accept it when something doesn't fit. Nowhere is this more clear than in the idea that there are men, and there are women, and that's it. Alice Dreger is an hist ... Show More
1h 20m
May 2024
Overthinking About Narcissism
Is it just us, or does American culture have narcissism fever? Between 2004 and 2016, the volume of Google searches for the word “narcissist” grew exponentially. Thanks to factors like the rise of therapyspeak, TikTok mental health diagnoses, and badly behaving reality stars-turn ... Show More
58m 20s
May 2023
Jan Ke-Schutte, "Angloscene: Compromised Personhood in Afro-Chinese Translations" (U California Press, 2023)
Today I had the pleasure of talking to Jay Ke-Schutte on his just released book, Angloscene: Compromised Personhood in Afro-Chinese Translations (U California Press, 2023). Angloscene examines Afro-Chinese interactions within Beijing's aspirationally cosmopolitan student class. J ... Show More
1h 4m