logo
episode-header-image
Apr 10
49m 38s

Is Human Data Enough? With David Silver

Hannah Fry
About this episode

In this episode of Google DeepMind: The Podcast, VP of Reinforcement Learning, David Silver, describes his vision for the future of AI, exploring the concept of the "era of experience" versus the current "era of human data". Using AlphaGo and AlphaZero as examples, he highlights how these systems surpassed human capabilities by engaging in reinforcement learning without prior human knowledge. This approach contrasts with large language models, which depend on human data and feedback. Silver emphasizes the need to explore this path to drive AI progress and achieve artificial superintelligence.

Timestamps 

  • 00:00 Introduction
  • 01:50 Era of experience
  • 03:45 AlphaZero
  • 10:19 Move 37
  • 15:20 Reinforcement learning and human feedback
  • 24:30 AlphaProof
  • 29:50 Math Olympiads
  • 35:00 Experience based methods
  • 42:56 Hannah's reflections
  • 44:00 Fan Hui joins

___

Thanks to everyone who made this possible, including but not limited to: 

  • Presenter: Professor Hannah Fry
  • Series Producer: Dan Hardoon
  • Series Editor: Rami Tzabar
  • Commissioner & Producer: Emma Yousif
  • Music Composition: Eleni Shaw
  • Audio Engineer: Richard Courtice
  • Production Manager: Dan Lazard
  • Video Director and Editor: Bernardo Resende
  • Video Studio Production: Nicholas Duke
  • Video Editor: Bilal Merhi
  • Audio Engineer: Perry Rogantin
  • Camera and Lighting Operator: Robert Messere
  • Production Coordination: Zoey Roberts, Sarah Ellen Morton
  • Visual Identity and Design: Rob Ashley
  • Commissioned by Google DeepMind

Please leave us a review on Spotify or Apple Podcasts if you enjoyed this episode. We always want to hear from our audience whether that's in the form of feedback, new idea or a guest recommendation! 

 

Up next
May 22
Redefining Robotics with Carolina Parada
In this episode, Hannah is joined by Carolina Parada, Senior Director and Head of Robotics at Google DeepMind. They explore the recent leap forward in robotic capabilities, highlighting advancements in multimodal understanding and embodied reasoning, which enable robots to intera ... Show More
44m 57s
May 8
AI and the Future of Health with Joelle Barral
In this episode, Professor Hannah Fry interviews Joelle Barral, Senior Director of Research at Google DeepMind, about AI in healthcare. They discuss existing AI applications including image analysis for diabetic retinopathy and the expansion of diagnostic tools as a result of mul ... Show More
36m 32s
Apr 24
Consciousness, Reasoning and the Philosophy of AI with Murray Shanahan
In this episode, Hannah is once again joined by Murray Shanahan, Professor of Cognitive Robotics at Imperial College London and Principal Scientist at Google DeepMind, for a philosophical deep dive on AI. They explore everything from consciousness and metacognition in animals, to ... Show More
40m 30s
Recommended Episodes
Nov 2024
Why You Should Ditch AI // AI Robot Learn Surgery
### Podcast Show Notes: Exploring AI, Productivity, and Autonomous Agents   #### Episode Highlights: 1. **AI Learns to Perform Surgery: The Future of Robotic Healthcare**    - Researchers at Johns Hopkins University have developed a surgical robot capable of learning complex proc ... Show More
14m 49s
Dec 2024
The TED AI Show: How AI robots learn just like babies — but a million times faster w/ NVIDIA’s Rev Lebaredian
Computers have been outperforming humans for years on tasks like solving complex equations or analyzing data, but when it comes to the physical world, robots struggle to keep up. It can take years to train robots to function in the messy chaos of the “real world” — but thanks to ... Show More
53m 27s
Sep 2020
047 – The robots are coming. Are you ready?
A study predicts that all human tasks could be automated in the next 30 years. And that all human jobs might be replaced within the next 100 years or so. Holy crap! What will we do when the robots take over? A.I. is coming. The robots are coming. But are we ready? In this Real En ... Show More
18m 17s
Dec 2024
How AI robots learn just like babies—but a million times faster w/ NVIDIA’s Rev Lebaredian
Computers have been outperforming humans for years on tasks like solving complex equations or analyzing data, but when it comes to the physical world, robots struggle to keep up. It can take years to train robots to function in the messy chaos of the “real world” — but thanks to ... Show More
53m 27s
Mar 2023
Humans vs. Machines with Gary Marcus
From the producers of The World as You’ll Know It, a new series about the perils and promise of artificial intelligence with cognitive scientist, Gary Marcus. For all the progress in artificial intelligence over the last 70 years — computers can now beat people at chess and Go, d ... Show More
3m 33s
May 2017
Robots - More Human than Human?
Robots are becoming present in our lives, as companions, carers and as workers. Adam Rutherford explores our relationship with these machines. Have we made them to be merely more dextrous versions of us? Why do we want to make replicas of ourselves? Should we be worried that they ... Show More
26m 59s
May 10
Star Trek AI Lessons. WhatsApp AI. AI in Medicine. Pet Communication.
The AI news for May 10th, 2025 Here are the details of the day's selected top stories: Analysis: What Star Trek Teaches About Dealing with Artificial Intelligence Source: https://www.heise.de/hintergrund/Analyse-Was-Star-Trek-ueber-den-Umgang-mit-kuenstlicher-Intelligenz-lehrt-10 ... Show More
4m 37s
Nov 2023
Azeem’s Picks: Creating AI Responsibly with Joanna Bryson
Artificial Intelligence (AI) is on every business leader’s agenda. How do you ensure the AI systems you deploy are harmless and trustworthy? This month, Azeem picks some of his favorite conversations with leading AI safety experts to help you break through the noise. Today’s pick ... Show More
31m 40s
May 17
OpenAI whistleblower Daniel Kokotajlo on superintelligence and existential risk of AI
How much could our relationship with technology change by 2027? In the last few years, new artificial intelligence tools like ChatGPT and DeepSeek have transformed how we think about work, creativity, even intelligence itself. But tech experts are ringing alarm bells that powerfu ... Show More
38m 16s
Jan 2025
Not all AI is, well, AI
Artificial intelligence and promises about the tech are everywhere these days. But excitement about genuine advances can easily veer into hype, according to Arvind Narayanan, computer science professor at Princeton who along with PhD candidate Sayash Kapoor wrote the book “AI Sna ... Show More
13m 54s