logo
episode-header-image
Jul 2022
2h 15m

#306 – Oriol Vinyals: Deep Learning and ...

LEX FRIDMAN
About this episode

Oriol Vinyals is the Research Director and Deep Learning Lead at DeepMind. Please support this podcast by checking out our sponsors:
Shopify: https://shopify.com/lex to get 14-day free trial
Weights & Biases: https://lexfridman.com/wnb
Magic Spoon: https://magicspoon.com/lex and use code LEX to get $5 off
Blinkist: https://blinkist.com/lex and use code LEX to get 25% off premium

EPISODE LINKS:
Oriol’s Twitter: https://twitter.com/oriolvinyalsml
Oriol’s publications: https://scholar.google.com/citations?user=NkzyCvUAAAAJ
DeepMind’s Twitter: https://twitter.com/DeepMind
DeepMind’s Instagram: https://instagram.com/deepmind
DeepMind’s Website: https://deepmind.com
Papers:
1. Gato: https://deepmind.com/publications/a-generalist-agent
2. Flamingo: https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model
3. Language Models are Few-Shot Learners: https://arxiv.org/abs/2005.14165
4. Emergent Abilities of Large Language Models: https://arxiv.org/abs/2206.07682
5. Attention Is All You Need: https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(05:18) – AI
(20:14) – Weights
(26:33) – Gato
(1:01:22) – Meta learning
(1:15:21) – Neural networks
(1:37:46) – Emergence
(1:44:30) – AI sentience
(2:08:27) – AGI

Up next
Oct 1
#482 – Pavel Durov: Telegram, Freedom, Censorship, Money, Power & Human Nature
Pavel Durov is the founder and CEO of Telegram. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep482-sc See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc. Transcript: https://lexfridman.com/pavel-duro ... Show More
4h 42m
Sep 19
#481 – Norman Ohler: Hitler, Nazis, Drugs, WW2, Blitzkrieg, LSD, MKUltra & CIA
Norman Ohler is a historian and author of "Blitzed: Drugs in the Third Reich," a book that investigates the role of psychoactive drugs, particularly stimulants such as methamphetamine, in the military history of World War II. It is a book that two legendary historians Ian Kershaw ... Show More
4h 31m
Sep 4
#480 – Dave Hone: T-Rex, Dinosaurs, Extinction, Evolution, and Jurassic Park
Dave Hone is a paleontologist, expert on dinosaurs, co-host of the Terrible Lizards podcast, and author of numerous scientific papers and books on the behavior and ecology of dinosaurs. He lectures at Queen Mary University of London on topics of Ecology, Zoology, Biology, and Evo ... Show More
3h 41m
Recommended Episodes
Apr 2024
130 - Laura Gwilliams: The Needles that Unraveled the Brain’s Language and What We Can Learn from Them
Anjie chats with Dr. Laura Gwilliams.  Laura is an assistant professor at Stanford University, jointly appointed between Stanford Psychology, Wu Tsai Neurosciences Institute and Stanford Data Science. Her work is focused on understanding the neural representations and operations ... Show More
40m 52s
Feb 2024
E167: Nvidia smashes earnings (again), Google's Woke AI disaster, Groq's LPU breakthrough & more
(0:00) Bestie intros: Banana boat! (2:34) Nvidia smashes expectations again: understanding its terminal value and bull/bear cases in the context of the history of the internet (27:26) Groq's big week, training vs. inference, LPUs vs. GPUs, how to succeed in deep tech (49:37) Goog ... Show More
1h 20m
Feb 2024
Google DeepMind C.E.O. Demis Hassabis on the Path From Chatbots to A.G.I.
This week’s episode is a conversation with Demis Hassabis, the head of Google’s artificial intelligence division. We talk about Google’s latest A.I. models, Gemini and Gemma; the existential risks of artificial intelligence; his timelines for artificial general intelligence; and ... Show More
56m 37s
Feb 2024
Reddit’s IPO, Consumer vs. Enterprise AI, and Sam Altman’s New Fund and more! | E1903
This Week in Startups is brought to you by… Northwest Registered Agent. When starting your business, it's important to use a service that will actually help you. Northwest Registered Agent is that service. They'll form your company fast, give you the documents you need to ... Show More
1h 12m
Feb 2024
Reading And Learning From The Stoics | Austin Central Library
On today’s weekend episode of the Daily Stoic podcast, Ryan talks with over 150 employees from Austin Central Library during their staff development and apperception day. They discuss why Ryan became an author, writing process, and the importance of reading and learning from anci ... Show More
31m 44s
Feb 2024
#748 - Rob Henderson - How Privileged Thinking Drives Our Entire Culture
Rob Henderson is a PhD graduate from the University of Cambridge, a US Air Force Veteran and an author.The people who make the rules are not the ones impacted by the rules. Luxury beliefs are ideas and opinions that confer status on the upper class, while often inflicting costs o ... Show More
1h 48m
Feb 2024
Episode 108 - Diving into Amazon Q Builder with Clare Liguori
🚀 Dive into the world of AI with Morgan Willis, Principal Cloud Technologist for AWS, as she interviews Clare Liguori, a Senior Principal Software Engineer at AWS and one of the visionaries behind Amazon Q. Discover the secrets behind this groundbreaking Generative AI conversati ... Show More
48m 6s
Feb 2024
Scalar Fields | Energy Healing | Spooky2 Device | Interview with Bradley Johnson
In this episode I was able to pick the brain of a Holistic Frequency Practitioner with 16 years of wireless engineering experience. Bradley Johnson is a wealth of information when it comes to energy healing devices, and I find the topic to be fascinating. I have been using freque ... Show More
58m 8s
Feb 2024
Empowering Innovation: Oxolo's €13M Funding Boosts AI-Driven Video Platform
Explore the transformative potential of Oxolo's €13M funding round, fueling innovation and pushing the boundaries of AI-driven video technology. Get on the AI Box Waitlist: https://AIBox.ai/ Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠ Follow ... Show More
8m 18s