logo
episode-header-image
Jul 2022
2h 15m

#306 – Oriol Vinyals: Deep Learning and ...

LEX FRIDMAN
About this episode

Oriol Vinyals is the Research Director and Deep Learning Lead at DeepMind. Please support this podcast by checking out our sponsors:
Shopify: https://shopify.com/lex to get 14-day free trial
Weights & Biases: https://lexfridman.com/wnb
Magic Spoon: https://magicspoon.com/lex and use code LEX to get $5 off
Blinkist: https://blinkist.com/lex and use code LEX to get 25% off premium

EPISODE LINKS:
Oriol’s Twitter: https://twitter.com/oriolvinyalsml
Oriol’s publications: https://scholar.google.com/citations?user=NkzyCvUAAAAJ
DeepMind’s Twitter: https://twitter.com/DeepMind
DeepMind’s Instagram: https://instagram.com/deepmind
DeepMind’s Website: https://deepmind.com
Papers:
1. Gato: https://deepmind.com/publications/a-generalist-agent
2. Flamingo: https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model
3. Language Models are Few-Shot Learners: https://arxiv.org/abs/2005.14165
4. Emergent Abilities of Large Language Models: https://arxiv.org/abs/2206.07682
5. Attention Is All You Need: https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(05:18) – AI
(20:14) – Weights
(26:33) – Gato
(1:01:22) – Meta learning
(1:15:21) – Neural networks
(1:37:46) – Emergence
(1:44:30) – AI sentience
(2:08:27) – AGI

Up next
Jun 26
#473 – Iran War Debate: Nuclear Weapons, Trump, Peace, Power & the Middle East
Debate on Iran war between Scott Horton and Mark Dubowitz. Scott Horton is the author and director of the Libertarian Institute, editorial director of Antiwar.com, host of The Scott Horton Show, and for the past three decades, a staunch critic of U.S. foreign policy and military ... Show More
4h 11m
Jun 15
#472 – Terence Tao: Hardest Problems in Mathematics, Physics & the Future of AI
Terence Tao is widely considered to be one of the greatest mathematicians in history. He won the Fields Medal and the Breakthrough Prize in Mathematics, and has contributed to a wide range of fields from fluid dynamics with Navier-Stokes equations to mathematical physics & quantu ... Show More
3h 23m
Jun 5
#471 – Sundar Pichai: CEO of Google and Alphabet
Sundar Pichai is CEO of Google and Alphabet. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep471-sc See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc. Transcript: https://lexfridman.com/sundar-pichai ... Show More
2h 17m
Recommended Episodes
Apr 2024
130 - Laura Gwilliams: The Needles that Unraveled the Brain’s Language and What We Can Learn from Them
Anjie chats with Dr. Laura Gwilliams.  Laura is an assistant professor at Stanford University, jointly appointed between Stanford Psychology, Wu Tsai Neurosciences Institute and Stanford Data Science. Her work is focused on understanding the neural representations and operations ... Show More
40m 52s
Jun 2024
#397 - Yann Le Cun - Chief AI Scientist chez Meta - L'Intelligence Artificielle Générale ne viendra pas de Chat GPT
 L’IA en chatbot (LLM), c’est (déjà) le passé.  Yann Le Cun, scientifique en chef et fondateur du pôle IA chez Meta est l’une des divinités de l’IA au même titre que Sam Altman, Laurent Alexandre et compagnie. Une question l’anime : quel est le mystère de l’intelligence ? Considé ... Show More
1h 52m
Apr 2024
Twitter’s former Head of Product opens up: being fired, meeting Elon, changing stagnant culture, building consumer product, more | Kayvon Beykpour
Kayvon Beykpour was the longest-serving head of product at Twitter and was GM of Twitter’s consumer division until the platform was acquired by Elon Musk. He originally joined Twitter in 2015 through the acquisition of his company, Periscope, the largest live video streaming plat ... Show More
1h 35m
Feb 2024
Inside OpenAI | Logan Kilpatrick (head of developer relations)
Logan Kilpatrick leads developer relations at OpenAI, supporting developers building with the OpenAI API and ChatGPT. He is also on the board of directors at NumFOCUS, the nonprofit organization that supports open source projects like Jupyter, Pandas, NumPy, and more. Before Open ... Show More
1h 8m
May 2024
GPT-4o launches, Glue demo, Ohalo breakthrough, Druck's Argentina bet, did Google kill Perplexity?
(0:00) Bestie Intros: Recapping Phil Hellmuth's birthday weekend (7:38) OpenAI launches GPT-4o: better, faster, cheaper (29:40) Sacks demos Glue: How AI unlocked his Slack killer (40:12) Friedberg walks through his major breakthrough at Ohalo (1:01:35) Stanley Druckenmiller bets ... Show More
1h 41m
Feb 2024
E167: Nvidia smashes earnings (again), Google's Woke AI disaster, Groq's LPU breakthrough & more
(0:00) Bestie intros: Banana boat! (2:34) Nvidia smashes expectations again: understanding its terminal value and bull/bear cases in the context of the history of the internet (27:26) Groq's big week, training vs. inference, LPUs vs. GPUs, how to succeed in deep tech (49:37) Goog ... Show More
1h 20m
Apr 2024
The Rise and Dangers of Speech A.I.
Episode 3: Are you ready for speech A.I.? Because it’s here, not in 6 months or a year, but now. AI-generated voice technologies will have a major impact on many things in our daily lives. This technology will effect everything spanning applications in language learning, music cr ... Show More
38m 23s
Jun 2024
Elon gets paid, Apple's AI pop, OpenAI revenue rip, Macro debate & Inside Trump Fundraiser
(0:00) Bestie intros: bringing up the energy! (8:48) Trump fundraiser recap (23:16) Elon's comp package approved by shareholders (40:12) Apple announces "Apple Intelligence" and ChatGPT deal at WWDC (50:17) OpenAI reportedly hits a $3.4B revenue run rate (1:05:26) Macro debate: S ... Show More
1h 24m
May 2024
LIQUIDITY: Major challenger to OpenAI, xAI, closing on $6B in funding | E1944
This Week in Startups is brought to you by… OpenPhone. Create business phone numbers for you and your team that work through an app on your smartphone or desktop. TWiST listeners can get an extra 20% off any plan for your first 6 months at https://www.openphone.com/twist⁠ NetSuit ... Show More
1h 5m
Jan 2024
Jamie Goulding - How to Find A Mentor: A Guide to Wisdom
Daniel Karim engages in an inspiring conversation with Jamie Goulding, the founder and CEO of BeenThere, on Episode 43 of The Psychology Podcast. Join them as they explore Jamie's transformative journey and delve into the principles that have shaped the innovative landscape of kn ... Show More
2h 20m