logo
episode-header-image
Oct 2022
3h 33m

#333 – Andrej Karpathy: Tesla AI, Self-D...

LEX FRIDMAN
About this episode

Andrej Karpathy is a legendary AI researcher, engineer, and educator. He’s the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford. Please support this podcast by checking out our sponsors:
Eight Sleep: https://www.eightsleep.com/lex to get special savings
BetterHelp: https://betterhelp.com/lex to get 10% off
Fundrise: https://fundrise.com/lex
Athletic Greens: https://athleticgreens.com/lex to get 1 month of fish oil

EPISODE LINKS:
Andrej’s Twitter: http://twitter.com/karpathy
Andrej’s YouTube: http://youtube.com/c/AndrejKarpathy
Andrej’s Website: http://karpathy.ai
Andrej’s Google Scholar: http://scholar.google.com/citations?user=l8WuQJgAAAAJ
Books mentioned:
The Vital Question: https://amzn.to/3q0vN6q
Life Ascending: https://amzn.to/3wKIsOE
The Selfish Gene: https://amzn.to/3TCo63s
Contact: https://amzn.to/3W3y5Au
The Cell: https://amzn.to/3W5f6pa

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(05:41) – Neural networks
(10:45) – Biology
(16:15) – Aliens
(26:27) – Universe
(38:18) – Transformers
(46:34) – Language models
(56:45) – Bots
(1:03:05) – Google’s LaMDA
(1:10:28) – Software 2.0
(1:21:28) – Human annotation
(1:23:25) – Camera vision
(1:28:30) – Tesla’s Data Engine
(1:32:39) – Tesla Vision
(1:39:09) – Elon Musk
(1:44:17) – Autonomous driving
(1:49:11) – Leaving Tesla
(1:54:39) – Tesla’s Optimus
(2:03:45) – ImageNet
(2:06:23) – Data
(2:16:15) – Day in the life
(2:29:31) – Best IDE
(2:36:37) – arXiv
(2:41:06) – Advice for beginners
(2:50:24) – Artificial general intelligence
(3:03:44) – Movies
(3:09:37) – Future of human civilization
(3:13:56) – Book recommendations
(3:20:05) – Advice for young people
(3:21:56) – Future of machine learning
(3:28:44) – Meaning of life

Up next
Jun 26
#473 – Iran War Debate: Nuclear Weapons, Trump, Peace, Power & the Middle East
Debate on Iran war between Scott Horton and Mark Dubowitz. Scott Horton is the author and director of the Libertarian Institute, editorial director of Antiwar.com, host of The Scott Horton Show, and for the past three decades, a staunch critic of U.S. foreign policy and military ... Show More
4h 11m
Jun 15
#472 – Terence Tao: Hardest Problems in Mathematics, Physics & the Future of AI
Terence Tao is widely considered to be one of the greatest mathematicians in history. He won the Fields Medal and the Breakthrough Prize in Mathematics, and has contributed to a wide range of fields from fluid dynamics with Navier-Stokes equations to mathematical physics & quantu ... Show More
3h 23m
Jun 5
#471 – Sundar Pichai: CEO of Google and Alphabet
Sundar Pichai is CEO of Google and Alphabet. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep471-sc See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc. Transcript: https://lexfridman.com/sundar-pichai ... Show More
2h 17m
Recommended Episodes
Apr 2024
The Rise and Dangers of Speech A.I.
Episode 3: Are you ready for speech A.I.? Because it’s here, not in 6 months or a year, but now. AI-generated voice technologies will have a major impact on many things in our daily lives. This technology will effect everything spanning applications in language learning, music cr ... Show More
38m 23s
Apr 2024
The Alef Model A and the future of flying cars with Alef CEO Jim Dukhovny | E1929
This Week in Startups is brought to you by… Vanta. Compliance and security shouldn't be a deal-breaker for startups to win new business. Vanta makes it easy for companies to get a SOC 2 report fast. TWiST listeners can get $1,000 off for a limited time at http://www.vanta.com ... Show More
47m 49s
Jun 2024
E99 - Billy Carson: Uncovering the Lost Wisdom of Our Ancient Past
Billy Carson, a renowned researcher and author joins the podcast this week for a deep dive into his findings around ancient civilizations, alien encounters, and awakening a golden age .  Billy unpacks the illusion of reality and the hidden truths that lie beyond the veil of the t ... Show More
2h 19m
Jun 2024
20 Years, 1000 Episodes: The Man Behind PodQuiz
We have another bonus episode! In this one, Andrew sits down and talks with James Carter from PodQuiz who began his popular trivia podcast back in 2005. He just published his 1000th episode so Andrew took the opportunity to pick his brain on how he comes up with his questions and ... Show More
59m 30s
Feb 2024
Justin Drake & Ben Fisch: The United Rollups of Ethereum
In today’s episode, we do a shared sequencing deep dive with repeat guest, Mr. Moonmath himself, the Blockchain Brainiac, and the Ethereum Evangelist– Justin "The Juggernaut" Drake. Justin is joined by The Sultan of Sequencing, the Espresso Emperor, the Cross-Rollup Connoisseur h ... Show More
1h 40m
Jun 2024
Will We Even Recognize Society & Relationships in 20 Years? |E35 | I Wish You Knew Podcast
🎙️ Welcome to the latest episode of "I Wish You Knew" with Adam Lane Smith, the attachment specialist, Andrey Korikov, CEO and co-founder of Veritas Creative Media, and special guest Markku Wilenius, renowned futurist, award-winning author, professor, and speaker with more than ... Show More
1h 19m
Mar 2024
Linux Kernel Scheduler Developer | David Vernet
The linux kernel is something we all use but have you ever thought about what goes into it, well today we've got David Vernet on the show who has spent quite a bit of time focusing on one aspect, that being the scheduler. =========Guest Links========== Twitch: https://www.twi ... Show More
1h 55m
Jun 2024
Who Are You Afraid To Be? (& Why You Will Become Him) |E33 | I Wish You Knew Podcast
🎙️ Welcome to the latest episode of "I Wish You Knew" with Adam Lane Smith, the attachment specialist, Andrey Korikov, CEO and co-founder of Veritas Creative Media, and special guest Connor Beaton, featuring insightful discussions on men's psychological development and self-impr ... Show More
1h 7m
Jun 2024
#397 - Yann Le Cun - Chief AI Scientist chez Meta - L'Intelligence Artificielle Générale ne viendra pas de Chat GPT
 L’IA en chatbot (LLM), c’est (déjà) le passé.  Yann Le Cun, scientifique en chef et fondateur du pôle IA chez Meta est l’une des divinités de l’IA au même titre que Sam Altman, Laurent Alexandre et compagnie. Une question l’anime : quel est le mystère de l’intelligence ? Considé ... Show More
1h 52m
Feb 2024
E167: Nvidia smashes earnings (again), Google's Woke AI disaster, Groq's LPU breakthrough & more
(0:00) Bestie intros: Banana boat! (2:34) Nvidia smashes expectations again: understanding its terminal value and bull/bear cases in the context of the history of the internet (27:26) Groq's big week, training vs. inference, LPUs vs. GPUs, how to succeed in deep tech (49:37) Goog ... Show More
1h 20m