logo
episode-header-image
Oct 2022
3h 33m

#333 – Andrej Karpathy: Tesla AI, Self-D...

LEX FRIDMAN
About this episode

Andrej Karpathy is a legendary AI researcher, engineer, and educator. He’s the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford. Please support this podcast by checking out our sponsors:
Eight Sleep: https://www.eightsleep.com/lex to get special savings
BetterHelp: https://betterhelp.com/lex to get 10% off
Fundrise: https://fundrise.com/lex
Athletic Greens: https://athleticgreens.com/lex to get 1 month of fish oil

EPISODE LINKS:
Andrej’s Twitter: http://twitter.com/karpathy
Andrej’s YouTube: http://youtube.com/c/AndrejKarpathy
Andrej’s Website: http://karpathy.ai
Andrej’s Google Scholar: http://scholar.google.com/citations?user=l8WuQJgAAAAJ
Books mentioned:
The Vital Question: https://amzn.to/3q0vN6q
Life Ascending: https://amzn.to/3wKIsOE
The Selfish Gene: https://amzn.to/3TCo63s
Contact: https://amzn.to/3W3y5Au
The Cell: https://amzn.to/3W5f6pa

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00) – Introduction
(05:41) – Neural networks
(10:45) – Biology
(16:15) – Aliens
(26:27) – Universe
(38:18) – Transformers
(46:34) – Language models
(56:45) – Bots
(1:03:05) – Google’s LaMDA
(1:10:28) – Software 2.0
(1:21:28) – Human annotation
(1:23:25) – Camera vision
(1:28:30) – Tesla’s Data Engine
(1:32:39) – Tesla Vision
(1:39:09) – Elon Musk
(1:44:17) – Autonomous driving
(1:49:11) – Leaving Tesla
(1:54:39) – Tesla’s Optimus
(2:03:45) – ImageNet
(2:06:23) – Data
(2:16:15) – Day in the life
(2:29:31) – Best IDE
(2:36:37) – arXiv
(2:41:06) – Advice for beginners
(2:50:24) – Artificial general intelligence
(3:03:44) – Movies
(3:09:37) – Future of human civilization
(3:13:56) – Book recommendations
(3:20:05) – Advice for young people
(3:21:56) – Future of machine learning
(3:28:44) – Meaning of life

Up next
Oct 1
#482 – Pavel Durov: Telegram, Freedom, Censorship, Money, Power & Human Nature
Pavel Durov is the founder and CEO of Telegram. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep482-sc See below for timestamps, transcript, and to give feedback, submit questions, contact Lex, etc. Transcript: https://lexfridman.com/pavel-duro ... Show More
4h 42m
Sep 19
#481 – Norman Ohler: Hitler, Nazis, Drugs, WW2, Blitzkrieg, LSD, MKUltra & CIA
Norman Ohler is a historian and author of "Blitzed: Drugs in the Third Reich," a book that investigates the role of psychoactive drugs, particularly stimulants such as methamphetamine, in the military history of World War II. It is a book that two legendary historians Ian Kershaw ... Show More
4h 31m
Sep 4
#480 – Dave Hone: T-Rex, Dinosaurs, Extinction, Evolution, and Jurassic Park
Dave Hone is a paleontologist, expert on dinosaurs, co-host of the Terrible Lizards podcast, and author of numerous scientific papers and books on the behavior and ecology of dinosaurs. He lectures at Queen Mary University of London on topics of Ecology, Zoology, Biology, and Evo ... Show More
3h 41m
Recommended Episodes
Feb 2024
E167: Nvidia smashes earnings (again), Google's Woke AI disaster, Groq's LPU breakthrough & more
(0:00) Bestie intros: Banana boat! (2:34) Nvidia smashes expectations again: understanding its terminal value and bull/bear cases in the context of the history of the internet (27:26) Groq's big week, training vs. inference, LPUs vs. GPUs, how to succeed in deep tech (49:37) Goog ... Show More
1h 20m
Feb 2024
The Science of Generosity: Why It Makes You Happier and How To Do It Effectively (It Doesn’t Need To Involve Money) | Chris Anderson
New episodes come out every Monday, Wednesday, and Friday for free, with 1-week early access for Wondery+ subscribers. --- How to cultivate a generosity mindset— and make a good thing less boring. Chris Anderson is the curator of TED. He is the author of New York Times bestseller ... Show More
1h 13m
Feb 2024
Google DeepMind C.E.O. Demis Hassabis on the Path From Chatbots to A.G.I.
This week’s episode is a conversation with Demis Hassabis, the head of Google’s artificial intelligence division. We talk about Google’s latest A.I. models, Gemini and Gemma; the existential risks of artificial intelligence; his timelines for artificial general intelligence; and ... Show More
56m 37s
Feb 2024
Elon Musk Speech On Life 2024
Elon Musk Speech On Life 2024 Support this podcast at — https://redcircle.com/tate-therapy/donations Advertising Inquiries: https://redcircle.com/brands Privacy & Opt-Out: https://redcircle.com/privacy 
15m 56s
Feb 2024
Scalar Fields | Energy Healing | Spooky2 Device | Interview with Bradley Johnson
In this episode I was able to pick the brain of a Holistic Frequency Practitioner with 16 years of wireless engineering experience. Bradley Johnson is a wealth of information when it comes to energy healing devices, and I find the topic to be fascinating. I have been using freque ... Show More
58m 8s
Jun 2023
Digital Identity w/ ENS Domains
Always mixing business and education, Khori has major experience managing for-profits and non-profits, with a big love for tech and always being an early adopter. Developing an interest in distributed ledger tech, and being passionate about decentralized inclusion and identity, h ... Show More
1h 17m
Jan 2024
106: Building Blocks of Civilization: How the World Really Works
“Modern economies will always be tied to massive material flows, whether those of ammonia-based fertilizers to feed the still-growing global population; plastics, steel, and cement needed for new tools, machines, structures, and infrastructures; or new inputs required to produce ... Show More
1h 18m
Feb 2024
The Truth About That Voice In Your Head And What They Don’t Tell You About Starting A Podcast
Welcome back to The Journey Podcast! This episode is all about our thought patterns, how setting expectations lead to disappointment, and how hard it is to actually grow a podcast today. Magic Mind https://www.magicmind.com/JANthejourney DISCOUNT CODE THEJOURNEY20 APPLE https://p ... Show More
1h 7m
Feb 2024
Multi-Billionaire’s Journey In India - Leadership, Culture, and Opportunity | Odoo | TRS 386
Check out BeerBiceps SkillHouse's Video Editing Course - https://bbsh.in/bb-launch-yt Use my referral code OFF40 to get a 40% Discount on a standard membership subscription. Follow BeerBiceps SkillHouse's Social Media Handles: YouTube : https://www.youtube.com/channel/UC2-Y36TqZ5 ... Show More
1h 57m
Feb 2024
Reddit’s IPO, Consumer vs. Enterprise AI, and Sam Altman’s New Fund and more! | E1903
This Week in Startups is brought to you by… Northwest Registered Agent. When starting your business, it's important to use a service that will actually help you. Northwest Registered Agent is that service. They'll form your company fast, give you the documents you need to ... Show More
1h 12m