logo
episode-header-image
Oct 2025
9m 18s

Transformers: The Discovery That Sparked...

Y Combinator
About this episode

Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.

Up next
Yesterday
Alexandr Wang: “This is a Once-in-a-Civilization Opportunity”
Alexandr Wang's advice to his 18-year-old self: develop your own internal compass for how the future will unfold, and hold conviction in it against the noise. At Startup School 2026, the Scale AI (YC S16) founder — now leading Meta's Superintelligence Labs — talks with Garry Tan ... Show More
32m 9s
Jul 29
Blake Scholl: Breaking the Supersonic Ban
In 1969, we landed on the moon and flew Concorde. Half a century later, we could do neither.Blake Scholl founded Boom Supersonic (YC W16), the startup building America’s first supersonic airliner, to change that. At Startup School 2026, he shares how a cardboard mockup with Offic ... Show More
50m 1s
Jul 28
Sam Altman: "Never a Better Time to Do a Startup"
In 2005, Sam Altman was a Stanford sophomore in YC’s first batch, building a startup in a little Cambridge office while Paul Graham cooked the founders dinner. Twenty years later, as co-founder & CEO of OpenAI, he closed Startup School 2026 in conversation with YC's Garry Tan — o ... Show More
39 m
Recommended Episodes
Jul 2025
The AI Pioneer Developing New Kinds of Medicine
Jakob Uszkoreit is the CEO and co-founder of Inceptive, a biotech start-up. He’s also a co-author of “Attention is All You Need,” the paper that created transformer models. Today, transformers power chatbots like ChatGPT and Claude. They’ve also led to breakthroughs in everything ... Show More
47 m
Sep 2024
Episode 2 - The ins and outs of AI
AI has reached the stratosphere of innovation and digital transformation. It practically redefined how machines interpret and engage with all types of data inputs. In this episode, Senior Solution Architect and AI expert Kamal Youssef gives a behind-the-scenes perspective on how ... Show More
25m 10s
Jan 2024
AI ChatBots
Join us as we learn about new, groundbreaking AI technology such as OpenAI's ChatGPT. We'll talk about the origin of these technologies, how Large Language Models (LLM) and machine learning work, and how you might use them in your everyday life! 📖  Full Text @ BedtimeHistorySto ... Show More
10m 18s
Feb 2025
AI 101
Everyone’s talking about AI. Everyone says it’s the future. To find out where we’re going, we should know how we got here—and exactly what we’re working with.We hear a short history of AI development before diving into how it’s already changed the ways we learn and code. 
40m 37s
May 2024
Google Eats Rocks + A Win for A.I. Interpretability + Safety Vibe Check
<p>This week, Google found itself in more turmoil, this time over its new AI Overviews feature and a trove of leaked internal documents. Then Josh Batson, a researcher at the A.I. startup Anthropic, joins us to explain how an experiment that made the chatbot Claude obsessed with ... Show More
1h 19m
Oct 2025
Google Part III: The AI Company
Google faces the greatest innovator's dilemma in history. They invented the Transformer — the breakthrough technology powering every modern AI system from ChatGPT to Claude (and, of course, Gemini). They employed nearly all the top AI talent: Ilya Sutskever, Geoff Hinton, Demis H ... Show More
3h 56m
Mar 2024
Why AI is incredibly smart -- and shockingly stupid | Yejin Choi
Computer scientist Yejin Choi is here to demystify the current state of massive artificial intelligence systems like ChatGPT, highlighting three key problems with cutting-edge large language models (including some funny instances of them failing at basic commonsense reasoning.) S ... Show More
18m 13s
Jun 2023
Why AI is incredibly smart -- and shockingly stupid | Yejin Choi
Computer scientist Yejin Choi is here to demystify the current state of massive artificial intelligence systems like ChatGPT, highlighting three key problems with cutting-edge large language models (including some funny instances of them failing at basic commonsense reasoning.) S ... Show More
18m 13s