logo
episode-header-image
Oct 2025
9m 18s

Transformers: The Discovery That Sparked...

Y Combinator
About this episode

Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.

Up next
Sep 13
8 Ways To Improve Your Outbound Sales
The best outbound starts before you automate anything. Founders need to learn who actually has the problem, what gets their attention, and what makes them reply. YC Visiting Partner Christina Gilbert recommends doing at least your first 100 outreaches by hand so you can learn tho ... Show More
12m 41s
Sep 12
Open Models Change The Economics of AI
Ollama (YC W21) is used by 9 million developers and 85% of the Fortune 500, giving co-founder and CEO Jeffrey Morgan a unique view into which AI models people are actually using and how that’s changing.Right now, the biggest shift he sees is toward open models, driven by coding a ... Show More
57m 15s
Sep 5
Paul Graham On Startups, Ambition, and Great Founders
YC Visiting Partner Vivian Shen sits down with Paul Graham at the original YC office in Mountain View to talk about startups, AI, ambition, and what makes great founders. 
21m 24s
Recommended Episodes
Jul 2025
The AI Pioneer Developing New Kinds of Medicine
Jakob Uszkoreit is the CEO and co-founder of Inceptive, a biotech start-up. He’s also a co-author of “Attention is All You Need,” the paper that created transformer models. Today, transformers power chatbots like ChatGPT and Claude. They’ve also led to breakthroughs in everything ... Show More
47 m
Sep 2024
Episode 2 - The ins and outs of AI
AI has reached the stratosphere of innovation and digital transformation. It practically redefined how machines interpret and engage with all types of data inputs. In this episode, Senior Solution Architect and AI expert Kamal Youssef gives a behind-the-scenes perspective on how ... Show More
25m 10s
Jan 2024
AI ChatBots
Join us as we learn about new, groundbreaking AI technology such as OpenAI's ChatGPT. We'll talk about the origin of these technologies, how Large Language Models (LLM) and machine learning work, and how you might use them in your everyday life! 📖  Full Text @ BedtimeHistorySto ... Show More
10m 18s
Feb 2025
AI 101
Everyone’s talking about AI. Everyone says it’s the future. To find out where we’re going, we should know how we got here—and exactly what we’re working with.We hear a short history of AI development before diving into how it’s already changed the ways we learn and code. 
40m 37s
May 2024
Google Eats Rocks + A Win for A.I. Interpretability + Safety Vibe Check
<p>This week, Google found itself in more turmoil, this time over its new AI Overviews feature and a trove of leaked internal documents. Then Josh Batson, a researcher at the A.I. startup Anthropic, joins us to explain how an experiment that made the chatbot Claude obsessed with ... Show More
1h 19m
Oct 2025
Google Part III: The AI Company
Google faces the greatest innovator's dilemma in history. They invented the Transformer — the breakthrough technology powering every modern AI system from ChatGPT to Claude (and, of course, Gemini). They employed nearly all the top AI talent: Ilya Sutskever, Geoff Hinton, Demis H ... Show More
3h 56m
Mar 2024
Why AI is incredibly smart -- and shockingly stupid | Yejin Choi
Computer scientist Yejin Choi is here to demystify the current state of massive artificial intelligence systems like ChatGPT, highlighting three key problems with cutting-edge large language models (including some funny instances of them failing at basic commonsense reasoning.) S ... Show More
18m 13s
Jun 2023
Why AI is incredibly smart -- and shockingly stupid | Yejin Choi
Computer scientist Yejin Choi is here to demystify the current state of massive artificial intelligence systems like ChatGPT, highlighting three key problems with cutting-edge large language models (including some funny instances of them failing at basic commonsense reasoning.) S ... Show More
18m 13s