logo
episode-header-image
Oct 2025
9m 18s

Transformers: The Discovery That Sparked...

Y Combinator
About this episode

Nearly every modern AI model, from ChatGPT and Claude to Gemini and Grok, is built on the same foundation: the Transformer.In this video, YC's Ankit Gupta traces how AI learned to understand language — from early RNNs and LSTMs to attention mechanisms and the breakthrough 2017 paper Attention Is All You Need — the discovery that unlocked the modern AI era.

Up next
Oct 30
What Happens When Everyone Can Build Software
Supabase has become one of the default backends for the AI coding era. The open source Postgres platform now has 13 million users, spins up more than a million databases every week, and roughly 70% of its new activity is coming from agents.As coding shifts from developers writing ... Show More
48m 45s
Oct 28
The New Full-Stack Designer
Marvin Schwaibold leads the product design studio at Shopify, where his team is rethinking some of the company’s most important products for the AI era. Before Shopify, he co-founded the design studio Molly, working with companies including Apple and Google and building a reputat ... Show More
1h 5m
Oct 23
This Is How You Should Actually Make Launch Videos
There’s a misconception that a successful launch video needs to cost tens of thousands of dollars and feel like a high-production commercial. But Farza Majeed has a different approach.Farza is the founder of Clicky and previously built Buildspace, one of the largest online school ... Show More
47m 8s
Recommended Episodes
Jul 2025
The AI Pioneer Developing New Kinds of Medicine
Jakob Uszkoreit is the CEO and co-founder of Inceptive, a biotech start-up. He’s also a co-author of “Attention is All You Need,” the paper that created transformer models. Today, transformers power chatbots like ChatGPT and Claude. They’ve also led to breakthroughs in everything ... Show More
47 m
Sep 2024
Episode 2 - The ins and outs of AI
AI has reached the stratosphere of innovation and digital transformation. It practically redefined how machines interpret and engage with all types of data inputs. In this episode, Senior Solution Architect and AI expert Kamal Youssef gives a behind-the-scenes perspective on how ... Show More
25m 10s
Jan 2024
AI ChatBots
Join us as we learn about new, groundbreaking AI technology such as OpenAI's ChatGPT. We'll talk about the origin of these technologies, how Large Language Models (LLM) and machine learning work, and how you might use them in your everyday life! 📖  Full Text @ BedtimeHistorySto ... Show More
10m 18s
Feb 2025
AI 101
Everyone’s talking about AI. Everyone says it’s the future. To find out where we’re going, we should know how we got here—and exactly what we’re working with.We hear a short history of AI development before diving into how it’s already changed the ways we learn and code. 
40m 37s
May 2024
Google Eats Rocks + A Win for A.I. Interpretability + Safety Vibe Check
<p>This week, Google found itself in more turmoil, this time over its new AI Overviews feature and a trove of leaked internal documents. Then Josh Batson, a researcher at the A.I. startup Anthropic, joins us to explain how an experiment that made the chatbot Claude obsessed with ... Show More
1h 19m
Oct 2025
Google Part III: The AI Company
Google faces the greatest innovator's dilemma in history. They invented the Transformer — the breakthrough technology powering every modern AI system from ChatGPT to Claude (and, of course, Gemini). They employed nearly all the top AI talent: Ilya Sutskever, Geoff Hinton, Demis H ... Show More
3h 56m
Mar 2024
Why AI is incredibly smart -- and shockingly stupid | Yejin Choi
Computer scientist Yejin Choi is here to demystify the current state of massive artificial intelligence systems like ChatGPT, highlighting three key problems with cutting-edge large language models (including some funny instances of them failing at basic commonsense reasoning.) S ... Show More
18m 13s
Jun 2023
Why AI is incredibly smart -- and shockingly stupid | Yejin Choi
Computer scientist Yejin Choi is here to demystify the current state of massive artificial intelligence systems like ChatGPT, highlighting three key problems with cutting-edge large language models (including some funny instances of them failing at basic commonsense reasoning.) S ... Show More
18m 13s