logo
episode-header-image
Jan 2021
1h 21m

Trends in Natural Language Processing wi...

Sam Charrington
About this episode

Today we continue the 2020 AI Rewind series, joined by friend of the show Sameer Singh, an Assistant Professor in the Department of Computer Science at UC Irvine. 

We last spoke with Sameer at our Natural Language Processing office hours back at TWIMLfest, and was the perfect person to help us break down 2020 in NLP. Sameer tackles the review in 4 main categories, Massive Language Modeling, Fundamental Problems with Language Models, Practical Vulnerabilities with Language Models, and Evaluation. 

We also explore the impact of GPT-3 and Transformer models, the intersection of vision and language models, and the injection of causal thinking and modeling into language models, and much more.

The complete show notes for this episode can be found at twimlai.com/go/445.

Up next
Aug 19
Genie 3: A New Frontier for World Models with Jack Parker-Holder and Shlomi Fruchter - #743
Today, we're joined by Jack Parker-Holder and Shlomi Fruchter, researchers at Google DeepMind, to discuss the recent release of Genie 3, a model capable of generating “playable” virtual worlds. We dig into the evolution of the Genie project and review the current model’s scaled-u ... Show More
1h 1m
Aug 12
Closing the Loop Between AI Training and Inference with Lin Qiao - #742
In this episode, we're joined by Lin Qiao, CEO and co-founder of Fireworks AI. Drawing on key lessons from her time building PyTorch, Lin shares her perspective on the modern generative AI development lifecycle. She explains why aligning training and inference systems is essentia ... Show More
1h 1m
Jul 29
Context Engineering for Productive AI Agents with Filip Kozera - #741
In this episode, Filip Kozera, founder and CEO of Wordware, explains his approach to building agentic workflows where natural language serves as the new programming interface. Filip breaks down the architecture of these "background agents," explaining how they use a reflection lo ... Show More
46m 1s
Recommended Episodes
Jan 2023
Chat GPT - Podcast Trailer
https://www.solgood.org - Check out our Streaming Service for our full collection of audiobooks, podcasts, short stories, & 10 hour sounds for sleep and relaxation at our website Are you curious about the inner workings of a language model? Want to know how AI is revolutionizing ... Show More
1m 5s
Jul 2023
2451: How LingQ is Expanding Language Horizons With Tech
In today's episode of Tech Talks Daily, we are joined by Mark Kaufmann, the CEO of LingQ, an innovative language-learning app. LingQ has recently made headlines for announcing the addition of Swahili to their extensive catalogue of languages, raising their total to 42 languages o ... Show More
30m 21s
Jul 2023
#130 Mathew Lodge: The Future of Large Language Models in AI
Welcome to episode #130 of Eye on AI with Mathew Lodge. In this episode, we explore the world of reinforcement learning and code generation. Mathew Lodge, the CEO of Diffblue, shares insights into how reinforcement learning fuels generative AI. As we explore the intricacies of re ... Show More
49m 44s
Mar 2020
1140: Learn a New Language quickly With AI-powered Lingvist
I recently read a fascinating story about a particle physicist turned co-founder of an AI-based language learning app called Lingvist and felt compelled to find out more. Mait Müntel was part of the Higgs boson discovery team at CERN, where he was frustrated by being unable to sp ... Show More
23m 33s
Jan 2023
Chatting with ChatGPT: Pros and Cons of Advanced Language AI (Ep. 215)
In this episode, I'll be discussing the capabilities and limitations of ChatGPT, an advanced language AI model. I'll go over its power to understand and respond to natural language, and its applications in tasks such as language translation and text summarization. However, I'll a ... Show More
31m 27s
May 2023
Efficiently Retraining Language Models: How to Level Up Without Breaking the Bank (Ep. 227)
Get ready for an eye-opening episode! 🎙️ In our latest podcast episode, we dive deep into the world of LoRa (Low-Rank Adaptation) for large language models (LLMs). This groundbreaking technique is revolutionizing the way we approach language model training by leveraging low-rank ... Show More
33m 50s
Jun 2021
135. What can we learn about language from computers?
In this episode, you’ll learn about language learning from AI (Artificial Intelligence) linguist and English teacher, Yazzy Ares. In this podcast we’ll talk about the field of NLP (Natural Language Processing) and AI, and the difference between humans and computers when it comes ... Show More
46m 58s
Oct 2012
Can robots be made creative enough to invent their own language?
Luc Steels delivers the 2012 Simonyi lecture and asks can machines be creative enough to invent their own language? Professor Steels talks about some of his recent breakthrough experiments which have seen robots programmed to play language games and come up with novel concepts, w ... Show More
1h 22m