logo
episode-header-image
Jan 2021
1h 21m

Trends in Natural Language Processing wi...

Sam Charrington
About this episode

Today we continue the 2020 AI Rewind series, joined by friend of the show Sameer Singh, an Assistant Professor in the Department of Computer Science at UC Irvine. 

We last spoke with Sameer at our Natural Language Processing office hours back at TWIMLfest, and was the perfect person to help us break down 2020 in NLP. Sameer tackles the review in 4 main categories, Massive Language Modeling, Fundamental Problems with Language Models, Practical Vulnerabilities with Language Models, and Evaluation. 

We also explore the impact of GPT-3 and Transformer models, the intersection of vision and language models, and the injection of causal thinking and modeling into language models, and much more.

The complete show notes for this episode can be found at twimlai.com/go/445.

Up next
Yesterday
Distilling Transformers and Diffusion Models for Robust Edge Use Cases with Fatih Porikli - #738
Today, we're joined by Fatih Porikli, senior director of technology at Qualcomm AI Research for an in-depth look at several of Qualcomm's accepted papers and demos featured at this year’s CVPR conference. We start with “DiMA: Distilling Multi-modal Large Language Models for Auton ... Show More
1 h
Jun 24
Building the Internet of Agents with Vijoy Pandey - #737
Today, we're joined by Vijoy Pandey, SVP and general manager at Outshift by Cisco to discuss a foundational challenge for the enterprise: how do we make specialized agents from different vendors collaborate effectively? As companies like Salesforce, Workday, and Microsoft all dev ... Show More
56m 13s
Jun 17
LLMs for Equities Feature Forecasting at Two Sigma with Ben Wellington - #736
Today, we're joined by Ben Wellington, deputy head of feature forecasting at Two Sigma. We dig into the team’s end-to-end approach to leveraging AI in equities feature forecasting, covering how they identify and create features, collect and quantify historical data, and build pre ... Show More
59m 31s
Recommended Episodes
Jan 2023
Chat GPT - Podcast Trailer
https://www.solgood.org - Check out our Streaming Service for our full collection of audiobooks, podcasts, short stories, & 10 hour sounds for sleep and relaxation at our website Are you curious about the inner workings of a language model? Want to know how AI is revolutionizing ... Show More
1m 5s
Jul 2023
2451: How LingQ is Expanding Language Horizons With Tech
In today's episode of Tech Talks Daily, we are joined by Mark Kaufmann, the CEO of LingQ, an innovative language-learning app. LingQ has recently made headlines for announcing the addition of Swahili to their extensive catalogue of languages, raising their total to 42 languages o ... Show More
30m 21s
Jul 2023
#130 Mathew Lodge: The Future of Large Language Models in AI
Welcome to episode #130 of Eye on AI with Mathew Lodge. In this episode, we explore the world of reinforcement learning and code generation. Mathew Lodge, the CEO of Diffblue, shares insights into how reinforcement learning fuels generative AI. As we explore the intricacies of re ... Show More
49m 44s
Mar 2020
1140: Learn a New Language quickly With AI-powered Lingvist
I recently read a fascinating story about a particle physicist turned co-founder of an AI-based language learning app called Lingvist and felt compelled to find out more. Mait Müntel was part of the Higgs boson discovery team at CERN, where he was frustrated by being unable to sp ... Show More
23m 33s
Jan 2023
Chatting with ChatGPT: Pros and Cons of Advanced Language AI (Ep. 215)
In this episode, I'll be discussing the capabilities and limitations of ChatGPT, an advanced language AI model. I'll go over its power to understand and respond to natural language, and its applications in tasks such as language translation and text summarization. However, I'll a ... Show More
31m 27s
May 2023
Efficiently Retraining Language Models: How to Level Up Without Breaking the Bank (Ep. 227)
Get ready for an eye-opening episode! 🎙️ In our latest podcast episode, we dive deep into the world of LoRa (Low-Rank Adaptation) for large language models (LLMs). This groundbreaking technique is revolutionizing the way we approach language model training by leveraging low-rank ... Show More
33m 50s
Jun 2021
135. What can we learn about language from computers?
In this episode, you’ll learn about language learning from AI (Artificial Intelligence) linguist and English teacher, Yazzy Ares. In this podcast we’ll talk about the field of NLP (Natural Language Processing) and AI, and the difference between humans and computers when it comes ... Show More
46m 58s
Oct 2012
Can robots be made creative enough to invent their own language?
Luc Steels delivers the 2012 Simonyi lecture and asks can machines be creative enough to invent their own language? Professor Steels talks about some of his recent breakthrough experiments which have seen robots programmed to play language games and come up with novel concepts, w ... Show More
1h 22m