logo
episode-header-image
Aug 2024
36m 50s

ChatGPT has a language problem — but sci...

SPRINGER NATURE LIMITED
About this episode

AIs built on Large Language Models have wowed by producing particularly fluent text. However, their ability to do this is limited in many languages. As the data and resources used to train a model in a specific language drops, so does the performance of the model, meaning that for some languages the AIs are effectively useless.


Researchers are aware of this problem and are trying to find solutions, but the challenge extends far beyond just the technical, with moral and social questions to be answered. This podcast explores how Large Language Models could be improved in more languages and the issues that could be caused if they are not.


Watch our related video of people trying out ChatGPT in different languages.


Hosted on Acast. See acast.com/privacy for more information.

Up next
Yesterday
Ancient DNA reveals farming led to more human diseases
00:48 The past 35,000 years of diseaseAncient DNA evidence shows that the advent of agriculture led to more infectious disease among humans, with pathogens from animals only showing up 6,500 years ago. The DNA, extracted from human teeth, shows the history of diseases present in ... Show More
37m 6s
Jul 4
Audio long read: How to speak to a vaccine sceptic — research reveals what works
Questions and doubts about vaccines are on the rise worldwide and public-health specialists worry that these trends could worsen. But while the shift in public attitudes towards immunizations can leave scientists, physicians and many others feeling disheartened, a surge of resear ... Show More
16m 13s
Jul 2
3D-printed fake wasps help explain bad animal mimicry
In this episode:00:45 Why animals evolve to be imperfect mimicsMany harmless animals mimic dangerous ones to avoid being eaten, but often this fakery is inaccurate. To help explain why evolution sometimes favours imperfect mimicry, a team 3D printed a range of imaginary insects. ... Show More
27m 19s
Recommended Episodes
Apr 8
Andriy Burkov - The TRUTH About Large Language Models and Agentic AI (with Andriy Burkov, Author "The Hundred-Page Language Models Book")
Andriy Burkov is a renowned machine learning expert and leader. He's also the author of (so far) three books on machine learning, including the recently-released "The Hundred-Page Language Models Book", which takes curious people from the very basics of language models all the wa ... Show More
1h 24m
Aug 2023
Cuttlefish Model Tuning
Hongyi Wang, a Senior Researcher at the Machine Learning Department at Carnegie Mellon University, joins us. His research is in the intersection of systems and machine learning. He discussed his research paper, Cuttlefish: Low-Rank Model Training without All the Tuning, on today’ ... Show More
27m 8s
Mar 2025
How Learning a New Language Rewires Your Brain—Lessons from the Pirahã Tribe | Daniel Everett : 1258
Is the Way You Speak Limiting How You Think?For years, scientists debated how language shapes the brain, but new research reveals it goes far beyond communication. Some languages lack numbers, grammar, or even complex sentences—yet their speakers navigate reality in ways that def ... Show More
1h 11m
Sep 2021
Emily M. Bender — Language Models and Linguistics
In this episode, Emily and Lukas dive into the problems with bigger and bigger language models, the difference between form and meaning, the limits of benchmarks, and why it's important to name the languages we study.Show notes (links to papers and transcript): http://wandb.me/gd ... Show More
1h 12m
Apr 3
2027 Intelligence Explosion: Month-by-Month Model — Scott Alexander & Daniel Kokotajlo
Scott and Daniel break down every month from now until the 2027 intelligence explosion.Scott Alexander is author of the highly influential blogs Slate Star Codex and Astral Codex Ten. Daniel Kokotajlo resigned from OpenAI in 2024, rejecting a non-disparagement clause and risking ... Show More
3h 4m
Aug 2024
AI that connects the digital and physical worlds | Anima Anandkumar
While language models may help generate new ideas, they cannot attack the hard part of science, which is simulating the necessary physics," says AI professor Anima Anandkumar. She explains how her team developed neural operators — AI trained on the finest details of the real worl ... Show More
12m 14s
Jun 2024
Can AI Help Us Learn New Languages Faster with Kerstin Cable
Welcome to the Artificial Intelligence Podcast! This podcast is dedicated to helping you leverage artificial intelligence to unlock new opportunities and make money while you sleep. Our host, Jonathan Green, a best-selling author, shares his insights live from a tropical island i ... Show More
25m 20s
May 2023
TinyML: Bringing machine learning to the edge
When we think about machine learning today we often think in terms of immense scale — large language models that require huge amounts of computational power, for example. But one of the most interesting innovations in machine learning right now is actually happening on a really s ... Show More
45m 45s
Jul 2024
AI that connects the digital and physical worlds | Anima Anandkumar
“While language models may help generate new ideas, they cannot attack the hard part of science, which is simulating the necessary physics,” says AI professor Anima Anandkumar. She explains how her team developed neural operators — AI trained on the finest details of the real wor ... Show More
11m 6s
Jul 2017
14: Artificial Thought (Neural Networks)
Go to www.brilliant.org/breakingmathpodcast to learn neural networks, everyday physics, computer science fundamentals, the joy of problem solving, and many related topics in science, technology, engineering, and math.  Mathematics takes inspiration from all forms with which life ... Show More
1h 5m