logo
episode-header-image
Jan 2024
1h 5m

AI Trends 2024: Machine Learning & Deep ...

Sam Charrington
About this episode

Today we continue our AI Trends 2024 series with a conversation with Thomas Dietterich, distinguished professor emeritus at Oregon State University. As you might expect, Large Language Models figured prominently in our conversation, and we covered a vast array of papers and use cases exploring current research into topics such as monolithic vs. modular architectures, hallucinations, the application of uncertainty quantification (UQ), and using RAG as a sort of memory module for LLMs. Lastly, don’t miss Tom’s predictions on what he foresees happening this year as well as his words of encouragement for those new to the field.


The complete show notes for this episode can be found at twimlai.com/go/666.

Up next
Oct 7
Recurrence and Attention for Long-Context Transformers with Jacob Buckman - #750
Today, we're joined by Jacob Buckman, co-founder and CEO of Manifest AI to discuss achieving long context in transformers. We discuss the bottlenecks of scaling context length and recent techniques to overcome them, including windowed attention, grouped query attention, and laten ... Show More
57m 23s
Sep 30
The Decentralized Future of Private AI with Illia Polosukhin - #749
In this episode, Illia Polosukhin, a co-author of the seminal "Attention Is All You Need" paper and co-founder of Near AI, joins us to discuss his vision for building private, decentralized, and user-owned AI. Illia shares his unique journey from developing the Transformer archit ... Show More
1h 5m
Sep 23
Inside Nano Banana 🍌 and the Future of Vision-Language Models with Oliver Wang - #748
Today, we’re joined by Oliver Wang, principal scientist at Google DeepMind and tech lead for Gemini 2.5 Flash Image—better known by its code name, “Nano Banana.” We dive into the development and capabilities of this newly released frontier vision-language model, beginning with th ... Show More
1h 3m
Recommended Episodes
Oct 2023
Txt
In this episode of High Theory, Matthew Kirschenbaum talks about txt, or text. Not texting, or textbooks, but text as a form of data that is feeding large language models. Will the world end in fire, flood, or text?In the full interview, Matthew recommended Tim Maughan’s novel In ... Show More
19m 54s
Jul 2023
Moore’s law in peril and the future of computing
Demand for computer power continues to soar, but can the hardware keep up? 
1h 1m
Apr 2024
Modern Education & Large Language Models (LLMs) - Luis Serrano | Podcast #113
📚 Grokking Machine Learning by Luis: https://bit.ly/3TfQKtS 🌍 Cohere LLM University: https://docs.cohere.com/docs/llmuDr. Luis Serrano’s interest in mathematics started in high school when he participated in mathematical olympiads, representing his native Colombia. Later, he co ... Show More
44m 34s
Jul 2023
#130 Mathew Lodge: The Future of Large Language Models in AI
Welcome to episode #130 of Eye on AI with Mathew Lodge. In this episode, we explore the world of reinforcement learning and code generation. Mathew Lodge, the CEO of Diffblue, shares insights into how reinforcement learning fuels generative AI. As we explore the intricacies of re ... Show More
49m 44s
Feb 2024
#179 Why ML Projects Fail, and How to Ensure Success with Eric Siegel, Founder of Machine Learning Week, Former Columbia Professor, and Bestselling Author
We are in a Generative AI hype cycle. Every executive looking at the potential generative AI today is probably thinking about how they can allocate their department's budget to building some AI use cases. However, many of these use cases won't make it into production.In a similar ... Show More
48 m
Jul 2018
175: Insights from the Founder of KDnuggets
In this episode of the SuperDataScience Podcast, I chat with the President and Editor at KDNuggets, Gregory Piatetsky-Shapiro. You will hear about the recent advancements in Data Science, learn how Reinforcement Learning can greatly improve AI capabilities, and learn about the no ... Show More
53m 22s
Sep 2019
295: A Deep Conversation About Tech & Life
In this episode of the SuperDataScience Podcast, I chat with my friend and business partner, Hadelin de Ponteves. You will hear what new exciting things are happening in Hadelin's life now. You will hear some preview of his upcoming presentation at DataScienceGO 2019, which will ... Show More
55m 27s
Sep 2023
Smart Talks With IBM: Transformations in AI: why foundation models are the future
Major breakthroughs in artificial intelligence research often reshape the design and utility of AI in both business and society. In this episode of Smart Talks with IBM, Malcolm Gladwell and Jacob Goldstein explore the conceptual underpinnings of modern AI with Dr. David Cox, VP ... Show More
40 m