logo
episode-header-image
Feb 2025
1h 7m

Accelerating AI Training and Inference w...

Sam Charrington
About this episode
Today, we're joined by Ron Diamant, chief architect for Trainium at Amazon Web Services, to discuss hardware acceleration for generative AI and the design and role of the recently released Trainium2 chip. We explore the architectural differences between Trainium and GPUs, highlighting its systolic array-based compute design, and how it balances performance a ... Show More
Up next
Oct 15
Your Ranking Model Is Optimizing the Wrong Thing with Zoe Weil - #780
In this episode, Zoe Weil, co-founder and CEO of Sequen, joins us to discuss how ranking systems can use live behavioral signals to optimize for purchases rather than clicks or search relevance alone. Zoe explains why approaches developed at data-rich social platforms don’t neces ... Show More
52m 44s
Oct 6
Why Jev Is Changing How We Build With AI with Diogo Almeida - #779
In this episode, Diogo Almeida, co-founder and CEO of TypeSafe, joins us to discuss Jev, TypeSafe’s recently released model for bringing fast, reliable intelligence directly into software. We explore the idea of “machine-native intelligence” and why Diogo believes models optimize ... Show More
1h 30m
Sep 29
From Math Olympiads to Navier-Stokes: How Fast Is AI Progressing? with Greg Burnham - #778
AI systems have gone from struggling with grade-school math to helping solve research problems that have resisted mathematicians for decades, including Navier-Stokes. In this episode, Greg Burnham, who leads AI capabilities research at Epoch AI, joins us to examine what that prog ... Show More
1h 7m
Recommended Episodes
Jul 2023
#605: AWS Trainium-powered Amazon EC2 Trn1n instances
How to get the best price performance in Amazon EC2 for the most demanding machine learning training workloads? Tune in to learn how AWS Trainium-based Amazon EC2 Trn1n instances can help you train your network-intensive generative AI models at scale. Amazon EC2 Trn1n instances d ... Show More
20m 58s
Nov 2025
939: Mixture-of-Experts and State-Space Models on Edge Devices, with Tyler Cox and Shirish Gupta
State space models (SSMs), granite models, and Mamba: Dell’s Tyler Cox and Shirish Gupta discuss with Jon Krohn why state space models can process information so efficiently, and how Dell’s AI factory helps enterprises manage custom AI workloads. Hear the latest on the Dell Pro A ... Show More
1h 6m
Aug 2025
911: The Future of Python Notebooks is Here, with Marimo’s Dr. Akshay Agrawal
Reproducibility, Python notebooks, and data science communities: Software developer Akshay Agrawal speaks to Jon Krohn about Marimo, the next-generation computational notebook for Python, how he built and fostered a thriving community around the product, and what makes this noteb ... Show More
58m 20s
Oct 2025
What Open Source Teaches Us About Making AI Better - Ep. 278
Learn how NVIDIA's Nemotron family of open source models is redefining accelerated computing. NVIDIA’s Bryan Catanzaro and Jonathan Cohen discuss the breakthroughs in efficiency, openness, and collaboration — sharing how Nemotron empowers developers and enterprises to innovate, c ... Show More
34m 13s
Oct 2025
929: Dragon Hatchling: The Missing Link Between Transformers and the Brain, with Adrian Kosowski
Breaking news: Jon Krohn welcomes Adrian Kosowski to the show to talk about the groundbreaking research happening at Pathway. Adrian and his team demonstrate how they have brought attention in AI closer to the way the brain functions, creating, in essence, a “massively parallel s ... Show More
1h 14m
May 2020
Exploring NVIDIA's Ampere & the A100 GPU (Practical AI #90)
On the heels of NVIDIA's latest announcements, Daniel and Chris explore how the new NVIDIA Ampere architecture evolves the high-performance computing (HPC) landscape for artificial intelligence. After investigating the new specifications of the NVIDIA A100 Tensor Core GPU, Chris ... Show More
53m 19s
Feb 2025
#706: Automate LLM fine-tuning and selection with Amazon SageMaker Pipelines
This week on the Official AWS Podcast, dive into the rapidly evolving world of Large Language Model Operations (LLMOps)! Join the experts as our host Shruti interviews Piyush Kadam, Sr. Product Manager, and Lauren Mullennex, Sr. Solutions Architect at AWS to explore how Amazon Sa ... Show More
30m 51s
Jul 2024
2965: How Digital Realty is Driving AI Growth Through High-Performance Infrastructure
In our latest Tech Talks Daily Podcast episode, I sit down with Seamus Dunne from Digital Realty to explore the accelerating demand for compute power driven by AI and generative AI technologies. As these innovations push the boundaries of what's possible, the infrastructure suppo ... Show More
32m 5s
Aug 2023
2481: Zenoss - From Cloud to AI: The Evolution of IT Infrastructure
In today's episode of Tech Talks Daily, I sit down with Trent Fitz, a seasoned veteran in the tech space with over two decades of leadership experience, especially in cloud computing, AI, and cybersecurity. As Chief Product Officer of Zenoss, Trent has been at the forefront of te ... Show More
27m 4s