logo
episode-header-image
Feb 2020
31m 31s

Networking Optimizations for Multi-Node ...

Sam Charrington
About this episode

Today we conclude the KubeCon ‘19 series joined by Erez Cohen, VP of CloudX & AI at Mellanox, who we caught up with before his talk “Networking Optimizations for Multi-Node Deep Learning on Kubernetes.” In our conversation, we discuss NVIDIA’s recent acquisition of Mellanox, the evolution of technologies like RDMA and GPU Direct, how Mellanox is enabling Kubernetes and other platforms to take advantage of the recent advancements in networking tech, and why we should care about networking in Deep Lea

Up next
Oct 7
Recurrence and Attention for Long-Context Transformers with Jacob Buckman - #750
Today, we're joined by Jacob Buckman, co-founder and CEO of Manifest AI to discuss achieving long context in transformers. We discuss the bottlenecks of scaling context length and recent techniques to overcome them, including windowed attention, grouped query attention, and laten ... Show More
57m 23s
Sep 30
The Decentralized Future of Private AI with Illia Polosukhin - #749
In this episode, Illia Polosukhin, a co-author of the seminal "Attention Is All You Need" paper and co-founder of Near AI, joins us to discuss his vision for building private, decentralized, and user-owned AI. Illia shares his unique journey from developing the Transformer archit ... Show More
1h 5m
Sep 23
Inside Nano Banana 🍌 and the Future of Vision-Language Models with Oliver Wang - #748
Today, we’re joined by Oliver Wang, principal scientist at Google DeepMind and tech lead for Gemini 2.5 Flash Image—better known by its code name, “Nano Banana.” We dive into the development and capabilities of this newly released frontier vision-language model, beginning with th ... Show More
1h 3m
Recommended Episodes
Sep 2021
Accelerating Innovation with Hybrid Cloud ​at the Edge
The world is hitting a data tipping point where vast connectivity requires massive network capacity. In this episode of Smart Talks, Malcolm Gladwell talks to David Shacochis, Vice President for Enterprise Technology and Field CTO at Lumen, and Howard Boville, Head of IBM Cloud P ... Show More
28m 55s
Jul 2022
Distributed Cloud Edge for Telcos with DP Ayyadevara and Krishna Garimella
Stephanie Wong and Carter Morgan are back this week learning about Google’s Distributed Cloud Edge for telcos with guests Krishna Garimella and DP Ayyadevara. Launched last year, Google Distributed Cloud Edge has benefited companies across many industries. Today, our guests are h ... Show More
36m 20s
Oct 2020
Tracking the Trends: AI, WebRTC, Crypto, and Full Stack Startups
Today’s episode is a conversation about four big trends in the tech world. Any one of these trends would be notable on its own, but we cover all four in this hallway-style chat, as a16z General Partner Chris Dixon talks with Sep Kamvar (professor of Media Arts and Sciences at MIT ... Show More
28m 26s
Aug 2022
NVIDIA’s Clément Farabet on Orchestrating AI Training for Autonomous Vehicles - Ep. 175
Autonomous vehicles are one of the most complex AI challenges of our time. The networks running in the car must act as an intricate symphony, requiring intensive training, testing and validation on massive amounts of data to operate safely in the real world. Clément Farabet is th ... Show More
29m 36s
Mar 2022
Tech News: Tech Strikes Back at Russia
The tech world has clamped down on Russia in the wake of the country's invasion of Ukraine. A cryptocurrency exchange founder is going to stand trial on charges of wire fraud and money laundering. And we say farewell to a man who co-developed Ethernet technology. Learn more about ... Show More
32 m
Mar 2024
HN727: Kubernetes Networking Essentials
Where there are containers, there is networking. Today we dig into the networking that underlies Kubernetes, the open source orchestration platform for container-based applications. Our guest Karim El Jamali takes us through the essential concepts: Nodes, pods, clusters, CNIs, vi ... Show More
1h 6m
Oct 2017
The Complexity of Learning Neural Networks
Over the past several years, we have seen many success stories in machine learning brought about by deep learning techniques. While the practical success of deep learning has been phenomenal, the formal guarantees have been lacking. Our current theoretical understanding of the ma ... Show More
38m 51s