logo
episode-header-image
Jul 2021
20m 22s

Scaling CPU-intensive Backends - The Bac...

Hussein Nasser
About this episode
tail spinning
Up next
Jan 19
5 Backend Design Patterns for Managing Threads and Sockets
In this video I introduce 5 different design patterns for building backend applications. Each mode explains how a socket listener is established, a connections are established and how threads and connections are managed to read, write and process requests. 
46m 9s
Dec 15
Page Tables
Page tables provide the mapping between virtual memory and physical memory for each process. This means it needs to be as efficient and as fast as possible. I explore the inner workings of page tables in this episode.0:00 Intro2:00 Virtual Memory ⁃ ⁃ 8:00 MMU10:00 Page Tables ⁃ ⁃ ... Show More
46m 39s
Nov 24
CPU and Kernel Page Faults
<p>Page faults occurs when the process tries to access a memory that isn’t backed by a physical page kernel raises a fault which loads a page. It happens on first access, stack expansion, COW, swap and much more. However it comes with a cost. </p><p><br /></p><p>In this episode o ... Show More
48m 37s
Recommended Episodes
Jun 2021
Accelerating ML Training And Delivery With In-Database Machine Learning
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>When you build a machine learning model, the first step is always to load your data. Typically this means downloading files from object storage, or querying a database. To speed up the process, why not build the model in ... Show More
1h 5m
Feb 2022
Embedded Machine Learning: Part 5 - Machine Learning Compiler Optimization (Ep. 186)
tail spinning
49m 12s
Mar 2024
Linux Kernel Scheduler Developer | David Vernet
<p>The linux kernel is something we all use but have you ever thought about what goes into it, well today we&#39;ve got David Vernet on the show who has spent quite a bit of time focusing on one aspect, that being the scheduler.</p> <p>=========Guest Links==========</p> <p>Twitch ... Show More
1h 55m
Jun 2023
#599: Amazon EC2 Hpc7g Instances
How can you build designs faster and predict the weather more efficiently? How can you can carry out complex calculations across HPC clusters using up to tens of thousands of cores with high performance and lower costs? In this podcast, Heidi Poxon, Principal HPC Technologist, ta ... Show More
13m 48s
Jul 2023
#605: AWS Trainium-powered Amazon EC2 Trn1n instances
How to get the best price performance in Amazon EC2 for the most demanding machine learning training workloads? Tune in to learn how AWS Trainium-based Amazon EC2 Trn1n instances can help you train your network-intensive generative AI models at scale. Amazon EC2 Trn1n instances d ... Show More
20m 58s
Sep 2021
Massively Parallel Data Processing In Python Without The Effort Using Bodo
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>Python has beome the de facto language for working with data. That has brought with it a number of challenges having to do with the speed and scalability of working with large volumes of information.There have been many ... Show More
1h 4m
Jan 2022
125 - Object Caching Systems
tail spinning
1h 14m
Oct 2023
Reducing The Barrier To Entry For Building Stream Processing Applications With Decodable
<h2>Summary</h2> <p>Building streaming applications has gotten substantially easier over the past several years. Despite this, it is still operationally challenging to deploy and maintain your own stream processing infrastructure. Decodable was built with a mission of eliminat ... Show More
1h 8m
Mar 2023
Unlocking The Potential Of Streaming Data Applications Without The Operational Headache At Grainite
<h2>Summary</h2> <p>The promise of streaming data is that it allows you to react to new information as it happens, rather than introducing latency by batching records together. The peril is that building a robust and scalable streaming architecture is always more complicated a ... Show More
1h 13m