logo
episode-header-image
Mar 2023
1h 9m

How Discord Stores Trillions of Messages...

Hussein Nasser
About this episode

Discord engineering goes into details of how they migrated from Cassandra to ScyllaDB, improved the performance of their reads and writes and rearchitected their backend to support the new load. It is an interesting episode lets get into it

0:00 Intro

1:50 Relational vs Distributed

7:00 The Cassandra Troubles

11:00 SnowFlake vs UUID

14:30 B+Tree

19:20 B+Tree and SSDs

25:30 LSM Trees

31:00 Hot partitions

36:00 Cassandra Garbage Collector Pauses

40:00 Changing the Architecture

45:00 The Data Services

55:00 The Migration

1:02:00 Zoned Named Spaces

1:04:00 Summary

Article here How Discord Stores Trillions of Messages

https://discord.com/blog/how-discord-stores-trillions-of-messages

Up next
Jun 13
kTLS - Kernel level TLS
Fundamentals of Operating Systems Course https://oscourse.winktls is brilliant.TLS encryption/decryption often happens in userland. While TCP lives in the kernel. With ktls, userland can hand the keys to the kernel and the kernel does crypto. When calling write, the kernel encryp ... Show More
22m 55s
May 9
The beauty of the CPU
If you are bored of contemporary topics of AI and need a breather, I invite you to join me to explore a mundane, fundamental and earthy topic.The CPU.A reading of my substack article https://hnasr.substack.com/p/the-beauty-of-the-cpu 
9m 38s
Apr 2025
Sequential Scans in Postgres just got faster
This new PostgreSQL 17 feature is game changer. They know can combine IOs when performing sequential scan. Grab my database coursehttps://courses.husseinnasser.com 
27m 36s
Recommended Episodes
Nov 2023
Jordi Baylina of Polygon zkEVM | Zero Knowledge, Privacy, Scalability and Building Useful Technology
The Hashing it Out team sits down with Jordi Baylina to discuss everything from his involvement in the Catalan Independence Movement, DApp Node, and Giveth to technical details associated in bringing privacy and compression to zk proofs via recursion. 
1h 4m
Feb 2023
David Deutsch: Knowledge Creation and The Human Race, Part 1
Introduction 0:00 The Human Race 2:11 Knowledge Creation 12:34 AGI 15:50 Taking Children Seriously 23:30 Good Explanations 27:49 Quantum Computers 36:35 — Transcript http://nav.al/david-deutsch 
43m 50s
Jun 2023
Digital Identity w/ ENS Domains
Always mixing business and education, Khori has major experience managing for-profits and non-profits, with a big love for tech and always being an early adopter. Developing an interest in distributed ledger tech, and being passionate about decentralized inclusion and identity, h ... Show More
1h 17m
Feb 2024
Episode 58: Youssef Sammouda - Client-Side & ATO War Stories
Episode 58: In this episode of Critical Thinking - Bug Bounty Podcast we finally sit down with Youssef Samouda and grill him on his various techniques for finding and exploiting client-side bugs and postMessage vulnerabilities. He shares some crazy stories about race conditions, ... Show More
1h 54m
Jan 2022
125 - Object Caching Systems
DownloadWe are sponsored by audible! http://www.audibletrial.com/programmingthrowdownWe are on Patreon! https://www.patreon.com/programmingthrowdownT-Shirts! http://www.cafepress.com/programmingthrowdown/13590693Join us on Discord! https://discord.gg/r4V2zpCObject Caching Systems ... Show More
1h 14m
Feb 2022
#507: February 2022 Update Show 2
Some interesting updates across all kinds of topics this week! Remember you can record feedback at https://d1ox81nm0qxip8.cloudfront.net/index.html Chapters: 00:21 Analytics 02:58 Application Integration 03:10 Compute 04:30 Customer Engagement 05:27 Database 07:44 Developer Tools ... Show More
22m 39s
Jul 2024
Episode 78: Less Writing, More Hacking - Reporting Efficiency Techniques
Episode 78: In this episode of Critical Thinking - Bug Bounty Podcast we’re talking about writing reports. We share some tips that we’ve learned, and discuss ways that AI can (and can’t) help with that process. We also talk about the benefit of using tools like Fabric, Loom, and ... Show More
1h 6m
Oct 2022
Going From Transactional To Analytical And Self-managed To Cloud On One Database With MariaDB
Summary The database market has seen unprecedented activity in recent years, with new options addressing a variety of needs being introduced on a nearly constant basis. Despite that, there are a handful of databases that continue to be adopted due to their proven reliability and ... Show More
52m 4s
May 2023
Blockchain Scalability w/ Cartesi
Omran is a tech-savvy with a background in software architecture for more than 15 years, having worked in big companies such as Google and Intel. Max, on the other hand, even without a tech background, has always been curious about innovation and technology, using business models ... Show More
1h 3m
Mar 2023
POGs Takeover w/ Kyler
Kyler has a broad background story, from being a former professional snowboarder to working in banking, but as soon as he learned about Bitcoin, it clicked for him. A crypto OG, he has experienced both bears and bulls, with a great passion and interest for blockchain technology a ... Show More
56m 31s