Best Practices Working with Billion-row Tables in Databases

The Backend Engineering Show with Hussein Nasser

Episode | Podcast

Date: Mon, 14 Sep 2020 19:39:23 GMT

<p>In this video, I discuss 3 methods to work with tables of billion rows. This discussion is inspired by a comment on my YouTube video on Twitter System Design right here https://www.youtube.com/watch?v=gfq-LG9ZJQA&amp;lc=UgyYbm5889dW0XtKhsV4AaABAg</p> <p>Chapters</p> <p>Intro 0:00</p> <p>1. Brute Force Distributed Processing 2:30</p> <p>2. Working with a Subset of table 3:35</p> <p>2.1 Indexing 3:55</p> <p>2.2 Partitioning 5:30</p> <p>2.3 Sharding 7:30</p> <p>3. Avoid it all together (reshuffle the whole design) 9:10</p> <p>Summary 11:30</p>