Learn System Design

Send us a text

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

How does the invisible architecture of the internet keep everything running smoothly? Prepare to have your mind blown as we unravel the mysteries of the Domain Name System (DNS) in this episode of Learn System Design. We'll guide you through the intricate process of how your browser finds the correct IP address for a domain name, likening DNS to an enormous, sophisticated key-value database. Discover the essential components that make DNS work seamlessly, from DNS servers and resource records to caching mechanisms. We break down the DNS hierarchy, explaining the pivotal roles of recursive resolvers, root name servers, and top-level domain servers.

But that's not all—we're also diving deep into the world of service discovery patterns. Which is better: client-side or server-side discovery? We'll weigh the pros and cons of each, spotlighting real-world examples like Netflix's Eureka and AWS Elastic Load Balancer. Learn why a service registry is crucial for maintaining an updated list of services and how heartbeat checks fit into this ecosystem. Finally, we explore three popular service discovery methods—DNS-based, Apache Zookeeper, and sidecar services—giving you an in-depth look at their benefits and limitations. This episode is your ultimate guide to building robust and efficient systems, so tune in and elevate your system design knowledge!

Learn more about the different types of DNS Records (Zone files)

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

Imagine your website could handle the furious influx of a flash sale without breaking a sweat. That's the magic of load balancers, the unsung heroes of system design, which we dissect in this episode to help your services run smoothly even under the avalanche of high traffic. Together with industry experts, we unravel the mystery behind these traffic conductors, ensuring you grasp the significance of active-passive and active-active setups to avoid the dreaded single point of failure. We also pit hardware against software load balancers in an epic showdown, discussing how each fares in terms of performance, flexibility, and cost to help you architect a robust and scalable system.

As the conversation heats up, we chart the terrain of load balancing algorithms, where each choice can lead to triumph or turmoil for your server efficiency. Get ready to be enlightened on the intricacies of weighted least connections, least response time strategies, and how real-time data can empower your system to channel web traffic with the precision of a symphony conductor. We're not just talking about keeping your digital lights on; it's about fine-tuning your system's performance to handle the crescendo of demands. So stay with us, because next time we'll be navigating the complex waters of DNS and network management, adding another layer to your growing mastery of system design.

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

Discover the secret sauce that makes software systems scalable and robust as we dissect the architecture that powers modern applications. You're about to get a masterclass in software design, where we unravel the complex world of monolithic and microservice architectures. Say goodbye to confusion around when to stick with the simplicity of a monolith and when to break free into the modular world of microservices. We'll walk you through the need for message brokers and queues in this digital maze, ensuring your journey in software scalability is as smooth as possible.

Then, fasten your seatbelts as we delve into the messaging protocols that keep the world connected. MQTT and AMQP are more than just acronyms; they're the backbone of reliable communication in distributed systems. We'll demystify MQTT's retained messages and 'Last Will' features, and break down AMQP's advanced message handling that's critical in sectors like banking. This episode is jam-packed with insights that promise to elevate your understanding of the intricate dance of message exchange types and delivery processes. Tune in and equip yourself with the knowledge to architect resilient and flexible software systems.

Show Notes:
You can follow Diego's language podcast here: https://diversilingua.com/

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

Unlock the full potential of your database management with our deep dive into scalability strategies that can revolutionize how you handle data growth and system performance. Jessica Ho, a sharp-minded listener, brought forth questions that led us to explore the intricate dance of read-through versus cache-aside caching. We break down when to use each technique for the utmost data consistency across varying applications. Not stopping there, we also shed light on Redis and its dual capabilities as a powerhouse in-memory data structure store, adept at enhancing your caching solution both locally and remotely.

As we navigate through the labyrinth of database replication, you'll gain an understanding of the follower-leader model and its pivotal role in read-heavy applications—think TikTok or URL shorteners. We don't shy away from discussing the risks of single points of failure and the solutions like automatic failover that keep databases humming along. The conversation gets even more exciting as we delve into the advanced territory of multi-leader replication, a strategy that ups the ante on fault tolerance and caters to a global user base, reducing latency and the dread of write losses.

The episode wraps with an exploration of the various sharding methods, each with its own set of benefits and hurdles. Whether it's key-based sharding, range-based sharding, directory-based sharding, or geobased sharding we help you navigate these techniques to find the best fit for your specific needs. And as a bonus, we tease what's on the horizon for our tech-savvy listeners: the enthralling world of messaging queues. Be sure to hit subscribe for this and other forthcoming topics that will arm you with the know-how to stay ahead in the tech game. Join us on this journey, and let's conquer the scalability challenge together!

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

Embark on a time-traveling adventure with me, your host Benny Kitchell, as we chart the monumental shifts in database technology. From ancient civilizations etching their records into clay to the sophisticated graph databases of the present, this episode uncovers the pivotal moments that have shaped how we manage data. We'll delve into Edgar F. Codd's relational model revolution, understand the origins of the Hierarchical Model System, and discuss the impact of MongoDB's entrance into the field, all while drawing fascinating parallels to the systems we rely on today. As Oracle continues to represent the resiliency of relational databases, I'll also share a personal nod to Postgres for its robustness in the relational scene.

Prepare to look under the hood of database management as we unravel the intricacies of locking mechanisms and their critical role in maintaining data integrity. I'll guide you through the maze of optimistic and pessimistic locking techniques, clarifying their distinct applications and benefits. We'll also confront the concept of durability and the essential practice of write-ahead logging, ensuring our data withstands the unexpected. The rise of NoSQL and document databases throws a welcome curveball into our discussion, challenging the traditional database dominance with their specialized use cases.

Choosing the correct database type can be as complex as the data itself, but we simplify the decision-making process by breaking down the merits of document databases, especially when faced with rapidly evolving data structures. Your datas layout offers clues on whether to harness the power of relational, non-relational, or graph databases, and we'll explore when and why you might choose one over the others. To wrap up, it's a shout out to our listeners, whose insights and feedback shape our podcast's direction. If system design is the symphony, then your voices are the harmonies that enrich our collective journey into the world of database technology.

Show Notes:
A very special shout out to Sumaiya Asif!
Edgar F. Codd's paper

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

Embark on a journey with me, Benny Kitchell, as we chart the course through the complex waters of system design, zeroing in on the pivotal role of scalability. Imagine the chaos of a concert ticket site crashing just as sales go live; it’s a scenario I’ve lived through, and one that illustrates the high stakes of scaling. Within this episode, we dissect the anatomy of scalability, providing essential insights into how understanding both the product and user behavior is crucial for ensuring a system can handle fluctuating demands. As a veteran of the tech trenches, I share war stories and lessons learned, revealing how misguided scaling can be just as disastrous as stagnation, and how financial implications like ballooning AWS fees can catch you off guard if you’re not prepared.

Then, we shift gears and plunge into the 'War on Latency', where I illuminate the strategic deployment of caching and CDNs as our primary weapons. Not only do we unravel the technical threads of these systems, but we also tune in to the melodies of Aimless Orbiter, punctuating our discussion with an auditory experience that transcends the typical tech talk. From the intricacies of the CAP theorem to the harmonious balance proposed by its successor, the PACELC theorem, you’ll come away from this session armed with the knowledge that’s as practical as it is profound. Prepare to be enlightened by the symbiosis of robust system design discourse and the soul-stirring tunes that underscore our technological odyssey.

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Send us a text

Embark on an expedition into the vastness of system design with your host, Benny Kitchell, an experienced engineer whose passion for crafting scalable systems is as infectious as it is informative. Together, we'll traverse the complexities of database scaling, the subtleties of caching, and the intricacies of sharding. With foresight and expertise, I promise to arm you with the knowledge to tackle the challenges of building robust systems. As the series unfolds, anticipate engaging dialogues with the masterminds behind some of the most formidable tech architectures, offering a front-row seat to the creative and adaptable world of system design.

Step into a growing community where your thoughts and questions are the catalysts for our collective growth in mastering system design. As we unveil a Discord server, a space for unbridled discussion and growth, your input will help carve the path our conversations take. With each episode, including the upcoming one I'm thrilled to announce, we aim to enrich your understanding and spark your enthusiasm. Your journey in system design doesn't have to be a solo venture—join us, contribute, and let's elevate our skills in unison.

Support the show

Dedicated to the memory of Crystal Rose.
Email me at [email protected]
Join the free Discord
Consider supporting us on Patreon
Special thanks to Aimless Orbiter for the wonderful music.
Please consider giving us a rating on ITunes or wherever you listen to new episodes.