Apache Kafka — System Design

Introduction

Apache Kafka is an event streaming platform which helps producers to publish stream of events and consumers to consume the event stream. The producer doesn’t need to know consumer and vice versa. The system stores the stream of events which helps consumers not to be up all the time to consume the data. In this article, we will see the system design of Apache Kafka and some of its architectural decisions.

Architecture

Kafka is distributed system consisting of server (broker) and client…