Introduction

In this article, we are going to learn about Apache Kafka and its overview.

Agenda

What is Kafka

Kafka is used to build distributed real-time data and streaming applications. It has a few features such as scalability, fault-tolerant, and event replay, capable of persisting messages for a certain duration.

Why Kafka

Kafka is often used to generate real-time metrics, log aggregation solutions, and stream processing. Mostly used to understand the customer journeys, so that we can recommend offers based on the customer click stream data.

Kafka Components

Component Architecture

Kafka

Note: First Topic, then partition, and finally, offset. The offset is used to read the data from which location. Moreover, offset it incrementally by 1.

Kafka APIs

ZooKeeper

It acts as a manager to coordinate all Kafka brokers. Its vital role is to notify consumers or producers if there are any issues or changes occurring in the Kafka broker, may be added new broker, or failure of the broker. so that the consumer or producer can decide to coordinate with the next available broker.

Real World Example

I hope, this article gives an idea about Kafka, Thanks for reading this, we will meet in the next session.