2022-04-08

Deploy Standalone (Single Node) MinIO server using Docker Compose on Linux

4 mins read MinIO is a high-performance object storage solution with native support for Kubernetes deployments that provides an Amazon Web Services S3-compatible […]
2020-05-28

Difference between ETL and ELT

13 mins read On a high level, ETL transforms your data before loading, while ELT transforms data only after loading to your warehouse. In this post, […]
2019-07-17

A quick review of Apache Kafka

27 mins read Introduction Kafka is a word that gets heard a lot nowadays. A lot of leading digital companies seem to use it. […]
2019-05-12

Kafka Producer and Consumer example in Python

3 mins read Till now we have seen the basics of Apache Kafka and created Producer and Consumer using Java. In this tutorial, […]
2019-05-11

Kafka Data Processing Guarantees: An explanation of at-least -once, at-most- once, and exactly-once semantics

12 mins read Distributed event stream processing has become an increasingly hot topic in the area of Big Data. Notable Stream Processing Engines […]
2019-05-10

Apache Kafka comprehensive tutorial series – Part 4 – Kafka Broker, Kafka Queuing, Kafka Client

28 mins read Kafka Broker In this section, we are going to learn Kafka Broker. Kafka Broker manages the storage of messages in […]
2019-05-10

Apache Kafka comprehensive tutorial series – Part 3 – Kafka Cluster, Producer, and Consumer

17 mins read Kafka Cluster In this Kafka section, we will see Kafka Cluster Setup. This Kafka Cluster tutorial provides us with some simple steps […]
2019-05-10

Apache Kafka comprehensive tutorial series – Part 2 – Kafka Architecture and Its Fundamental Concepts

10 mins read Kafka Architecture – Apache Kafka APIs Apache Kafka Architecture has four core APIs, producer API, Consumer API, Streams API, and […]
2019-05-10

Kafka Comprehensive Tutorial – Part 1

21 mins read What is Kafka?  We use Apache Kafka when it comes to enabling communication between producers and consumers using message-based topics. […]
2019-05-09

Kafka Architecture: Log Compaction

5 mins read This article is heavily inspired by the Kafka section on design around log compaction. You can think of it as the cliff notes […]
2019-05-09

Writing a Kafka Consumer in Java

11 mins read In this tutorial, you are going to create simple Kafka Consumer. This consumer consumes messages from the Kafka Producer you wrote […]
2019-05-09

Writing a Kafka Producer in Java

9 mins read In this tutorial, we are going to create a simple Java example that creates a Kafka producer. You create a […]
2019-05-09

Understand Kafka Clusters, Kafka Consumer Failover, and Kafka Broker Failover with examples

11 mins read In this tutorial, we are going to run many Kafka Nodes on our development laptop so you will need at […]
2019-05-09

The Kafka Ecosystem: Kafka Core, Kafka Streams, Kafka Connect, Kafka REST Proxy, and the Schema Registry

3 mins read The core of Kafka is the brokers, topics, logs, partitions, and clusters. The core also consists of related tools like […]
2019-05-09

Kafka, Avro Serialization, and Schema Registry

12 mins read Confluent Schema Registry stores Avro Schemas for Kafka producers and consumers. The Schema Registry provides a RESTful interface for managing Avro schemas […]