To create a topic we’ll use a Kafka CLI tool called kafka-topics, that comes with Kafka. A producer is always sending a message to a particular topic and consumers are always reading messages from a particular topic. Now that we have our cluster up and running, we’ll create a topic.Ī topic is a way to organize messages. Sn-zookeeper /etc/confluent/docker/run Up 2181/tcp, 2888/tcp, 3888/tcp Create a topic By running docker-compose ps, as shown below, we can see that Kafka broker is available on port 9092. Your local Kafka cluster is now ready to be used. The output should look something like this: Creating network 'single-node-kafka_default' with the default driver Once you have the project, navigate to a folder called single-node-kafka and start the Kafka cluster: docker-compose up -d I’ve prepared a docker-compose file which you can grab from Coding Harbour’s GitHub: git clone To simplify our job, we will run these two servers using docker-compose.ĭon’t have docker-compose? Check: how to install docker-compose At a minimum, a Kafka cluster consists of one Kafka server (called broker) and it needs at least one Zookeeper node. To be able to produce messages to and consume them from Kafka we need… uhm, the Kafka cluster. Ok, are you ready? Let’s get started! Running a Kafka cluster locally Using only the CLI tools that come with Apache Kafka. In this post, I will show you how to run an Apache Kafka cluster on your machine and how to:

Running kafka in docker on mac