Posts

Showing posts from February, 2020

Kafka cluster installation. Only practical experience.

Disclaimer: The story below is related to OpenShift Dedicated v.3. I have a project which requires event sourcing architecture. The project is running in OpenShift. My idea is to try Kafka and RabbitMQ in the broker role. Kafka installation is supported in OpenShift by Strimzi implementation called AMQ Streams . This means that, in case of OpenShift Dedicated clusters, RedHat has to enable Streams support if you are on v.3. After the Streams are enabled you can create a Kafka cluster with a simple command, like it is described in How to run Kafka on Openshift, the enterprise Kubernetes, with AMQ Streams . Just execute: $ cat << EOF | oc create -f - apiVersion: kafka.strimzi.io/v1alpha1 kind: Kafka metadata: name: my-cluster spec: kafka: replicas: 3 listeners: external: type: route storage: type: ephemeral zookeeper: replicas: 3 storage: type: ephemeral entityOperator: topicOperator: {} EOF And you will get you cluster.....

How to execute `kafka-topic.sh` using a broker pod in OpenShift

RedHat advices to use the next command: oc exec -it <broker_pod_name: e.g.="" my-cluster-kafka-0=""> -c kafka -- bin/kafka-topics.sh --zookeeper localhost:2181 --describe --topic <topic_name> RedHat portal Other interesting topics: https://access.redhat.com/documentation/en-us/red_hat_amq/7.5/html/using_amq_streams_on_openshift/uninstalling-str https://access.redhat.com/documentation/en-us/red_hat_amq/7.5/html/using_amq_streams_on_openshift/assembly-deployment-configuration-str#assembly-storage-deployment-configuration-kafka

Deploy RabbitMQ cluster in OpenShift

https://github.com/jharting/openshift-rabbitmq-cluster

Deploy Kafka in OpenShift

I guess the most valid links are:  Finite Loop Git Repo  and Kunal Repo , even previous one relates on last one. But the best way is Strimzi