Orell Garten
Aug 23, 2022

--

I have used Kafka with Python and it's not a great experience over all.

1. Kafka ist overblown for almost all problems. Using MQTT or RabbitMQ is probably sufficient for most projects, unless you deal with 100s of 1000s of events per second.

2. If you don't use Java you feel like a second-class citizen in the Kafka (or really the Apache) world. There are a lot of small bugs and annoyances when using any of the available Python libraries. Documentation also isn't too great.

Nevertheless, Kafka definitely has its use cases, but I didn't find it particularly nice to work with Kafka in Python.

--

--

Orell Garten
Orell Garten

Written by Orell Garten

Helping industrial companies collect and gain insights from data with custom software and data engineering. LinkedIn: @orgarten

Responses (2)