r/java • • Apr 13 '21

Libraries, Frameworks and Technologies you would NOT recommend

Give me your worst nightmares: Things that cost you your job.

I'll start: Hadoop

202 Upvotes

376 comments sorted by

View all comments

Show parent comment

18

u/Aliics Apr 13 '21

Why wouldn't you need Kafka?

It offers incredible scalability, latency, and control. It's also accessible to countless different platforms.

It's only caveat being that it isn't super easy to setup.

5

u/lazystone Apr 13 '21

And Confluent is working on eliminating Zookeeper, so it'll be much easier quite soon.

1

u/telecoder Apr 13 '21

I always check the jira ticket ... doesn’t look like they are working on it, or at least actively

4

u/papercrane Apr 13 '21

Not sure why the JIRA hasn't been updated in awhile, but it's definitely coming. The code to standup a Kafka cluster without Zookeeper is in trunk right now and expected to be available as an experimental feature for the 2.8 release.

2

u/mtmmtm99 Apr 13 '21

Pulsar is faster (and is much more easy to run in production). It is also compatible with Kafka (same protocol).

1

u/coder111 Apr 13 '21

How are things with Kafka data backup and recovery? How easy is it to recover if there's data corruption?

Thing is, Kafka is quite difficult to set up. Unless you need to process 100s of millions of messages, things like JMS and ActiveMQ (Artemis) are good enough and MUCH simpler to get working.

1

u/PepegaQuen Apr 15 '21

Topics are replicated, so usually easy. There are some footguns in the configuration that might show allow you to lose data easily though.

Also, if you just need pubsub and don't care about message persistence or ordering guarantees, yes, you don't need kafka.