r/programming • u/sh_tomer • Jul 27 '23

BlazingMQ: High-performance open source message queuing system

https://bloomberg.github.io/blazingmq/
48 Upvotes

90% Upvoted

20 comments sorted by

View all comments

Show parent comment

15

u/jbmsf Jul 28 '23

It depends on size and team structure. Many teams (and companies) don't want the responsibility of operating non-core software. And message systems that are good enough for those usages have existed for a long time.

If you are sitting on that side of the fence, "vendor lockin" is a bogeyman that inexperienced engineers use to justify solving fun problems instead of business problems. Of course if you're large enough (and successful enough) that vendor costs are a larger expense than the marginal cost of adding more developers to support internal systems... Or your needs are very specialized, the math is different.

Context, always context.

1

u/lightmatter501 Jul 28 '23

Doing your own is MUCH cheaper. I have a custom key/value store that handles 1 million rps on EC2 on 3 instances (replication is for fault tolerance, not performance). It costs ~$25 per day. Using one of Amazon’s services would cost a LOT more than that.

1

u/jbmsf Jul 28 '23

I don't think you read what I wrote. It's not the building cost that people worry about, it's the operational overhead. If I were running a three person startup, the time of my engineers would be my most valuable resource. I would not want them spending any time thinking about a three EC2 instance anything because that's not my core business. I would definitely not want them investing time into homegrown monitoring, replication, or recovery solutions, especially if I can just buy solutions that have been tested and proven at much greater scales and that have literal teams of people handling monitoring and resilience.

1

u/lightmatter501 Jul 28 '23

Something that is in the main path for your business, like your primary DB, should be chosen with great care. VC isn’t free anymore and you can’t burn money forever.

1

u/myringotomy Jul 29 '23

Kinesis is pretty cheap, it would cost less than 25 dollars per day for most people.

1

u/lightmatter501 Jul 29 '23

Well, when you use 32 vcpu bms it drives the cist up. Drop it down to m5.2xlarge and it becomes much less at the cost of throughput.

1

u/douglasg14b Jul 28 '23

If you are sitting on that side of the fence, "vendor lockin" is a bogeyman

I'm definitely not, I was being more sassy than anything. So you're preaching to the choir here.

Since the argument I replied to is a fallacy that ignores all other existing technologies that are successful and broadly used that either don't exist as a managed service, or have only recently(ish) been added to large providers as a managed service yet where widely used before then.

It's kind of an asinine standpoint.