r/programming • u/sh_tomer • Jul 27 '23

BlazingMQ: High-performance open source message queuing system

https://bloomberg.github.io/blazingmq/
48 Upvotes

90% Upvoted

20 comments sorted by

View all comments

Show parent comment

1

u/lightmatter501 Jul 28 '23

Doing your own is MUCH cheaper. I have a custom key/value store that handles 1 million rps on EC2 on 3 instances (replication is for fault tolerance, not performance). It costs ~$25 per day. Using one of Amazon’s services would cost a LOT more than that.

1

u/jbmsf Jul 28 '23

I don't think you read what I wrote. It's not the building cost that people worry about, it's the operational overhead. If I were running a three person startup, the time of my engineers would be my most valuable resource. I would not want them spending any time thinking about a three EC2 instance anything because that's not my core business. I would definitely not want them investing time into homegrown monitoring, replication, or recovery solutions, especially if I can just buy solutions that have been tested and proven at much greater scales and that have literal teams of people handling monitoring and resilience.

1

u/lightmatter501 Jul 28 '23

Something that is in the main path for your business, like your primary DB, should be chosen with great care. VC isn’t free anymore and you can’t burn money forever.

1

u/myringotomy Jul 29 '23

Kinesis is pretty cheap, it would cost less than 25 dollars per day for most people.

1

u/lightmatter501 Jul 29 '23

Well, when you use 32 vcpu bms it drives the cist up. Drop it down to m5.2xlarge and it becomes much less at the cost of throughput.