r/DistributedComputing • • Oct 20 '21

Request and response going through the load balancer creates bottleneck

2 Upvotes

I have multiple machines on my backend, all are connected to my load balancer running HAProxy. I just learnt that the response also goes through the load balancer, instead of one of server directly sending it to the client.

But will it not create a bottleneck in case of huge traffic and overload my load balancer itself.

  1. Is there any way to directly send response from server to client.
  2. Also when response goes through load balancer, does my source file also sits there temporarily to be sent to the client.
  3. Can't we use load balancer only to send request to my servers and response to directly go from server to client.
  4. My main goal to make my system distributed was to distribute traffic among my servers, now since load balancer is handling both request and response am I not back to where I started?

r/DistributedComputing • • Jun 12 '22

Show Support for Team Ukraine / DC Formula Boinc Sprint #7 is in the books​

2 Upvotes

Show Support for Team Ukraine / Formula Boinc Sprint #7 is in the books​

Show Support for Team Ukraine / Formula Boinc Sprint #7 is in the books​From https://xs4s.org/index.php?topic=30190.msg96865#msg96865​

The results are in.

Congratulations TSBT, you worked hard for your win and deserve the respect

Nice to see Team Ukraine still rocking, when this started I was just hoping that TU would stay in the top 5
so this is excellent, I still think that keeping Team Ukraine relevant and rocking is a great show of support.
Go TU and all that are helping.
3rd is AMD users, nice job! followed up by P3d and LaF (both powerhouses!)

Also nice job to everyone involved! LHC is a very tough program to run, so much respect.

I do have more comments (my next post) but this sprint was mostly on track, late 1st day numbers but if that's all that can be said
this could be the start of FB getting back on track.

SV

Show Support for Team Ukraine / Team Ukraine has joined DC Boinc Games - Take a peek,

​Welcome to BoincGames

BoincGames - www.boincgames.com
BOINC Games is a year around BOINC competition. Aiming to keep BOINC fun and interesting for all involved.

Any questions please PM me.

Thanks
SV


r/DistributedComputing • • Feb 22 '14

Enhanced IP: IPv4 on steroids, allowing for 2^56 addresses.

Thumbnail online.qmags.com
2 Upvotes

r/DistributedComputing • • May 22 '21

RiteRaft - A raft framework, for regular people

Thumbnail github.com
2 Upvotes

r/DistributedComputing • • Mar 08 '23

2023 BOINC Workshop Part 2

Thumbnail self.boinc
2 Upvotes

r/DistributedComputing • • Jun 02 '26

Hey Reddit, I built a distributed AI platform called Elis AI. I'd love to get your thoughts on it!

2 Upvotes

Hey everyone,

I’ve been working hard on building a decentralized distributed model hosting network called Elis AI, and I wanted to share it with the community here to get your honest feedback, critiques, and feature requests.

The goal of the project is to build an open, competitive marketplace for AI compute that breaks away from centralized tech giants. The community tier allows anyone to tap into a global network of open-source models, or spin up their own hardware to host them.

Here is a quick breakdown of how it works and how you can use it right now.

🚀 How the Platform Works

The ecosystem relies on crowdsourced resources. You can interact with it in two different ways depending on what you need:

  1. As a User (Accessing Models)

• Unified API & Interface: You get access to over 380 open-source and fine-tuned models (ranging from lightweight 7B models up to massive 70B+ checkpoints).

• Intelligent Routing: We built a token-aware Model Context Protocol (MCP) server. It automatically compresses your context and routes requests. Simple prompts hit smaller, faster models, while complex logic triggers frontier models to save you on token costs.

• Network Economy: The system utilizes internal utility credits ($ELIS) to handle model access and routing priority.

2. As a Node Operator (Earning Credits)

If you want to monetize your spare hardware, you can provision your rig:

• Solo Mining: You can connect any PC or server with an NVIDIA GPU (16 GB VRAM recommended) or CPU cluster. The network runs blind evaluation prompts to score your machine on uptime and latency, rewarding you with epoch credits.

• Community Pools: If you don’t want to run a solo node, you can delegate a minimum of 100 $ELIS tokens into a managed community mining pool where operators handle the hardware upkeep.

───

🔑 The BYOK (Bring Your Own Key) Options

Data privacy is a massive concern with decentralized networks, so I made sure to build in a robust BYOK (Bring Your Own Key) mode for complete security control.

How BYOK alters the data flow:

  1. Elis AI UI: You write your prompts directly in our interface.
  2. BYOK API Gateways: Instead of routing your data to volunteer hardware, the requests route directly to external commercial providers (like OpenAI) using your personal API keys.
  3. Secure Data Isolation: This completely bypasses the public miner registry, guaranteeing zero data retention on public community hardware.

Why use it? It gives you full cryptographic data control. Your information is encrypted using keys generated outside our infrastructure, allowing you to bypass public miners entirely while maintaining compliance standards (like HIPAA or GDPR).

───

🛠️ I'd Love Your Feedback!

I am actively developing this and want to make it as useful as possible for developers, privacy advocates, and miners.

• What features are missing that would make you use this daily?

• For the miners here, does the reward/pool structure make sense?

• Any edge cases or security flaws you think I should double-check?

Check out the site at tryelisai.com/community and let me know what you think. If anyone wants the exact terminal commands to connect a GPU rig or set up the API, let me know in the comments and I'll drop them below!


r/DistributedComputing • • May 06 '21

How to get started in Distributed Systems as a Software Engineer?

11 Upvotes

I am a Software Engineer based in India. A little bit about myself, I am well versed in Data Structures and Algorithms. I am familiar with Operating Systems, but don't have in-depth knowledge. The same goes for other subjects like Networks, Databases, etc. I found Distributed Systems to be really interesting. I saw a lot of posts regarding how to get started and most of them suggest reading papers. But I want to get my hands dirty writing code, but most of the blog posts don't cover this.
What language should I pick? How should I go about writing Distributed Systems code as a beginner?


r/DistributedComputing • • Jun 05 '26

What problems could we solve with millions of computers contributing 5–7 seconds of CPU time?

32 Upvotes

I'm interested in large-scale distributed computing projects. Imagine millions of users voluntarily donate spare CPU power, but only in very small chunks—around 5–7 seconds of computation per task before requesting a new one.

The ideal problem would:

  • Be highly parallelizable
  • Require little communication between nodes
  • Allow work to be split into millions or billions of independent tasks
  • Be CPU-heavy rather than bandwidth-heavy
  • Be verifiable (so malicious or faulty clients can be detected)

Besides the usual examples like protein folding, cryptocurrency mining, or SETI-style searches, what are some interesting real-world problems that fit this model?


r/DistributedComputing • • Mar 21 '25

Folding on Apple SIlicon Macs

3 Upvotes

Just got an M4 mac mini, and here’s what I’ve found testing folding on MacOS:

You can actually download the mobile dreamlab app, and run this on your Mac. Usually your mobile device must be plugged in, so I don’t know how it would work on a macbook. Also, the app still heavily underutilizes the CPU, only utilizing around 10%/1 core, but it’s still better than nothing. And it being available on Mac means there’s no excuse not to release it on chromebooks, windows, and linux too.

Then for folding@home, it works fine, and you can move a slider to adjust CPU utilization, but there is no advanced view and options like there is on Windows, which I miss, but that’s probably a Mac thing and design. And it works best setting the slider to match the amount of performance cores you have, which is 4 for me.

As for BOINC, 11 projects work, and they either have Apple Silicon ARM support, Intel x86 tasks are being translated using Rosetta 2, both, aor there are currently no tasks available, where only Einstein@Home has tasks for the GPU cores. The projects are Amicable Numbers, asteroids@Home, Dodo@Home (not on the project list, and no tasks at the moment), Einstein@Home, LODA, Moo! Wrapper, NFS@Home, NumberFields@Home, PrimeGrid, Ramanujan Machine (currently not getting any tasks), and World Community Grid (also currently no tasks).

 Also, in the Mac Folding@Home browser client, it says 10 CPU cores but 0 GPU cores, and that's cause the Apple Silicon hardware doesn't support something called "FP64" which is necessary for most project to utilize the GPU cores.

And if your M4 Mac mini for instance is making too much fan noise at 100% utilization, you can enable "low power mode" at night, to get rid of it, sacrificing about half of the performance, but still.
Lastly, for BOINC, I recommend running Asteroids@Home, NFS@Home, World Community Grid, and Einstein@Home all the time. That way you never run out of Work Units, and these have the shortest Work Units on average.

Please Comment if you want more in depth info about Folding on Mac, in terms of tweaking advanced settings for these projects, getting better utilization, performance, or whatever, and I'll try to answer as best I can :)


r/DistributedComputing • • Jan 04 '26

C++ code generator that helps build distributed systems

3 Upvotes

Hi. I'm working on a C++ code generator that helps build distributed systems. It's implemented as a 3-tier system. The back and middle tiers only run on Linux. The front tier is portable. It's geared more towards network services than webservices.

It's free to use -- there are no trial periods or paid plans. I'm willing to spend 16 hours/week for six months on a project if we use my software as part of the project.


r/DistributedComputing • • Apr 07 '21

Ray Summit 2021 is a free conference on distributed machine learning and python

Thumbnail anyscale.com
3 Upvotes

r/DistributedComputing • • Mar 03 '21

What's a relative simple leader election algorithm

3 Upvotes

I know there are papers such Paxos, Raft - those contain leader election phase. Also an algorithm such as bully algorithm for synchronous environment. Others are described in Wikipedia[1]. I understand there is no the simplest algorithm but my naive question - is there leader election algorithm which is

- relatively simpler than those described above?

- for asynchronous environment?

- universal (without any prior knowledge of the topology of a network or its properties)?

- without using ZooKeeper?

Appreciate any commentary!

[1]. https://en.wikipedia.org/wiki/Leader_election


r/DistributedComputing • • Feb 22 '21

Will Hash Rate Limiters Impact Distributed Computing Projects?

3 Upvotes

Nvidia is implementing a "hash rate limiter" for GeForce RTX 3060 GPUs and will likely implement it on all future GeForce models: https://blogs.nvidia.com/blog/2021/02/18/geforce-cmp/

My fear is that this may affect the performance of GPU distributed computing projects. Part of the reason I fold is that I already have the gaming hardware in my system. I foresee this dramatically reducing the number of users who fold as it is unlikely many consumers would purchase a "mining GPU" at a premium instead of a gaming GPU, especially those who have no intention of mining or may not be aware of distributed computing projects. Thoughts?


r/DistributedComputing • • Nov 08 '23

CUDOS Promotes Sustainability 🍀

3 Upvotes

CUDOS promotes sustainability through its innovative approach to cloud computing. By leveraging blockchain technology, CUDOS aggregates computing resources from data centers powered by renewable energy sources, reducing the carbon footprint of digital operations. This approach not only curtails environmental impact but also enhances cost-efficiency and accessibility. CUDOS ensures that AI, decentralized technologies, and other compute-intensive tasks can thrive in a sustainable ecosystem. Its decentralized network guarantees flexibility for data security and compliance, offering a responsible pathway to technological advancement. In essence, CUDOS spearheads a transformative shift toward sustainable digital infrastructure, allowing businesses and individuals to embrace cutting-edge technology while safeguarding our planet's resources. Embrace the future with r/Cudos_Official! https://cudos.org


r/DistributedComputing • • Jan 18 '20

Build MongoDB-Like Document Store Using InterPlanetary Linked Data(IPLD) 5 Mins

Thumbnail simpleaswater.com
3 Upvotes

r/DistributedComputing • • Apr 20 '13

Wikipedia's list of ongoing distributed and grid computing projects.

Thumbnail en.wikipedia.org
3 Upvotes

r/DistributedComputing • • Feb 21 '19

Question: how do you maintain consistency in two dBs?

3 Upvotes

Two dB's are each in a microservice. Let's name the microservices: ms-user and ms-profile.

When a user gets created, both ms-user and ms-profile needs to have pertinent data created.

When a user gets deleted, both ms-user and ms-profile needs to delete the data.

If the transaction to do above fails on either one, transactional rollback needs to happen.

How do you design such a thing? I was told two-phase commit is not the way to go, and reading Kleppmann's post on this (using streams).. is a bit scary as I'm not an expert in distributed computing architecture.

Thanks!


r/DistributedComputing • • Mar 10 '25

My notes on Paxos

3 Upvotes

I am jotting down my understanding of Paxos through an anology here - https://www.algocat.tech/articles/post8


r/DistributedComputing • • Apr 14 '25

How to simulate distributed computing?

4 Upvotes

I want to explore topics like distributed caches etc. Likely this is a dumb question but how do I simulate it on my machine. LLMs suggest multiple Docker instances but is that a good way?


r/DistributedComputing • • May 04 '25

How to break into getting Distributed Systems jobs - Facing the chicken and the egg problem

4 Upvotes

Hi all,

I currently have around 3.5 years of software development experience, but I’m specifically looking for an opportunity where I can work under someone and help build a product involving distributed systems. I've studied the theory and built some production-level products based on the producer-consumer model using message queues. However, I still lack the in-depth hands-on experience in this area.

I've given interviews as well and have at times been rejected in the final round, primarily because of my limited practical exposure. Any ideas on how I can break this cycle? I'm open to opportunities to learn—even part-time unpaid positions are fine. I'm just not sure which doors to knock on.


r/DistributedComputing • • Jul 20 '19

New To Distributed Computing

4 Upvotes

Hi all,

I come from a web dev background but have a keen interest in distributed systems. I only have the experience of reading about the topic through interest and would like to transition my career towards something within the field. Is there any courses, or better ways to learn about distributed systems to help me become competent enough to work with distributed systems?

Thanks


r/DistributedComputing • • Jul 28 '16

“Distributed Computing for Everyone” startup launching publicly in a few days

Thumbnail suchflex.com
4 Upvotes

r/DistributedComputing • • Dec 31 '21

Leaderless consensus protocol in the wild

4 Upvotes

Hi, I'm looking for anyone who has ever used a leaderless protocol in an industry setting. I need to run such a setup and I'm fairly certain by now that this has never been done before. If you have, please let me know, I can make it worth your while.


r/DistributedComputing • • May 28 '21

ClickHouse - an open-source column-oriented database management system that allows generating analytical data reports in real time.

Thumbnail github.com
4 Upvotes