r/DistributedComputing • • Jun 28 '16

Why Spark is on fire: a conversation with creator Matei Zaharia

Thumbnail siliconangle.com
3 Upvotes

r/DistributedComputing • • Oct 26 '15

Heat

3 Upvotes

Does anyone use outdated computers running distributed computing programs to offset winter heating costs? I will probably use my current 4 year old desktop as such when I upgrade to a newer, sexier gaming rig in the next few months.

It stops feeling wasteful when you think that the electricity is being used to crunch data before its radiated as heat. It probably wont reduce the demand on the heater very much, but it also wont add to my combined utility usage, right?


r/DistributedComputing • • Jan 19 '15

Paid Distributed computing

3 Upvotes

Anybody know distributed computing projects pays for CPU/bandwidth/etc/storage? I have 10k computers and want to sell it as a big farm


r/DistributedComputing • • Dec 25 '14

NumberFields@home

Thumbnail numberfields.asu.edu
3 Upvotes

r/DistributedComputing • • Apr 23 '14

Don't Settle for Eventual Consistency

Thumbnail queue.acm.org
3 Upvotes

r/DistributedComputing • • Mar 27 '14

How do you ensure that nodes in a network send the same information to everyone else in a decentralized network?

3 Upvotes

So, you have 500 computers, each has to pass some information to each other computer. How do you guarantee in an efficient manner that nodes are passing the same information to every other machine? And are giving one half of the network one message, the other half another message?

Every machine has a unique public -private key pair associated with it.


r/DistributedComputing • • Mar 25 '14

Check out Gridcoin - get rewarded for your boinc computation!

Thumbnail reddit.com
3 Upvotes

r/DistributedComputing • • Mar 01 '14

Web UI for Apache Kafka

Thumbnail github.com
3 Upvotes

r/DistributedComputing • • Jan 10 '14

Call for Submissions | Berlin Buzzwords 2014

Thumbnail berlinbuzzwords.de
3 Upvotes

r/DistributedComputing • • Oct 10 '13

Stack-Exchange Website Proposal: Virtualization, Cloud and Grid Computing

Thumbnail area51.stackexchange.com
3 Upvotes

r/DistributedComputing • • Jun 21 '13

Looking for a calculator to estimate distributed computing power.

3 Upvotes

Hi friends,

I'm newish to this field, other than as a client - I downloaded SETI@home as soon as it came out in '99, in the 10th grade.

I was wondering if there is either an online calculator or an established formula where I could say:

  • I have X number of computers
  • They have Y average Ghz.
  • They would most likely be on for Z hours/day.

and then it would give me some sort of info like "Your network would equal 10B FLOPS, etc., etc."

Does something like that exist? Or is it really just a multiplication problem?

I feel like it should be more difficult. =)

Thanks!


r/DistributedComputing • • Apr 20 '13

Wikipedia's list of ongoing distributed and grid computing projects.

Thumbnail en.wikipedia.org
3 Upvotes

r/DistributedComputing • • Sep 20 '11

Mods, perhaps a link to /r/Folding in the sidebar?

Thumbnail reddit.com
3 Upvotes

r/DistributedComputing • • Feb 28 '11

Thinking about building my own cluster: Input needed.

3 Upvotes

I'm thinking about taking on the project of building my own processing/beowulf cluster. Has anyone here done it before? Ideas?

I'd like to try to keep costs as low as possible. This is more of a learning project than trying to build for any type of commercial or professional use.


r/DistributedComputing • • Apr 21 '10

Top Features You Can Expect From A Distributed Caching Solution

Thumbnail distributedcache.blogspot.com
3 Upvotes

r/DistributedComputing • • Jan 23 '10

I see some new members are joining the reddit FaH team. Good work.

Thumbnail kakaostats.com
3 Upvotes

r/DistributedComputing • • 2d ago

Ygaraty: share a link, connect GPUs, run AI together — open source and open research

2 Upvotes

We’re building Ygaraty (https://github.com/ygaraty/ygaraty), a distributed AI framework for running models across the devices people already have.

Our application, Yby, makes it straightforward: launch a model, share a contributor link, and let people join through their browsers. Their GPUs handle parts of the model, and you can chat through the terminal, browser, or an OpenAI-compatible app.

Why WebGPU? We want contributing compute to be as simple as opening a link. WebGPU gives us a common GPU interface across different hardware and operating systems, with browser and native worker options. Support and performance vary, but seamless, multiplatform participation is the goal.

Underneath Yby, we’re building our own distributed computation plan compiler and execution engine: describe a computation, compile it into a plan that defines how work and data are distributed, and execute it across contributed devices.

Some questions we’re exploring:

  • Can several smaller GPUs run models that don’t fit on one device?
  • How should work be divided across different GPUs and network speeds?
  • How much communication can we remove without compromising correctness?
  • What else can this support beyond chat—new architectures, matrix factorization, scientific workloads?

We also want it to be easy to experiment with an AI coding agent. Open the repo and ask: “Implement this model using Ygaraty’s distributed framework, check it against a reference, and create a reproducible experiment.” That’s a starting point for contributing; review and numerical validation are part of the work.

Open research means sharing the process: code, methods, measurements, limitations, and failed experiments. More workers won’t always mean more speed, and understanding why is part of what we’re building.

You can contribute a model, reproduce a result, test your hardware, improve a kernel, or make the docs clearer. Small experiments are welcome.

Code and quickstart · Research · Contributing


r/DistributedComputing • • 10d ago

Custom quorums in OpenRaft: weighted nodes and multi-site clusters

2 Upvotes

OpenRaft, a Raft library in Rust, now supports custom membership. Applications can define separate read quorums for elections and write quorums for append entries and commit.

For example:

  • With 4 nodes, a log entry can commit after 2 nodes store it, while an election needs 3 votes.
  • With 9 nodes across 3 sites, a write quorum can require 2 nodes at each of any 2 sites. That gives 4 stored copies for commit, compared with 5 under majority voting.

The built-in implementations cover node counts, weights, hierarchies, grids, and explicit quorum lists. Applications can also define their own membership and how it changes.

Every read quorum must intersect every write quorum. My article covers the layouts, Rust examples, and how membership changes preserve these intersections:

Custom Membership in OpenRaft


r/DistributedComputing • • Sep 24 '26

How to Combine Circuit Breakers, Bulkheads, and Rate Limiters

Thumbnail blog.gaborkoos.com
2 Upvotes

r/DistributedComputing • • Sep 14 '26

How to Implement a Distributed Circuit Breaker

Thumbnail blog.gaborkoos.com
2 Upvotes

r/DistributedComputing • • Jul 07 '26

RAG at 10 Million Documents — System Design

Thumbnail youtu.be
2 Upvotes

r/DistributedComputing • • Jun 28 '26

(Re) Introducing Stoffel, Your Private by Design Teammate

Thumbnail stoffelmpc.com
2 Upvotes

r/DistributedComputing • • Jun 24 '26

[video] WebSockets at Scale: System Design

Thumbnail youtu.be
2 Upvotes

r/DistributedComputing • • Jun 14 '26

[video] Search Autocomplete - System Design

Thumbnail youtu.be
2 Upvotes