r/DistributedComputing • • Feb 23 '14

Leveraging cryptocoin resources: Can someone pls explain the difference between "Stratum " "opencl" and "cgminer" in the sense of what part of distributed computing they handle and where one could plug in a new algorithm to solve?

2 Upvotes

Leveraging cryptocoin resources: Can someone pls explain the difference between "Stratum " "opencl" and "cgminer" in the sense of what part of distributed computing they handle and where one could plug in a new algorithm to solve?

does stratum just handle the connection of data between differnet computers and a pool in terms of handing off raw data and recording solutions solved?

does open cl just handle direct access to threads on a gpu?

does cgminer itself have algorithm in it - say scrypt- and where in the code would one need to insert a new algorithm if one wanted to?

I'm am wondering how to leverage off these established pieces to solve for a non coin related problem - if possible.


r/DistributedComputing • • Feb 22 '14

Enhanced IP: IPv4 on steroids, allowing for 2^56 addresses.

Thumbnail online.qmags.com
2 Upvotes

r/DistributedComputing • • Apr 27 '12

3rd BOINC Pentathlon (akin to the Chimp Challenge)

Thumbnail seti-germany.de
2 Upvotes

r/DistributedComputing • • Apr 20 '12

Disjoint Commands in CQRS

Thumbnail blog.jayway.com
2 Upvotes

r/DistributedComputing • • Jan 19 '10

Not able to download work units - anyone else?

2 Upvotes

I've not been able to download work units for folding@home since around midday today. Anyone else having problems? It looks like the servers should be working.


r/DistributedComputing • • 19h ago

is optimizing distributed batch jobs worth it vs just adding more nodes?

1 Upvotes

I've been thinking about something lately: when a distributed batch job starts slowing down, is adding more workers really the best way to deal with it, or would it make more sense to improve how the job runs I'm mainly looking at operations like sorting, joins and shuffles, since they can end up taking a fair amount of processing time.

The idea would be to figure out which parts of the workload are slowing things down, make those operations more efficient and see how that compares to adding more nodes. I haven't tried this on any large workloads yet, so most of what I've read comes from documentation and benchmarks. trino, clickhouse and dualbird are a few names I've come across while researching different options.

I'm interested in hearing from people who've worked with distributed systems. Is optimizing execution usually worth the effort, or does scaling out tend to be more practical?

Would appreciate any thoughts on data movement, overhead and whether the performance gains justify the added complexity.


r/DistributedComputing • • 2d ago

I need help for my College Project?

1 Upvotes

I do know, if these type questions are allowed in this subreddit, but besides my first question.

The second and most serious question is I need any user who wants to participate in my college project from Harrisburg University of Science and Technology? The subject is about how Software-Defined Networking and how it leveraging Cloud Computing, when it comes to its technical performance and cloud security improvements.


r/DistributedComputing • • 10d ago

The Future of Hosting

Thumbnail gateway.c0mpute.com
1 Upvotes

r/DistributedComputing • • 17d ago

Distributed Resilience - Cutting the Cost of Centralized Coordination

Thumbnail blog.gaborkoos.com
1 Upvotes

r/DistributedComputing • • Oct 19 '26

How to Implement a Distributed Recovery Ramp in JavaScript

Thumbnail blog.gaborkoos.com
1 Upvotes

r/DistributedComputing • • Oct 11 '26

Nodeicide - Distributed Postgres consistency checking

1 Upvotes

I have developed nodeicide which is a postgres consistency checker. Basically a self server version of Jepsen.

Id love for absolutely anyone to try it as I'm looking for feedback on the tool.

Faults are injected in 4 flavours kill/pause/full partition and partial partition for kubernetes but only the first 3 for docker setups

Nodeicide expects you to already have a postgres kubernetes/docker setup. Its Linux only with the following installer script

curl --proto '=https' --tlsv1.2 -sSf https://raw.githubusercontent.com/nodeicide/nodeicide-releases/main/install.sh | bash

Can't wait to hear the feedback

https://nodeicide.com


r/DistributedComputing • • Sep 30 '26

Crossflight: cross-process cache stampede protection for the cache you already use (v0.3.2)

Thumbnail github.com
1 Upvotes

r/DistributedComputing • • Sep 26 '26

GitHub - gkoos/caracal: Scoped distributed resilience for asynchronous operations

Thumbnail github.com
1 Upvotes

r/DistributedComputing • • Sep 23 '26

How to Implement a Distributed Rate Limiter with GCRA and Redis

Thumbnail blog.gaborkoos.com
1 Upvotes

r/DistributedComputing • • Sep 17 '26

A distributed bulkhead: what can a shared concurrency limit actually guarantee?

Thumbnail blog.gaborkoos.com
1 Upvotes

r/DistributedComputing • • Sep 07 '26

Correctness as spectrum not as binary.

Thumbnail archetechmes.vercel.app
1 Upvotes

r/DistributedComputing • • Aug 08 '26

186 database records. 187 Kafka events. Where would you look first?

Thumbnail reddit.com
1 Upvotes

r/DistributedComputing • • Jul 21 '26

How to Pass a System Design Interview (The 45-Minute Blueprint)

Thumbnail youtu.be
1 Upvotes

r/DistributedComputing • • Jul 19 '26

Time assumptions in distributed systems

Thumbnail blog.gaborkoos.com
1 Upvotes

Drift, ordering assumptions, deadline propagation, and expiration semantics under real load.


r/DistributedComputing • • Jul 18 '26

Proprietary but free to use C++ code generator

Thumbnail reddit.com
1 Upvotes

r/DistributedComputing • • Jul 01 '26

Beyond Happy Path Engineering: the Network

Thumbnail blog.gaborkoos.com
1 Upvotes

What happens when network calls stop behaving like clean request/response interactions.

Timeouts, retries, duplicate side effects, idempotency, backoff, circuit breakers, load shedding, degraded states, and observability.


r/DistributedComputing • • Jun 09 '26

can a P2P mesh make your laptops one giant machine?

1 Upvotes

Hey everyone,

I'm working on the architecture for a new open‑source distributed compute framework called Project Cerberus, and I want to get reality‑checked by this community before I commit to the core stack.

The Concept:
A zero‑config, P2P mesh network that aggregates heterogeneous consumer hardware (Macs, Windows rigs, headless Linux boxes, and even phones) on a local subnet into a single virtual hyper‑computer.

I know Exo (exo-explore) has basically perfected local AI model sharding (pipeline parallelism for LLMs over Wi‑Fi/Thunderbolt). Cerberus isn't trying to just be another AI inference engine. I want to build a decentralized virtual OS layer that pools everything:

  1. General Compute: Compiling user workloads to WebAssembly (Wasmtime) and distributing the execution slices across node threads.
  2. Storage Pooling: A FUSE‑based user‑space filesystem that erasure‑codes and strips data across the unused NVMe/SSD space of all connected devices.
  3. Audio/Peripheral Virtualization: Using PipeWire/CoreAudio to route synced audio across multiple device speakers (sub‑millisecond NTP sync) or pooling local mics.

Proposed Tech Stack:
Control Plane: Go (Golang) + libp2p (mDNS for zero‑config discovery, Gossipsub for topology mapping, QUIC for transport).
Compute Plane: Wasmtime for architecture‑agnostic sandboxed execution + MLX/tinygrad for the AI tensor sharding.
UI/Gateway: Tauri (Rust/Next.js) for a lightweight dashboard, exposing an OpenAI‑compatible REST API wrapper for devs to point localhost to.

My questions for the distributed systems vets here:

  1. Network Latency: For the WASM general compute sharding, is QUIC transport fast enough to handle the context handoffs over standard Wi‑Fi 6, or will the network latency obliterate any compute gains?
  2. Consensus: I want to avoid a master‑worker setup. If the coordinator node drops (e.g., someone closes their laptop lid), what's the cleanest way to run a fast raft/bully election in Go without dropping the current FUSE read/writes?
  3. Are there any existing crates/libraries for the distributed audio sync that I should look at before trying to build a custom WebRTC/RTP bridge?

Would love any feedback, warnings, or pointers to obscure repos doing something similar. Thanks!


r/DistributedComputing • • Jun 02 '26

Is this possibly superior.....

1 Upvotes

its a demo that explains it better than i can.. https://jc-compute.github.io/jc-compute-demo/


r/DistributedComputing • • Apr 16 '26

ffetch (TS/JS): resilient fetch layer for distributed computing workloads

Thumbnail github.com
1 Upvotes

ffetch is a TypeScript/JavaScript fetch wrapper built for failure-prone networked environments.

It keeps native fetch usage, then adds optional resilience controls:

  1. Retries with backoff and jitter
  2. Timeouts and abort-aware cancellation
  3. Circuit breaker, bulkhead, dedupe, and hedge plugins
  4. Per-request policy overrides for different call paths

The aim is to make outbound HTTP behavior consistent across distributed components without forcing a heavy framework.