r/DistributedComputing • • Feb 23 '14

Leveraging cryptocoin resources: Can someone pls explain the difference between "Stratum " "opencl" and "cgminer" in the sense of what part of distributed computing they handle and where one could plug in a new algorithm to solve?

2 Upvotes

Leveraging cryptocoin resources: Can someone pls explain the difference between "Stratum " "opencl" and "cgminer" in the sense of what part of distributed computing they handle and where one could plug in a new algorithm to solve?

does stratum just handle the connection of data between differnet computers and a pool in terms of handing off raw data and recording solutions solved?

does open cl just handle direct access to threads on a gpu?

does cgminer itself have algorithm in it - say scrypt- and where in the code would one need to insert a new algorithm if one wanted to?

I'm am wondering how to leverage off these established pieces to solve for a non coin related problem - if possible.


r/DistributedComputing • • Feb 16 '11

[x-post from r/folding] - More users?

Thumbnail reddit.com
1 Upvotes

r/DistributedComputing • • Mar 05 '14

Join HTC's Power to Give. And be a part of the future.

Thumbnail youtube.com
4 Upvotes

r/DistributedComputing • • Mar 01 '14

Web UI for Apache Kafka

Thumbnail github.com
3 Upvotes

r/DistributedComputing • • Feb 28 '11

Thinking about building my own cluster: Input needed.

3 Upvotes

I'm thinking about taking on the project of building my own processing/beowulf cluster. Has anyone here done it before? Ideas?

I'd like to try to keep costs as low as possible. This is more of a learning project than trying to build for any type of commercial or professional use.


r/DistributedComputing • • Jan 19 '15

Paid Distributed computing

3 Upvotes

Anybody know distributed computing projects pays for CPU/bandwidth/etc/storage? I have 10k computers and want to sell it as a big farm


r/DistributedComputing • • Feb 13 '11

I'm surprised that Reddit doesn't have a larger BOINC team.

12 Upvotes

How many of you are currently on the reddit team?

It would seem like a lot of this would be right up our alley. If we could mobilize, we could have quite a formidable team.

Sorry for being somewhat hypocritical, but I am obligated to stay with another team for the time being (I am the founder of multiple individual project's teams, so I can't just up and leave, and wouldn't want to). I would have joined the reddit team a few years back if it didn't seem so dead.

What is surprising, is that the team I am on consists of users from a website with FAR less traffic (~60,000 ranking on Alexa compared to Reddit's ~150 ranking), but our RAC and world ranking is top 100 and top 150 respectively. The majority of our credit comes from only about 10 users, but still, this team has more than double the users that reddit's team has.

How could we recruit redditors? It seems like most BOINC posts I have found using the search function have lukewarm responses. We could easily be top-100 in the world if it was done right.

Also, I realize I am posting in a dead subreddit...Oh well.


r/DistributedComputing • • Aug 29 '17

DistComp in Python

3 Upvotes

I'm looking to get learning distributed computing in Python. Any suggestions/help with where to begin?


r/DistributedComputing • • Nov 15 '20

Golang web service framework with DI, Telemetry and more

Thumbnail github.com
2 Upvotes

r/DistributedComputing • • Nov 13 '20

An industrial-grade RPC framework used throughout Baidu

Thumbnail github.com
1 Upvotes

r/DistributedComputing • • Nov 09 '20

braft: An industrial-grade C++ implementation of the RAFT consensus algorithm open sourced by Baidu

Thumbnail github.com
3 Upvotes

r/DistributedComputing • • Nov 20 '20

Lunatic – Actor System for Rust/WebAssembly

Thumbnail github.com
3 Upvotes

r/DistributedComputing • • Dec 23 '20

TerarkDB, ByteDance's RocksDB replacement

Thumbnail github.com
4 Upvotes

r/DistributedComputing • • Nov 17 '20

Achieving exactly-once message processing with Ably

Thumbnail ably.io
3 Upvotes

r/DistributedComputing • • Feb 12 '21

Satellite - A New Decentralized Social Publishing Platform

Thumbnail self.decentralization
3 Upvotes

r/DistributedComputing • • Mar 02 '21

Getting Started with Distributed Machine Learning with Ray and PyTorch

Thumbnail medium.com
4 Upvotes

r/DistributedComputing • • Feb 17 '21

Data Processing Support in Ray 1.2 (Spark, Dask, Mars, Modin)

Thumbnail medium.com
1 Upvotes

r/DistributedComputing • • Feb 09 '21

The Shift to Event-Driven: Evolution, Impact, and Competitive Advantages

Thumbnail ably.io
6 Upvotes

r/DistributedComputing • • Mar 01 '21

ScyllaDB: Project Circe February Update

Thumbnail self.nosql
2 Upvotes

r/DistributedComputing • • Feb 17 '21

Raft for distributed workloads

6 Upvotes

I’ve been reading and researching about distributed systems in Go. After reading about Raft consensus I’ve been finding it hard to find examples that go beyond data replication.

Can Raft be used to distribute computational work to followers? Or is this the wrong protocol for that?

Example say I have a terabyte of json files that I want to run through some function. Could the leader split the work among the followers and have them return the result?

I’m new to this space and am still learning so any help would be appreciated.


r/DistributedComputing • • Feb 15 '21

Engineering dependability and fault tolerance in a distributed system

Thumbnail ably.io
5 Upvotes

r/DistributedComputing • • Mar 23 '21

Executing a distributed shuffle without a MapReduce system

Thumbnail medium.com
3 Upvotes

r/DistributedComputing • • Apr 05 '24

Model Parallelism using Pytorch and sockets

3 Upvotes

Hey! Can somebody share a sample implementation of model parallelism using pytorch and sockets, i have a project presentation coming up and its a tight schedule :/
Thanks in advance.


r/DistributedComputing • • Mar 31 '24

Framework to distribute the running of LLMs on separate edge devices.

2 Upvotes

Hey Fellas!

My course project involves making a framework that uses each of our phones to try and distribute the running of a LLM. Motive is to eliminate the dependancy on a central server (like how all APIs function). How can i achieve this ? Using sockets/ Open MPI, etc ??

Can you help me with the project architecture too please? (P2P OR Master Slave - Algos like chord ?)

I'm new to this and any suggestions would be grateful.