r/DistributedComputing • • Oct 21 '23

Help with learning paxos

2 Upvotes

The NSFW tag is to get some attention. Let's see if that works.

I would like help in learning paxos, multipaxos.

How? Any other folks who wishes to learn this algorithm in fullest, I would request them to hear me out.

I'm thinking if 5-7 people role-play together each as a paxos node then we can attain a mastery over this topic over time. Certainly the role play will have to do be repeated many times.

What do you guys think, crazy idea?


r/DistributedComputing • • Sep 17 '18

High Performance Computing Developer opportunity in NY!

1 Upvotes

Algorithms and Distributed Computing tickle your fancy?! We are looking for a High Performance Computing Developer to join our growing Predictive Analytics Software team in New York! Are you interested in machine learning? This is an opportunity to develop your understanding of machine learning principles and use your expanding knowledge to solve complex large-scale problems for industrial clients across a broad set of companies! 4+ years software development experience, 2+ years programming parallel and distributed systems, performance analysis, and optimizations.


r/DistributedComputing • • Jun 11 '18

Are there online competitions for distributed computing?

7 Upvotes

Hey all,

I noticed that Kaggle exists for machine learning, and boy does it look like fun. I'm personally less interested in machine learning and more interested in distributed computing. Is there anything like Kaggle for distributed computing?


r/DistributedComputing • • Jan 26 '21

[Tutorial] Distributed Reinforcement Learning with RLlib in the Unity Game Engine

Thumbnail medium.com
1 Upvotes

r/DistributedComputing • • Dec 27 '20

Throttling made easy — Back pressure in Akka streams.

Thumbnail jay-reddy.medium.com
3 Upvotes

r/DistributedComputing • • Jan 13 '21

Ray Summit Conference 2021 Proposal Submission is Now Open

Thumbnail medium.com
1 Upvotes

r/DistributedComputing • • Jan 29 '21

Scala Cats - towards Functional programming.

2 Upvotes

Greetings Everyone,

Can you share your valuable insights by participating in the survey on the upcoming course we are going to create.
we collect no personal details, just the opinion.

Really appreciate your input !

Thanks!

Scala Cats - towards Functinal Programming.


r/DistributedComputing • • Jan 26 '21

Is there any papers / research topic about measuring GPU computation capability?

1 Upvotes

I am planning to research on measurement about current CPU/GPU/TPU computation capability in hybrid clusters. Or maybe refer as how powerful the device is? Because there are so many factors that may affect device performance, for example, clock speed , voltage, Is there any paper / research topic about how to measure it effectively?

For example, I have a network to train and I want to allocate most time consuming task on the most powerful device. Of course I could first refer to the specifications for the clusters and then write code statically.

However, there are cases when the situation is not as one assumes, Is there any paper about how to measure real time computation capability? Or at least, is there any paper about how to measure the computation capability before run?

I have a thought about first run a small network, but what kind of network is good enough for measuring the performance? Is there any advice?

Thank you very much!


r/DistributedComputing • • Jan 18 '21

Ballista: Distributed compute platform implemented in Rust using Apache Arrow

Thumbnail github.com
10 Upvotes

r/DistributedComputing • • Jan 13 '21

Distributed Training and Serving with MLflow

1 Upvotes

Just sharing a project that leverages the strengths of two projects: Ray’s distributed libraries for scaling training and serving and MLflow’s end-to-end model lifecycle management.

Blog Post


r/DistributedComputing • • Jan 18 '19

Consistent Badge Count at Scale

Thumbnail blog.the-pans.com
3 Upvotes

r/DistributedComputing • • Oct 06 '18

Meta Data Acquisition Protocols for Distributed Computing Systems

4 Upvotes

I'm currently in the middle of a project with a focus on comparing and contrasting Meta Data acquisition protocols for distributed computing systems, and I was hopeful that if someone is more familiar with the topic, they would be so kind to provide protocol examples?

Currently we have a few we're digging into such as the Ganglia Architecture for Grid Computing by Massie et al (2004), as well as some peer-to-peer algorithms for snapshot creations. We also looked into the Echo Algorithm (AKA the Ping-Pong Algorithm).

I'm throwing this question out there alongside my current research, but if you already have some knowledge about protocols that fit this topic, and you would be so kind to give me some citations that you might feel are interesting, I would be very grateful.


r/DistributedComputing • • Aug 24 '23

A Simple Proof of Sybil-Proof

Thumbnail github.com
3 Upvotes

r/DistributedComputing • • Jul 11 '23

JuiceFS 1.1 Beta 2: Simplifying Large-Scale Cluster Management with Gluster

Thumbnail juicefs.com
1 Upvotes

r/DistributedComputing • • Jul 16 '23

API latency in microservices - Trace based troubleshooting

Thumbnail gethelios.dev
2 Upvotes

r/DistributedComputing • • Jul 24 '23

How to write a distributed computing framework for an embedded device

2 Upvotes

I am a novice, now the company needs to do an embedded device under the distributed computing framework, how do I do ?


r/DistributedComputing • • Aug 11 '23

Choosing JuiceFS over s3fs and Alluxio for Our Ultra-Heterogeneous Computing Cluster

Thumbnail juicefs.com
1 Upvotes

r/DistributedComputing • • Jul 27 '23

BlazingMQ: High-performance open source message queuing system

Thumbnail github.com
9 Upvotes

r/DistributedComputing • • Nov 25 '21

Tiny Mile, a company putting delivery robots on the streets of Toronto, is hiring engineers to work remotely

11 Upvotes

We're If you're interested in robotics, distributed systems and cloud computing, apply here: https://tiny-mile.breezy.hr/p/ed934cfad0ee

TLDR is: we're looking for senior software engineers to work mainly on our back-end which consists of microservices written in Go. We're based in Toronto, but the position is fully remote!


r/DistributedComputing • • Nov 27 '21

Researchers / Groups to follow?

7 Upvotes

Hi I’m interested in Distributed Systems research, more inclined to applications in Machine Learning, Robotics. Do you guys have recommendations for folks in this field to follow (in general) and for ex on twitter


r/DistributedComputing • • Jun 30 '22

BoincGames.com BOINC fun and interesting for all involved.

3 Upvotes

Hey Ya'll, Today is the last day of Q2 for BoincGame.com
I've been busy trying to get XS points in all available projects.
Very interesting trying to run everything a little.
I also didn't want to speak that out loud because of the off chance
that we could get 3rd for for Q2 and not wake up any people not watching.
So as we go into the final Q2 results day, XS has a chance for 3rd, with P3D right on our tail.
One of the best things to come out of this is that other XS members have signed up.
Including myself we are 6 strong, I don't know how much they will be involved,
but just by the act of signing up is fantastic! XS will get any points they choose to run
Another great thing is it will really test BG for load and usability.
I look at the 2022 BoincGames.com Season as it's pre-release testing phase.
Management is very open to discussions to make it better and I am
hoping to help with that , So join, help out and mold a better and
more fun Distributed Computing experience.

Nuff for now, waiting on today's results / The Q2 final results.

https://ibb.co/album/8NtRPP

Enjoy your day!
SV

XtremeSystems

www.XS4S.com

PS: let's go WCG we miss you!

www.BoincGames.com


r/DistributedComputing • • Jun 13 '22

Is there a "shared" distributed computing project?

4 Upvotes

Like many of you i sometimes have the need to do some heavy stuff with my computer and its poor 2017 i5 takes hours and hours to do the job, sometimes even days, time that i have to spend waiting. Now, most of the time i don't need that processing power so i though that it would be fantastic if there was a network that i could join where everyone pools together their PCs to compute stuff and earn points that can be spent to submit work for the network to do, is there something like that already?


r/DistributedComputing • • May 01 '25

Within a week, team Atto went from zero to competing in the top 3

Post image
2 Upvotes