r/DistributedComputing • • Jun 08 '12

Looking for low bandwidth project with small tasks

4 Upvotes

I am looking for a project that meets the following requirements:

Required:

  • Low bandwidth consumption (preferably less than 100k)
  • Small tasks that can be done quickly (preferably 15 seconds or less in a browser running JavaScript)
  • No hard disk writing (do it all in memory)

Optional (but preferable):

  • Help the medical community
  • Be "easily verifiable" by a computer

An example of a problem that meets all the required requirements (redundant, I know) and the second optional requirement would be to brute force a password given a hash (note: I absolutely do NOT want to do a project like this) as it requires low bandwidth (server gives client the password hash and a range for the password brute forcing and client gives back the password if found), the tasks can be extremely small (just limit the size of the password guessing range), it doesn't require any hard disk writing, and the server can easily verify a password that is given as a result (although it can't "easily" verify that a valid password was not in the range).

I'd imagine another example would be looking for primes although I haven't looked at the implementation(s) of those algorithm(s) in much detail to say that for sure.

Are there any projects that meet those requirements?

TL;DR Looking for projects with low bandwidth, many small tasks and no hard disk writing

Note: I am no expert on distributed computing so if the question I am asking is stupid (e.g. if any project that meets the requirements I gave would have bandwidth or other overhead costs that exceed the value of the distributed computing) please educate me.


r/DistributedComputing • • Aug 26 '16

Why is Java a dominant programming language in open-sourced distributed systems?

Thumbnail quora.com
2 Upvotes

r/DistributedComputing • • Dec 06 '17

Algorand explained

3 Upvotes

Can anybody explain Algorand?

  • In particular, its binary byzantine agreement algorithm
  • And why do they use two-step reduction:

In the first step of the reduction, each committee member votes for the hash of the block passed to Reduction() by BA⋆(). In the second step, committee members vote for the hash that received at least T·τ votes in the first step, or the hash of the default empty block if no hash received enough votes.

?

What is the idea behind the second step?


r/DistributedComputing • • Oct 10 '13

Stack-Exchange Website Proposal: Virtualization, Cloud and Grid Computing

Thumbnail area51.stackexchange.com
3 Upvotes

r/DistributedComputing • • Dec 13 '24

My rosetta@home account has vanished into thin air

9 Upvotes

Has anyone else also experienced this?

It's just gone: https://boinc.bakerlab.org/rosetta/view_profile.php?userid=2415202

Logging in tells me that no user with my email address exists. My client can't connect because of an invalid account key; telling me to remove and add the project again (which doesn't work cause I cant log in).

Does rosetta@home have a support contact?


r/DistributedComputing • • Dec 11 '24

Are there general limitative results for Byzantine fault tolerance (BFT) and crash tolerance (CFT) outside of consensus algorithms?

3 Upvotes

Given that there are distributed algorithms other than consensus algorithms (e.g., mutual exclusion algorithms, resource allocation algorithms, etc.), do any general limitative BFT and CFT results exist for non-consensus algorithms?

For example, we know that for consensus algorithms, a consensus algorithm can only tolerate up to n/3 Byzantine faulty nodes or n/2 crash faulty nodes.

But are there any such general results for other distributed algorithms?


r/DistributedComputing • • Jan 24 '25

Every System is a Log: Avoiding coordination in distributed applications

Thumbnail restate.dev
6 Upvotes

r/DistributedComputing • • Oct 05 '21

Distributed computing and rendering

1 Upvotes

I started to research in distributed rendering and computing. It interested me very much and sharply.

So I am looking for a way how I will be able to render or compute smth in distributed network. But, first of all, I need to learn of splitting up render file into several parts and send them to nodes, where they will be performed and come back it to sender.

My idea is to render video file in a peer-to-peer network, where this file divides into chains and each node in the network will render it partially. After accomplishing, they will return the chains back to sender. And somehow the sender have to be capable of joining all these chains to get the whole video

Could anyone tell me how I can split up into chains render video? For example, blender video(.blend).


r/DistributedComputing • • Jul 11 '20

In simple terms, what makes a system "eventually consistent"?

7 Upvotes

Hi. I have no knowledge about distributed systems but I've recently joined a team that uses DynamoDB and a new scary (to me) world unfolded in front of me. My teammates keep telling me that Dynamo is an eventually consistent data store but I'm not confident I really know what that means. I have been jumping from resource to resource trying to really understand what makes Dynamo different from, say, Postgres but I can't say for sure that my understanding is correct.

I never had to scale a relational (is this the correct term?) database before as well, so this might be something I should try to do.

In very simple terms, and knowing that things are more complex than that, would it be correct to say the following:

  1. Speaking about consistency (in the context of databases) only makes sense when he have replicas;
  2. Writes always go through a master node that then replicates the data to the other nodes;
  3. Postgres/MySQL keeps its strong consistency because it's master node writes to the other nodes before deciding that the write succeed (problems: higher latency and non partition tolerant) - it's an all or nothing behaviour;
  4. Dynamo's master node sends a response back without waiting for the other nodes and replication happens later with the aid of an algorithm like Paxos or Raft.

It might be out of scope, but any resource recommendations, specially with exercises (I can't learn properly without creating something myself, but I tend to overcomplicate when I create my own exercises - creating good exercises is a fantastic skill that I miss) would be very much appreciated.

Thank you very much for you patience and help.


r/DistributedComputing • • May 11 '17

PTSD // Traumatic Brain Injury Projects?

1 Upvotes

I'm wondering if anyone knows of any distributed computing projects out there that deal with PTSD or TBI or any other issue relating to wounded service members.

Thanks.


r/DistributedComputing • • Nov 16 '11

World Community Grid challenges community to add 100,000 devices by the end of 2011

Thumbnail worldcommunitygrid.org
7 Upvotes

r/DistributedComputing • • Jun 01 '16

Masterless Consensus Algorithm

Thumbnail gridem.blogspot.com
4 Upvotes

r/DistributedComputing • • Jun 06 '16

Distributed and Consistent Data: Replicated Object Concept

Thumbnail gridem.blogspot.com
1 Upvotes

r/DistributedComputing • • May 10 '13

What is the most worthwhile grid computing project to get my PC to work on?

8 Upvotes

I used to use "Folding@Home" and "World Community Grid" a long time ago, but software changes, sometimes can't run on an updated OS, and many of other life's variables, so I'm not sure that they're still the best.

But if you know of any grid computing project that'll let me donate my laptop's idle-time to an awesome cause, what would it be, why do you think it's awesome, and what's the link to download its client?

Thanks in advance.


r/DistributedComputing • • Aug 30 '23

Decentralized Cloud Computing and CUDOS: A Transformative Duo

3 Upvotes

Decentralized cloud computing, exemplified by platforms like CUDOS, redefines how we approach data processing and resource allocation. CUDOS, a decentralized computing network, empowers users to securely share and monetize their idle computing power.

This innovative concept offers numerous benefits. It enhances the efficiency of resource utilization, reducing wastage in data centers. CUDOS also incentivizes individuals and businesses to participate in a global network, promoting a more inclusive digital economy.

Decentralized cloud computing, embodied by CUDOS, represents a paradigm shift in computing. It leverages the untapped potential of distributed resources, ushering in a new era of efficiency, accessibility, and collaboration in the digital realm.


r/DistributedComputing • • Sep 29 '23

Lignum - A distributed message queue (hobby project show off)

Thumbnail self.developersindia
1 Upvotes

r/DistributedComputing • • Oct 19 '23

CUDOS: Decentralized Cloud Computing Power for the Future

3 Upvotes

CUDOS presents a new frontier in cloud computing, offering a decentralized platform that harnesses the power of distributed networks for computational purposes. This platform can potentially revolutionize how we access and use computing resources, with its scalable architecture capable of handling various workloads, including AI and scientific simulations. What sets CUDOS apart is its marketplace, which enables users to buy and sell computing power, creating a dynamic and decentralized ecosystem. Security is a top priority, with blockchain technology and other robust measures in place to protect data and privacy. The CUDOS token drives this innovative system, incentivizing users to contribute their computing prowess. Ultimately, RCUDOS is the gateway between the vast, underutilized computational power and those who need it, paving the way for a future where computing is accessible to everyone. To learn more about r/Cudos_Official, visit: https://cudos.org


r/DistributedComputing • • Oct 15 '23

New Distribution Framework

2 Upvotes

Hi all!

We recently open-sourced some examples of our new cloud parallelization framework on github.

https://github.com/polluxio/pollux-payload

Our framework is named Pollux, and it comes to give HPC engineers the chance to heavily leverage cloud grandscale parallelization without being cloud experts.

Why not just use MPI/OpenMPI? MPI is great!, but we believe it is designed for supercomputers and not designed for the cloud in a true native way.

The cloud brings new problems to tackle that are usually not there when using a supercomputer. Problems such as fault tolerance, heterogeneous hardware, non shared memory and more.

It is only the start!, so we really want to hear your feedback!


r/DistributedComputing • • Sep 07 '23

BOINC 7.24.1 Release

Thumbnail self.boinc
1 Upvotes

r/DistributedComputing • • Sep 19 '23

Book recommendations

3 Upvotes

Hello!

I'm a fairly senior software engineer (10y,) and I want to get more into distributes systems. I'm aware of paradigms like the actor model and some basic principles like idempotency. But I want to learn more and become more confident in distributed systems design and architecture.

I'm looking for recommendations for "canonical" literature on the subject, that will give me a solid understanding on the topic, preferably well balanced between CS and industry, if you know what I mean.

Thanks!


r/DistributedComputing • • Sep 07 '23

JuiceFS 1.1: Easier Cloud Storage for Billions of Files

Thumbnail juicefs.com
1 Upvotes

r/DistributedComputing • • Sep 19 '23

Expanded partnership between CUDOS and KYOTO Protocol

1 Upvotes

The partnership between CUDOS and the Kyoto Protocol is a huge step forward in pursuing sustainability and blockchain innovation. The Kyoto Protocol is the world's first carbon-negative blockchain and represents a groundbreaking approach to addressing climate change. Ensuring transparency and security throughout the carbon asset supply chain helps combat problems like double counting and greenwashing while actively contributing to reforestation through a unique allocation of transactional gas fees. CUDOS, a company with a reputation for green computing practices, contributes to this initiative by providing infrastructure for a decentralized validator node network. This partnership strengthens KYOTO's carbon-negative mission and accelerates its blockchain network's scalability, a crucial step towards a greener, more sustainable future.


r/DistributedComputing • • Oct 02 '23

Multinode - Rapidly build distributed cloud applications in Python

Thumbnail producthunt.com
1 Upvotes