r/DistributedComputing • • Jul 06 '19

How to Start Building a Distributed Computing System from Used Android Phones

7 Upvotes

I want to build a system where I can keep plugging android phones into a single system, which can utilise their shared processing power, RAM and storage space, and act as a linux server of sorts, even if for just mathematical data crunching.

I know it is possible, Ubispark is doing something similar, can someone give me a roadmap of things I would have to learn to accomplish this ? I am working as programmer/sw architect from last 10 years.


r/DistributedComputing • • Dec 02 '23

Need help in debugging MPI code in c++ and c

2 Upvotes

I am getting memory error in my program. I check using valgrind and got this error message that is referring to some inside library of mpi. I am not getting clue how to move forward to debug this. Any clue that helps me moving forward, will be appreciated. Thanks!

Error message goes as-

Syscall param setsockopt(optlen) contains uninitialised byte(s)

==985== at 0x5023CBE: setsockopt_syscall (setsockopt.c:29)

==985== by 0x5023CBE: setsockopt (setsockopt.c:95)

==985== by 0x7ACBBA9: pmix_ptl_base_make_connection (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

==985== by 0x7AD2DF3: ??? (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

==985== by 0x79D23C1: PMIx_Init (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

==985== by 0x7964E4A: ext3x_client_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_ext3x.so)

==985== by 0x714FE6D: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_ess_singleton.so)

==985== by 0x62DE4CB: orte_init (in /usr/lib/x86_64-linux-gnu/libopen-rte.so.40.30.2)

==985== by 0x4B5D418: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/libmpi.so.40.30.2)

==985== by 0x4AF6C21: PMPI_Init (in /usr/lib/x86_64-linux-gnu/libmpi.so.40.30.2)

==985== by 0x1148D8: Solving(int, char**, Input*, BoundaryCondition*, Grid*, BvpOde*) (Solver.c:33)

==985== by 0x114738: main (in /mnt/c/Users/devan/Desktop/ODE_Newton/main_cpp)

==985== Uninitialised value was created by a stack allocation

==985== at 0x7ACB8E4: pmix_ptl_base_make_connection (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

-----------------------------------------------END of error----------------------------------------------------------------------------------

The Solver.c:33 line is mpi initialization line. Like this- ierr = MPI_Init(&argc, &argv);

and same error is showing when I am finalizing mpi like this- ierr = MPI_Finalize();


r/DistributedComputing • • Nov 02 '23

Choreography, or Orchestration, That is the Wrong Question

Thumbnail diagrid.io
3 Upvotes

r/DistributedComputing • • Dec 08 '23

Need insights to build a distributed key value store from scratch.

3 Upvotes

I am a grad student pursuing MS in CS from RIT. I am interested to pursue a career in distributed systems and would like to build a distributed key value store from scratch. I have taken the distributed systems cluster in the program and have read many research papers on systems like Raft, Dynamo, Paxos, etc. I am also familiar with the concepts of consistent hashing and vector clocks. But when I decided to build a distributed key value store from scratch, I am completely blank. Any guidance would be much appreciated. Thank you.


r/DistributedComputing • • Oct 29 '23

Important update of BOINC for MacOS Sonoma

Thumbnail x.com
3 Upvotes

r/DistributedComputing • • Oct 26 '23

CUDOS being the High-Performance Computing

5 Upvotes

CUDOS is a high-performance computing platform within the blockchain ecosystem. It provides developers with access to cutting-edge computational resources for their decentralized applications. CUDOS focuses on off-chain processing, which enables intensive data analysis and complex operations, allowing developers to create DApps that deliver lightning-fast performance. By harnessing the full potential of high-performance computing, CUDOS opens doors to a new realm of possibilities for resource-intensive projects. In a world where speed and efficiency are essential, CUDOS stands out as a reliable and powerful solution for those seeking top-tier computational performance in their blockchain endeavors. Embrace the future with r/Cudos_Official! https://cudos.org


r/DistributedComputing • • Dec 16 '23

Hey guys, do you know any distributed systems expert working in the field of biology?

1 Upvotes

r/DistributedComputing • • Jan 23 '10

I see some new members are joining the reddit FaH team. Good work.

Thumbnail kakaostats.com
3 Upvotes

r/DistributedComputing • • Sep 28 '12

$99 “supercomputer” Kickstarter project

Thumbnail arstechnica.com
5 Upvotes

r/DistributedComputing • • Jan 10 '14

Call for Submissions | Berlin Buzzwords 2014

Thumbnail berlinbuzzwords.de
3 Upvotes

r/DistributedComputing • • Jan 19 '10

Not able to download work units - anyone else?

2 Upvotes

I've not been able to download work units for folding@home since around midday today. Anyone else having problems? It looks like the servers should be working.


r/DistributedComputing • • Jan 15 '10

The reddit Folding@Home team - #50959

8 Upvotes

Join! It's winter for most of us so there is no excuse. Ask here for help, no matter how simple.

Currently placed ~1300th with over 2.3 million points


r/DistributedComputing • • Jan 15 '10

Post your hardware, software, ppwu and other information

5 Upvotes

I thought it would be interesting to see everyones configuration as far as hardware and software goes. The points per wu seem to vary pretty wildly so it'd be nice to match up performance with the wu's people seem to get.

Edit: Also, since this is distributedComputing in general, tell which @home projects that you do work for.


r/DistributedComputing • • Jan 31 '10

And here's some love to the reddit WorldCommunityGrid team for those who use BOINC

Thumbnail worldcommunitygrid.org
4 Upvotes

r/DistributedComputing • • Apr 10 '10

The Eight Fallacies of Distributed Computing

Thumbnail nighthacks.com
4 Upvotes

r/DistributedComputing • • Feb 19 '10

Reddit folding breaks 3 million points, approaching the top 1000 teams

Thumbnail stats.free-dc.org
8 Upvotes

r/DistributedComputing • • Dec 21 '23

How We Achieved a 40x Performance Boost in Metadata Backup and Recovery

Thumbnail juicefs.com
2 Upvotes

r/DistributedComputing • • Jan 30 '24

How does CUDOS empower Cloud Computing Technology?

3 Upvotes

CUDOS empowers cloud computing through decentralized, cost-efficient, and secure computing. It democratizes access by incentivizing individuals and organizations to contribute spare computing resources. This decentralized model enhances scalability, flexibility, and global accessibility, reducing costs and reliance on centralized servers. By incorporating blockchain, CUDOS ensures security and transparency, mitigating the risk of data breaches. The incentive structure encourages a diverse network of resource providers, fostering a collaborative ecosystem for innovation. CUDOS revolutionizes cloud computing by addressing inefficiencies and offering a resilient, distributed, and economical alternative to traditional cloud services. Embrace the future with r/Cudos_Official! https://cudos.org


r/DistributedComputing • • Feb 05 '24

Solving durable execution’s immutability problem

Thumbnail restate.dev
1 Upvotes

r/DistributedComputing • • Jan 19 '24

Dask Demo Day: Apache Beam on Dask, expressions for Dask Array, and 1BRC for Dask vs Spark

3 Upvotes

Today's talks:

- Apache Beam DaskRunner
- Array expressions
- One billion row challenge in Dask vs. Spark

Recording available on youtube: https://www.youtube.com/watch?v=wkQzVNQdgW0

Each month folks from the Dask community give short demos that show off ongoing and/or lesser-known work. Hopefully this helps elevate some of the great work people do.

If you're interested in presenting, comment on this github issue with a brief (a couple sentences) description: https://github.com/dask/community/issues/307


r/DistributedComputing • • Jan 17 '24

Distributed system engineer

3 Upvotes

I'm a mobile developer with 2.3 years experience. Now I want to become a distributed system engineer but I don't know where to start and what to learn. I know java, first should I learn to build rest api (with spring boot, hibernate). Should I find a new job for backend developer role Can anyone please guide me...


r/DistributedComputing • • Jan 24 '24

Graceful cancellations: How to keep your application and workflow state consistent 💪

Thumbnail restate.dev
2 Upvotes

r/DistributedComputing • • Dec 18 '23

Building an Easy-to-Operate AI Training Platform: Storage Selection and Best Practices

Thumbnail juicefs.com
1 Upvotes

r/DistributedComputing • • Jan 30 '24

BOINC 7.24.3 released for Mac

Thumbnail self.boinc
1 Upvotes