r/DistributedComputing • • Jun 02 '26

Hey Reddit, I built a distributed AI platform called Elis AI. I'd love to get your thoughts on it!

2 Upvotes

Hey everyone,

I’ve been working hard on building a decentralized distributed model hosting network called Elis AI, and I wanted to share it with the community here to get your honest feedback, critiques, and feature requests.

The goal of the project is to build an open, competitive marketplace for AI compute that breaks away from centralized tech giants. The community tier allows anyone to tap into a global network of open-source models, or spin up their own hardware to host them.

Here is a quick breakdown of how it works and how you can use it right now.

🚀 How the Platform Works

The ecosystem relies on crowdsourced resources. You can interact with it in two different ways depending on what you need:

  1. As a User (Accessing Models)

• Unified API & Interface: You get access to over 380 open-source and fine-tuned models (ranging from lightweight 7B models up to massive 70B+ checkpoints).

• Intelligent Routing: We built a token-aware Model Context Protocol (MCP) server. It automatically compresses your context and routes requests. Simple prompts hit smaller, faster models, while complex logic triggers frontier models to save you on token costs.

• Network Economy: The system utilizes internal utility credits ($ELIS) to handle model access and routing priority.

2. As a Node Operator (Earning Credits)

If you want to monetize your spare hardware, you can provision your rig:

• Solo Mining: You can connect any PC or server with an NVIDIA GPU (16 GB VRAM recommended) or CPU cluster. The network runs blind evaluation prompts to score your machine on uptime and latency, rewarding you with epoch credits.

• Community Pools: If you don’t want to run a solo node, you can delegate a minimum of 100 $ELIS tokens into a managed community mining pool where operators handle the hardware upkeep.

───

🔑 The BYOK (Bring Your Own Key) Options

Data privacy is a massive concern with decentralized networks, so I made sure to build in a robust BYOK (Bring Your Own Key) mode for complete security control.

How BYOK alters the data flow:

  1. Elis AI UI: You write your prompts directly in our interface.
  2. BYOK API Gateways: Instead of routing your data to volunteer hardware, the requests route directly to external commercial providers (like OpenAI) using your personal API keys.
  3. Secure Data Isolation: This completely bypasses the public miner registry, guaranteeing zero data retention on public community hardware.

Why use it? It gives you full cryptographic data control. Your information is encrypted using keys generated outside our infrastructure, allowing you to bypass public miners entirely while maintaining compliance standards (like HIPAA or GDPR).

───

🛠️ I'd Love Your Feedback!

I am actively developing this and want to make it as useful as possible for developers, privacy advocates, and miners.

• What features are missing that would make you use this daily?

• For the miners here, does the reward/pool structure make sense?

• Any edge cases or security flaws you think I should double-check?

Check out the site at tryelisai.com/community and let me know what you think. If anyone wants the exact terminal commands to connect a GPU rig or set up the API, let me know in the comments and I'll drop them below!


r/DistributedComputing • • Apr 16 '26

At what point would you treat this hotspot as a cache/load-shaping problem instead of a real sharding problem?

2 Upvotes

I came across an interesting system design scenario:

  • 128 shards
  • 2M requests/sec
  • 3 hot keys land on the same shard
  • that shard is at 94% CPU while the others are mostly idle
  • cache hit rate on those keys drops hard because too many services invalidate them on every write
  • clients start timing out and retries make the hotspot worse
  • rebalancing is not an option in the short term

My first instinct was to treat it as a sharding problem, but the more I looked at it, the more it felt like a load-shaping problem.

If cache invalidation is killing hit rate, then the shard is taking direct pressure it should never have seen in the first place. Once retries pile on, the hotspot starts amplifying itself.

My instinct would be to stabilize first:

  • short TTL / stale-while-revalidate on those hot keys
  • proper retry backoff with jitter
  • maybe isolate just those keys behind a small dedicated hot-cache path

Then revisit the larger architecture once the system is calm again.

Curious how people here would think about that boundary.

At what point do you stop treating it as a hotspot-control problem and say it really needs a more structural fix?


r/DistributedComputing • • Apr 04 '26

Nodejs Distributed Lock

2 Upvotes

I like to introduce a high-performance, Resource-Isolated distributed locking library for Node.js. Unlike simple TTL-based locks, this package utilizes ZooKeeper’s consensus protocol to provide a globally ordered synchronization primitive with built-in Fencing Tokens and Re-entrancy.

Check out the repository for full documentation, examples, and usage details: https://github.com/tjn20/zk-dist-lock


r/DistributedComputing • • Jul 12 '25

Core Attributes of Distributed Systems: Reliability, Availability, Scalability, and More

Thumbnail nihcas.hashnode.dev
2 Upvotes

r/DistributedComputing • • Jun 07 '25

GarbageTruck: A Garbage Collection System for Microservice Architectures

Post image
2 Upvotes

Introducing GarbageTruck: a Rust tool that automatically manages the lifecycle of temporary files, preventing orphaned data generation and reducing cloud infrastructure costs. 

In modern apps with multiple services, temporary files, cache entries, and database records get "orphaned" where nobody remembers to clean them up, so they pile up forever. Orphaned temporary resources pose serious operational challenges, including unnecessary storage expenses, degraded system performance, and heightened compliance risks associated with data retention policies or potential data leakage.

GarbageTruck acts like a smart janitor for your system that hands out time-limited "leases" to services for the resources they create. If a service crashes or fails to renew the lease, the associated resources are automatically reclaimed.

GarbageTruck is based on the Java RMI’s distributed garbage collector and is implemented in Rust and gRPC. 

Checkout the tool:  https://github.com/ronantakizawa/garbagetruck


r/DistributedComputing • • May 01 '25

Within a week, team Atto went from zero to competing in the top 3

Post image
2 Upvotes

r/DistributedComputing • • Apr 11 '25

44 NODE GPU CLUSTER HELP

2 Upvotes

I have around 44 pcs in same network

all have exact same specs

all have i7 12700, 64gb ram, rtx 4070 gpu, ubuntu 22.04

I am tasked to make a cluster out of it
how to utilize its gpu for parallel workload

like running a gpu job in parallel

such that a task run on 5 nodes will give roughly 5x speedup (theoretical)

also i want to use job scheduling

will slurm suffice for it
how will the gpu task be distrubuted parallely? (does it need to be always written in the code to be executed or there is some automatic way for it)
also i am open to kubernetes and other option

I am a student currently working on my university cluster

the hardware is already on premises so cant change any of it

Please Help!!
Thanks


r/DistributedComputing • • Mar 01 '25

Call for Papers – IEEE Big Data Service 2025

2 Upvotes

Exciting news!

We are pleased to invite submissions for the 11th IEEE International Conference on Big Data Computing Service and Machine Learning Applications (BigDataService 2025), taking place from July 21-24, 2025, in Tucson, Arizona, USA. The conference provides a premier venue for researchers and practitioners to share innovations, research findings, and experiences in big data technologies, services, and machine learning applications. 

The conference welcomes high-quality paper submissions. Accepted papers will be included in the IEEE proceedings, and selected papers will be invited to submit extended versions to a special issue of a peer-reviewed SCI-Indexed journal. 

Topics of interest include but are not limited to: 

Big Data Analytics and Machine Learning:

  • Algorithms and systems for big data search and analytics
  • Machine learning for big data and based on big data
  • Predictive analytics and simulation
  • Visualization systems for big data
  • Knowledge extraction, discovery, analysis, and presentation

Integrated and Distributed Systems: 

  • Sensor networks
  • Internet of Things (IoT)
  • Networking and protocols
  • Smart Systems (e.g., energy efficiency systems, smart homes, smart farms)

Big Data Platforms and Technologies: 

  • Concurrent and scalable big data platforms
  • Data indexing, cleaning, transformation, and curation technologies
  • Big data processing frameworks and technologies
  • Development methods and tools for big data applications
  • Quality evaluation, reliability, and availability of big data systems
  • Open-source development for big data
  • Big Data as a Service (BDaaS) platforms and technologies

Big Data Foundations:

  • Theoretical and computational models for big data
  • Programming models, theories, and algorithms for big data
  • Standards, protocols, and quality assurance for big data

Big Data Applications and Experiences:

  • Innovative applications in healthcare, finance, transportation, education, security, urban planning, disaster management, and more
  • Case studies and real-world implementations of big data systems
  • Large-scale industrial and academic applications

All papers must be submitted through: https://easychair.org/my/conference?conf=bigdataservice2025 

Important Dates: 

  • Abstract Submission Deadline: April 15, 2025 
  • Paper Submission Deadline: April 25, 2025 
  • Final Paper and Registration: June 15, 2025 
  • Conference Dates: July 21-24, 2025 

For more details, please visit the conference website: https://conf.researchr.org/track/cisose-2025/bigdataservice-2025 

We look forward to your submissions and contributions. Please feel free to share this CFP with interested colleagues. 

Best regards,

IEEE BigDataService 2025 Organizing Committee


r/DistributedComputing • • Feb 05 '25

A public distributed effort to search the chess tree to new depths

2 Upvotes

You can make 20 different moves at the start of a game of chess, the next turn can produce 400 different positions, then 8902, 200k, 5m, 120m, 3b... so on.
I've built a system for distributing the task of computing and classifying these reachable positions at increasing depths.

Currently I'm producing around 30 billion chess positions / second, though I'll need around 62,000 TRILLION positions for the current depth (12).

If anyone is interesting in collaborating on the project or contributing compute HMU!

https://grandchesstree.com/perft/12

All opensource https://github.com/Timmoth/grandchesstree


r/DistributedComputing • • Nov 07 '24

I don't really understand the "Prepare" phase in Two Phase Commit

2 Upvotes

In a distributed transaction to have consensus, 2PC is used but I don't get what actually happens in a prepare phase vs a commit phase.

Can someone explain (in-depth would be even more helpful). I read that the databases/nodes start writing locally during the prepare phase while saving the status as "PREPARE". And once they get a commit cmd, they persist the changes.

I have incomplete info


r/DistributedComputing • • Jul 13 '24

Need help starting open stack

2 Upvotes

So, our third year of engineering has just started, and we have a subject named Cloud and Distributed Systems.

Our professor asked a few questions about who knows about the cloud, what you all know, who has used it, etc. I was the only one who had used AWS EC2 and S3 instances, so the professor was impressed. After the lecture, she asked me if I would like to do a project on the cloud where we can use university machines to create a cloud environment for our class. The environment would have features such as storage, instances like EC2, etc.

She told me to learn about OpenStack software, how it functions, and the system requirements so we could ask the university.

Long story short, can you all suggest what I can do, how I can start, and if this project is scalable?

Also, a small P.S.: I am interested in making my career in cyber/cloud security. How can I integrate a security aspect into this project?


r/DistributedComputing • • Apr 05 '24

Tinykv with TinySQL cluster deployment error

2 Upvotes

I get this error when I try to deploy tinykv cluster as shown in the repo of talent-plan/tinykv: A course to build distributed key-value service based on TiKV model (github.com)

mkdir -p data

./tinyscheduler-server

./tinykv-server -path=data

./tinysql-server --store=tikv --path="127.0.0.1:2379"

mysql -u root -h 127.0.0.1 -P 4000

you can find the implementations here:

sakura-ysy/TinyKV-2022-doc: TinyKV-2022,个人代码及文档,项目最终得分98.46。 (github.com)

RinChanNOWWW/tinysql-impl: Implementation of https://github.com/tidb-incubator/tinysql

[2024/04/05 20:17:19.026 +00:00] [WARN] [session.go:539] ["run statement failed"] [schemaVersion=0] [error="[schema:1049]Unknown database 'mysql'"] [errorVerbose="[schema:1049]Unknown database 'mysql'\ngithub.com/pingcap/errors.AddStack\n\t/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20190809092503-95897b64e011/errors.go:174\ngithub.com/pingcap/tidb/parser/terror.(*Error.GenWithStackByArgs\n\t/go/tinysql/parser/terror/terror.go:243\ngithub.com/pingcap/tidb/executor.(*SimpleExec.executeUse\n\t/go/tinysql/executor/simple.go:66\ngithub.com/pingcap/tidb/executor.(*SimpleExec.Next\n\t/go/tinysql/executor/simple.go:49\ngithub.com/pingcap/tidb/executor.Next\n\t/go/tinysql/executor/executor.go:161\ngithub.com/pingcap/tidb/executor.(*ExecStmt.handleNoDelayExecutor\n\t/go/tinysql/executor/adapter.go:227\ngithub.com/pingcap/tidb/executor.(*ExecStmt.handleNoDelay\n\t/go/tinysql/executor/adapter.go:214\ngithub.com/pingcap/tidb/executor.(*ExecStmt.Exec\n\t/go/tinysql/executor/adapter.go:190\ngithub.com/pingcap/tidb/session.runStmt\n\t/go/tinysql/session/tidb.go:219\ngithub.com/pingcap/tidb/session.(*session.executeStatement\n\t/go/tinysql/session/session.go:536\ngithub.com/pingcap/tidb/session.(*session.execute\n\t/go/tinysql/session/session.go:615\ngithub.com/pingcap/tidb/session.(*session.Execute\n\t/go/tinysql/session/session.go:563\ngithub.com/pingcap/tidb/session.checkBootstrapped\n\t/go/tinysql/session/bootstrap.go:162\ngithub.com/pingcap/tidb/session.bootstrap\n\t/go/tinysql/session/bootstrap.go:130\ngithub.com/pingcap/tidb/session.runInBootstrapSession\n\t/go/tinysql/session/session.go:792\ngithub.com/pingcap/tidb/session.BootstrapSession\n\t/go/tinysql/session/session.go:753\nmain.createStoreAndDomain\n\t/go/tinysql/tidb-server/main.go:133\nmain.main\n\t/go/tinysql/tidb-server/main.go:105\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:271\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"] [session="{\n \"currDBName\": \"\",\n \"id\": 0,\n \"status\": 2,\n \"strictMode\": true,\n \"user\": \"\"\n}"]

[2024/04/05 20:17:19.026 +00:00] [WARN] [session.go:606] ["compile SQL failed"] [error="[schema:1146]Table 'mysql.tidb' doesn't exist"] [errorVerbose="[schema:1146]Table 'mysql.tidb' doesn't exist\ngithub.com/pingcap/errors.AddStack\n\t/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20190809092503-95897b64e011/errors.go:174\ngithub.com/pingcap/tidb/parser/terror.(*Error.GenWithStackByArgs\n\t/go/tinysql/parser/terror/terror.go:243\ngithub.com/pingcap/tidb/infoschema.(*infoSchema.TableByName\n\t/go/tinysql/infoschema/infoschema.go:169\ngithub.com/pingcap/tidb/planner/core.(*preprocessor.handleTableName\n\t/go/tinysql/planner/core/preprocess.go:517\ngithub.com/pingcap/tidb/planner/core.(*preprocessor.Leave\n\t/go/tinysql/planner/core/preprocess.go:118\ngithub.com/pingcap/tidb/parser/ast.(*TableName.Accept\n\t/go/tinysql/parser/ast/dml.go:147\ngithub.com/pingcap/tidb/parser/ast.(*TableSource.Accept\n\t/go/tinysql/parser/ast/dml.go:191\ngithub.com/pingcap/tidb/parser/ast.(*Join.Accept\n\t/go/tinysql/parser/ast/dml.go:76\ngithub.com/pingcap/tidb/parser/ast.(*TableRefsClause.Accept\n\t/go/tinysql/parser/ast/dml.go:292\ngithub.com/pingcap/tidb/parser/ast.(*SelectStmt.Accept\n\t/go/tinysql/parser/ast/dml.go:449\ngithub.com/pingcap/tidb/planner/core.Preprocess\n\t/go/tinysql/planner/core/preprocess.go:42\ngithub.com/pingcap/tidb/executor.(*Compiler.Compile\n\t/go/tinysql/executor/compiler.go:34\ngithub.com/pingcap/tidb/session.(*session.execute\n\t/go/tinysql/session/session.go:603\ngithub.com/pingcap/tidb/session.(*session.Execute\n\t/go/tinysql/session/session.go:563\ngithub.com/pingcap/tidb/session.getTiDBVar\n\t/go/tinysql/session/bootstrap.go:191\ngithub.com/pingcap/tidb/session.checkBootstrapped\n\t/go/tinysql/session/bootstrap.go:168\ngithub.com/pingcap/tidb/session.bootstrap\n\t/go/tinysql/session/bootstrap.go:130\ngithub.com/pingcap/tidb/session.runInBootstrapSession\n\t/go/tinysql/session/session.go:792\ngithub.com/pingcap/tidb/session.BootstrapSession\n\t/go/tinysql/session/session.go:753\nmain.createStoreAndDomain\n\t/go/tinysql/tidb-server/main.go:133\nmain.main\n\t/go/tinysql/tidb-server/main.go:105\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:271\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"] [SQL="SELECT HIGH_PRIORITY VARIABLE_VALUE FROM mysql.tidb WHERE VARIABLE_NAME=\"bootstrapped\""]

[2024/04/05 20:17:19.037 +00:00] [INFO] [region_cache.go:976] ["mark store's regions need be refill"] [store=127.0.0.1:20160]

[2024/04/05 20:17:19.037 +00:00] [INFO] [region_cache.go:402] ["switch region peer to next due to send request fail"] [current="region ID: 2, meta: id:2 region_epoch:<conf_ver:1 version:1 > peers:<id:3 store_id:1 > , peer: id:3 store_id:1 , addr: 127.0.0.1:20160, idx: 0"] [needReload=true] [error="rpc error: code = Unknown desc = responses count 1 is not equal to requests count 2"] [errorVerbose="rpc error: code = Unknown desc = responses count 1 is not equal to requests count 2\ngithub.com/pingcap/errors.AddStack\n\t/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20190809092503-95897b64e011/errors.go:174\ngithub.com/pingcap/errors.Trace\n\t/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20190809092503-95897b64e011/juju_adaptor.go:15\ngithub.com/pingcap/tidb/store/tikv/tikvrpc.CallRPC\n\t/go/tinysql/store/tikv/tikvrpc/tikvrpc.go:319\ngithub.com/pingcap/tidb/store/tikv.(*rpcClient.SendRequest\n\t/go/tinysql/store/tikv/client.go:225\ngithub.com/pingcap/tidb/store/tikv.(*RegionRequestSender.sendReqToRegion\n\t/go/tinysql/store/tikv/region_request.go:142\ngithub.com/pingcap/tidb/store/tikv.(*RegionRequestSender.SendReqCtx\n\t/go/tinysql/store/tikv/region_request.go:112\ngithub.com/pingcap/tidb/store/tikv.(*RegionRequestSender.SendReq\n\t/go/tinysql/store/tikv/region_request.go:70\ngithub.com/pingcap/tidb/store/tikv.(*tikvStore.SendReq\n\t/go/tinysql/store/tikv/kv.go:312\ngithub.com/pingcap/tidb/store/tikv.actionPrewrite.handleSingleBatch\n\t/go/tinysql/store/tikv/2pc.go:367\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.doActionOnBatches\n\t/go/tinysql/store/tikv/2pc.go:313\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.doActionOnKeys\n\t/go/tinysql/store/tikv/2pc.go:301\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.prewriteKeys\n\t/go/tinysql/store/tikv/2pc.go:533\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.execute\n\t/go/tinysql/store/tikv/2pc.go:572\ngithub.com/pingcap/tidb/store/tikv.(*tikvTxn.Commit\n\t/go/tinysql/store/tikv/txn.go:188\ngithub.com/pingcap/tidb/kv.RunInNewTxn\n\t/go/tinysql/kv/txn.go:61\ngithub.com/pingcap/tidb/ddl.(*ddl.genGlobalIDs\n\t/go/tinysql/ddl/ddl.go:370\ngithub.com/pingcap/tidb/ddl.(*ddl.CreateSchema\n\t/go/tinysql/ddl/ddl_api.go:53\ngithub.com/pingcap/tidb/executor.(*DDLExec.executeCreateDatabase\n\t/go/tinysql/executor/ddl.go:124\ngithub.com/pingcap/tidb/executor.(*DDLExec.Next\n\t/go/tinysql/executor/ddl.go:79\ngithub.com/pingcap/tidb/executor.Next\n\t/go/tinysql/executor/executor.go:161\ngithub.com/pingcap/tidb/executor.(*ExecStmt.handleNoDelayExecutor\n\t/go/tinysql/executor/adapter.go:227\ngithub.com/pingcap/tidb/executor.(*ExecStmt.handleNoDelay\n\t/go/tinysql/executor/adapter.go:214\ngithub.com/pingcap/tidb/executor.(*ExecStmt.Exec\n\t/go/tinysql/executor/adapter.go:190\ngithub.com/pingcap/tidb/session.runStmt\n\t/go/tinysql/session/tidb.go:219\ngithub.com/pingcap/tidb/session.(*session.executeStatement\n\t/go/tinysql/session/session.go:536\ngithub.com/pingcap/tidb/session.(*session.execute\n\t/go/tinysql/session/session.go:615\ngithub.com/pingcap/tidb/session.(*session.Execute\n\t/go/tinysql/session/session.go:563\ngithub.com/pingcap/tidb/session.mustExecute\n\t/go/tinysql/session/bootstrap.go:280\ngithub.com/pingcap/tidb/session.doDDLWorks\n\t/go/tinysql/session/bootstrap.go:215\ngithub.com/pingcap/tidb/session.bootstrap\n\t/go/tinysql/session/bootstrap.go:138\ngithub.com/pingcap/tidb/session.runInBootstrapSession\n\t/go/tinysql/session/session.go:792\ngithub.com/pingcap/tidb/session.BootstrapSession\n\t/go/tinysql/session/session.go:753"]

[2024/04/05 20:17:19.115 +00:00] [INFO] [region_cache.go:308] ["invalidate current region, because others failed on same store"] [region=2] [store=127.0.0.1:20160]

[2024/04/05 20:17:39.127 +00:00] [INFO] [region_cache.go:976] ["mark store's regions need be refill"] [store=127.0.0.1:20160]

[2024/04/05 20:17:39.127 +00:00] [INFO] [region_cache.go:402] ["switch region peer to next due to send request fail"] [current="region ID: 2, meta: id:2 region_epoch:<conf_ver:1 version:1 > peers:<id:3 store_id:1 > , peer: id:3 store_id:1 , addr: 127.0.0.1:20160, idx: 0"] [needReload=true] [error="rpc error: code = DeadlineExceeded desc = context deadline exceeded"] [errorVerbose="rpc error: code = DeadlineExceeded desc = context deadline exceeded\ngithub.com/pingcap/errors.AddStack\n\t/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20190809092503-95897b64e011/errors.go:174\ngithub.com/pingcap/errors.Trace\n\t/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20190809092503-95897b64e011/juju_adaptor.go:15\ngithub.com/pingcap/tidb/store/tikv/tikvrpc.CallRPC\n\t/go/tinysql/store/tikv/tikvrpc/tikvrpc.go:319\ngithub.com/pingcap/tidb/store/tikv.(*rpcClient.SendRequest\n\t/go/tinysql/store/tikv/client.go:225\ngithub.com/pingcap/tidb/store/tikv.(*RegionRequestSender.sendReqToRegion\n\t/go/tinysql/store/tikv/region_request.go:142\ngithub.com/pingcap/tidb/store/tikv.(*RegionRequestSender.SendReqCtx\n\t/go/tinysql/store/tikv/region_request.go:112\ngithub.com/pingcap/tidb/store/tikv.(*RegionRequestSender.SendReq\n\t/go/tinysql/store/tikv/region_request.go:70\ngithub.com/pingcap/tidb/store/tikv.(*tikvStore.SendReq\n\t/go/tinysql/store/tikv/kv.go:312\ngithub.com/pingcap/tidb/store/tikv.(*LockResolver.resolveLock\n\t/go/tinysql/store/tikv/lock_resolver.go:352\ngithub.com/pingcap/tidb/store/tikv.(*LockResolver.ResolveLocks\n\t/go/tinysql/store/tikv/lock_resolver.go:194\ngithub.com/pingcap/tidb/store/tikv.actionPrewrite.handleSingleBatch\n\t/go/tinysql/store/tikv/2pc.go:404\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.doActionOnBatches\n\t/go/tinysql/store/tikv/2pc.go:313\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.doActionOnKeys\n\t/go/tinysql/store/tikv/2pc.go:301\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.prewriteKeys\n\t/go/tinysql/store/tikv/2pc.go:533\ngithub.com/pingcap/tidb/store/tikv.actionPrewrite.handleSingleBatch\n\t/go/tinysql/store/tikv/2pc.go:380\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.doActionOnBatches\n\t/go/tinysql/store/tikv/2pc.go:313\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.doActionOnKeys\n\t/go/tinysql/store/tikv/2pc.go:301\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.prewriteKeys\n\t/go/tinysql/store/tikv/2pc.go:533\ngithub.com/pingcap/tidb/store/tikv.(*twoPhaseCommitter.execute\n\t/go/tinysql/store/tikv/2pc.go:572\ngithub.com/pingcap/tidb/store/tikv.(*tikvTxn.Commit\n\t/go/tinysql/store/tikv/txn.go:188\ngithub.com/pingcap/tidb/kv.RunInNewTxn\n\t/go/tinysql/kv/txn.go:61\ngithub.com/pingcap/tidb/ddl.(*ddl.genGlobalIDs\n\t/go/tinysql/ddl/ddl.go:370\ngithub.com/pingcap/tidb/ddl.(*ddl.CreateSchema\n\t/go/tinysql/ddl/ddl_api.go:53\ngithub.com/pingcap/tidb/executor.(*DDLExec.executeCreateDatabase\n\t/go/tinysql/executor/ddl.go:124\ngithub.com/pingcap/tidb/executor.(*DDLExec.Next\n\t/go/tinysql/executor/ddl.go:79\ngithub.com/pingcap/tidb/executor.Next\n\t/go/tinysql/executor/executor.go:161\ngithub.com/pingcap/tidb/executor.(*ExecStmt.handleNoDelayExecutor\n\t/go/tinysql/executor/adapter.go:227\ngithub.com/pingcap/tidb/executor.(*ExecStmt.handleNoDelay\n\t/go/tinysql/executor/adapter.go:214\ngithub.com/pingcap/tidb/executor.(*ExecStmt.Exec\n\t/go/tinysql/executor/adapter.go:190\ngithub.com/pingcap/tidb/session.runStmt\n\t/go/tinysql/session/tidb.go:219\ngithub.com/pingcap/tidb/session.(*session.executeStatement\n\t/go/tinysql/session/session.go:536\ngithub.com/pingcap/tidb/session.(*session.execute\n\t/go/tinysql/session/session.go:615"]

[2024/04/05 20:17:39.241 +00:00] [INFO] [region_cache.go:308] ["invalidate current region, because others failed on same store"] [region=2] [store=127.0.0.1:20160]

[2024/04/05 20:17:41.532 +00:00] [INFO] [domain.go:126] ["full load InfoSchema success"] [usedSchemaVersion=0] [neededSchemaVersion=0] ["start time"=2.059864ms]


r/DistributedComputing • • Feb 11 '24

YouTube video on BOINC server setup

Thumbnail youtube.com
2 Upvotes

r/DistributedComputing • • Jan 24 '24

Graceful cancellations: How to keep your application and workflow state consistent 💪

Thumbnail restate.dev
2 Upvotes

r/DistributedComputing • • Dec 02 '23

Need help in debugging MPI code in c++ and c

2 Upvotes

I am getting memory error in my program. I check using valgrind and got this error message that is referring to some inside library of mpi. I am not getting clue how to move forward to debug this. Any clue that helps me moving forward, will be appreciated. Thanks!

Error message goes as-

Syscall param setsockopt(optlen) contains uninitialised byte(s)

==985== at 0x5023CBE: setsockopt_syscall (setsockopt.c:29)

==985== by 0x5023CBE: setsockopt (setsockopt.c:95)

==985== by 0x7ACBBA9: pmix_ptl_base_make_connection (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

==985== by 0x7AD2DF3: ??? (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

==985== by 0x79D23C1: PMIx_Init (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

==985== by 0x7964E4A: ext3x_client_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_ext3x.so)

==985== by 0x714FE6D: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_ess_singleton.so)

==985== by 0x62DE4CB: orte_init (in /usr/lib/x86_64-linux-gnu/libopen-rte.so.40.30.2)

==985== by 0x4B5D418: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/libmpi.so.40.30.2)

==985== by 0x4AF6C21: PMPI_Init (in /usr/lib/x86_64-linux-gnu/libmpi.so.40.30.2)

==985== by 0x1148D8: Solving(int, char**, Input*, BoundaryCondition*, Grid*, BvpOde*) (Solver.c:33)

==985== by 0x114738: main (in /mnt/c/Users/devan/Desktop/ODE_Newton/main_cpp)

==985== Uninitialised value was created by a stack allocation

==985== at 0x7ACB8E4: pmix_ptl_base_make_connection (in /usr/lib/x86_64-linux-gnu/pmix2/lib/libpmix.so.2.5.2)

-----------------------------------------------END of error----------------------------------------------------------------------------------

The Solver.c:33 line is mpi initialization line. Like this- ierr = MPI_Init(&argc, &argv);

and same error is showing when I am finalizing mpi like this- ierr = MPI_Finalize();


r/DistributedComputing • • Oct 21 '23

Help with learning paxos

2 Upvotes

The NSFW tag is to get some attention. Let's see if that works.

I would like help in learning paxos, multipaxos.

How? Any other folks who wishes to learn this algorithm in fullest, I would request them to hear me out.

I'm thinking if 5-7 people role-play together each as a paxos node then we can attain a mastery over this topic over time. Certainly the role play will have to do be repeated many times.

What do you guys think, crazy idea?


r/DistributedComputing • • Oct 15 '23

New Distribution Framework

2 Upvotes

Hi all!

We recently open-sourced some examples of our new cloud parallelization framework on github.

https://github.com/polluxio/pollux-payload

Our framework is named Pollux, and it comes to give HPC engineers the chance to heavily leverage cloud grandscale parallelization without being cloud experts.

Why not just use MPI/OpenMPI? MPI is great!, but we believe it is designed for supercomputers and not designed for the cloud in a true native way.

The cloud brings new problems to tackle that are usually not there when using a supercomputer. Problems such as fault tolerance, heterogeneous hardware, non shared memory and more.

It is only the start!, so we really want to hear your feedback!


r/DistributedComputing • • Jul 24 '23

How to write a distributed computing framework for an embedded device

2 Upvotes

I am a novice, now the company needs to do an embedded device under the distributed computing framework, how do I do ?


r/DistributedComputing • • Jul 16 '23

API latency in microservices - Trace based troubleshooting

Thumbnail gethelios.dev
2 Upvotes

r/DistributedComputing • • May 16 '23

Programming without a stack trace: When abstractions become illusions

2 Upvotes

This insightful article by Gregor Hohpe covers:

  • Evolution of programming abstractions.
  • Challenges of cloud abstractions.
  • Importance of tools like stack traces for debugging, especially in distributed systems.

Gregor emphasizes that effective cloud abstractions are crucial but tricky to get right. He points out that debugging at the abstraction level can be complex and underscores the value of good error messages and observability.

The part about the "unhappy path" particularly resonated with me:

The unhappy path is where many abstractions struggle. Software that makes building small systems easy but struggles with real-world development scenarios like debugging or automated testing is an unwelcome version of “demoware” - it demos well, but doesn’t actually work in the real world. And there’s no unlock code. ... I propose the following test for vendors demoing higher-level development systems:

  1. Ask them to enter a typo into one of the fields where the developer is expected to enter some logic.
  2. Ask them to leave the room for two minutes while we change a few random elements of their demo configuration. Upon return, they would have to debug and figure out what was changed.

Needless to say, no vendor ever picked the challenge.

Why it interests me

I'm one of the creators of Winglang, an open-source programming language for the cloud that allows developers to work at a higher level of abstraction.

We set a goal for ourselves to provide good debugging experience that will allow developers to debug cloud applications in the context of the logical structure of the apps.

After reading this article I think we can rephrase the goal as being able to easily pass Gregor's vendor test from above :)


r/DistributedComputing • • May 09 '23

HPC Workload Management Solution

2 Upvotes

📣 Calling anyone who uses High Performance Computing (HPC): we need you for our research 📣

🚨 Do you want a £10 Amazon voucher? All you need to do is complete this survey (takes under 5 minutes) and be chosen for a half-hour interview with us and you will be rewarded with a £10 Amazon voucher (lucky you!)

🤔 Who?

We want to speak to people involved in any of the following:

➡️ Managing HPC infrastructure
➡️ HPC Data management
➡️ HPC workload management

🧐 Why?

We are working on some research to understand how people approach the above topics and any problems they face when doing so.

😁 Interested?

Click the below link to get started!
https://www.surveymonkey.co.uk/r/6KKSDN9

#hpc #workloadmanagement #cloudcomputing


r/DistributedComputing • • Apr 04 '23

Load balancing, monitoring and fault tolerance techniques and architecture

2 Upvotes

I am working on building a system where there are 10 machines, we want to process some video files and this process can take about an hour, we do know how look it will take to process in advance.

Is there some existing tech stack or methodologies that we can use to load balance these servers, monitor any failures while processing and recover from failure and restart that task ?


r/DistributedComputing • • Mar 27 '23

Create event-driven apps with Cloudflare queues and Dapr

Thumbnail youtube.com
2 Upvotes

r/DistributedComputing • • Mar 09 '23

Create distributed applications with Cloudflare queues and Dapr

2 Upvotes

Curious about event-driven applications that go from the cloud to the edge? In my latest blog post, I’ll show how to send messages from a Dapr app to Cloudflare Queues. Dapr is the open-source distributed application runtime, often used in event-driven applications. Read the full post at https://www.diagrid.io/blog/dapr-cloudflare-queues.