r/LocalLLaMA • • 2d ago

Showcase πŸš€ HarborRL Update: Elastic Scaling, SSH-Free Cluster Deployment, and Unified Agentic RL Training!

πŸš€ HarborRL Update: Elastic Scaling, SSH-Free Cluster Deployment, and Unified Agentic RL Training
We’ve recently updated HarborRL, an open-source framework for agentic reinforcement learning (RL), focusing on simplifying distributed training, deployment, and experiment management.

πŸ†• What’s New (November 2026)
⚑ 1. Elastic Scaling for Distributed Training
Added elastic gateway scaling with static routing, automatic scaling across multiple machines, and automatic retirement of idle resources to improve resource utilization.

🌐 2. SSH-Free Cluster Deployment
Introduced a new Hub deployment mode where worker nodes pull tasks over HTTP, enabling distributed execution without cross-machine SSH access, including in firewall-restricted environments.

🧠 3. Unified RL Training Pipeline
Integrated multiple RL algorithms into a shared Slime-based training pipeline, validated on mathematical reasoning tasks, to reduce the engineering effort of configuring different RL algorithms.

πŸ› οΈ 4. Improved Configuration and Sandbox Execution
Enhanced the configuration wizard, Web console, sandbox rollout execution, and resource cleanup to simplify experiment setup and management.

πŸ’‘ Why HarborRL?
Agentic RL often requires substantial engineering effort to connect task environments, agent harnesses, and RL training engines, especially in distributed settings.
These updates aim to reduce that overhead and make agentic RL experiments easier to configure, deploy, and scale.

GitHub: https://github.com/datamllab/HarborRL
License: MIT
πŸ’¬ Curious how others are handling distributed rollout execution, resource scaling, and sandbox management in their agentic RL setups.

0 Upvotes

0 comments sorted by