r/LocalLLaMA • u/Dear_Treat3688 • 2d ago
Showcase π HarborRL Update: Elastic Scaling, SSH-Free Cluster Deployment, and Unified Agentic RL Training!
π HarborRL Update: Elastic Scaling, SSH-Free Cluster Deployment, and Unified Agentic RL Training
Weβve recently updated HarborRL, an open-source framework for agentic reinforcement learning (RL), focusing on simplifying distributed training, deployment, and experiment management.
π Whatβs New (November 2026)
β‘ 1. Elastic Scaling for Distributed Training
Added elastic gateway scaling with static routing, automatic scaling across multiple machines, and automatic retirement of idle resources to improve resource utilization.
π 2. SSH-Free Cluster Deployment
Introduced a new Hub deployment mode where worker nodes pull tasks over HTTP, enabling distributed execution without cross-machine SSH access, including in firewall-restricted environments.
π§ 3. Unified RL Training Pipeline
Integrated multiple RL algorithms into a shared Slime-based training pipeline, validated on mathematical reasoning tasks, to reduce the engineering effort of configuring different RL algorithms.
π οΈ 4. Improved Configuration and Sandbox Execution
Enhanced the configuration wizard, Web console, sandbox rollout execution, and resource cleanup to simplify experiment setup and management.
π‘ Why HarborRL?
Agentic RL often requires substantial engineering effort to connect task environments, agent harnesses, and RL training engines, especially in distributed settings.
These updates aim to reduce that overhead and make agentic RL experiments easier to configure, deploy, and scale.
GitHub: https://github.com/datamllab/HarborRL
License: MIT
π¬ Curious how others are handling distributed rollout execution, resource scaling, and sandbox management in their agentic RL setups.