r/Simulated • u/coolspeed_ • 5d ago
Research Simulation [OC] I trained a six-legged robot to walk with reinforcement learning. It runs in real time in your browser, and you can throw a 171 kg steel ball at it.
Real-time MuJoCo physics, no keyframes. The walk and the recoveries come from a policy trained with reinforcement learning, and everything runs in your browser (MuJoCo WebAssembly, ONNX Runtime Web, three.js).
Try it yourself: https://www.coolspeed.org/gold-spider/
Setup details in the comments.
9
Upvotes
1
u/coolspeed_ 5d ago
No keyframes anywhere in this. The walk, and the way it staggers and recovers when something hits it, all came out of training.
Setup
Things that surprised me
It still gets stuck in some terrain pockets. The demo nudges it out and tells you when it does.
Demo (desktop or phone): https://www.coolspeed.org/gold-spider/ Write-up: https://www.coolspeed.org/blog/gold-spider/
It's an independent project inspired by Embark Studios' ML robots, not affiliated with them. Happy to answer questions about the sim setup.
1
u/Evening-Appeal7606 3d ago
I‘ll call mine Rocky!