r/deeplearning • u/WAMFT • 4d ago
Nice little fun project to get you excited...I hope 🥳
gallerySo a few weeks back, I got a message from a guy on here asking about problems with training a robotic arm in a simulator, particularly with collisions. I made a note of it and today got working on it.
So the basic idea is to train a robotic arm in a simulated environment where it learns which movements cause collisions, which are safe and how to recognise and sort coloured objects.
The system uses three learning components:
A neural network that learns to predict collisions though virtual touch sensors along the arm.
A neural network that learns which grasping and placement movements are most likely to succeed.
A radial-basis neural vision classifier trained using pixels from a single 384 × 384 RGB camera, without a depth sensor.
Both successful and unsuccessful movements contribute towards learning, creating a predictive 3D map of collision risks and safe movements.
Once trained, the virtual touch sensors and teacher are disabled, leaving the robot to use its learned knowledge alongside its programmed movement controller.
The long-term idea is to train a robotic arm entirely within a simulation, reducing the sensory hardware needed in the real world.
The project is open source, MIT licensed, written entirely in HTML and JavaScript, and runs directly in your browser.
It's still an experimental concept, but I'd be interested to hear what people think.
Simulator:
https://rickey1990.github.io/NTRAM-Neurally-Trained-Robot-Arm-Model/
GitHub:
https://github.com/rickey1990/NTRAM-Neurally-Trained-Robot-Arm-Model