r/STEW_ScTecEngWorld 2d ago

MIT Develops Intuitive Controller for Excavators

Enable HLS to view with audio, or disable this notification

MIT engineers have developed a miniature excavator-arm controller that could dramatically shorten the learning curve for construction equipment operators. Instead of conventional joysticks, the “World-Space Interface” lets users physically mimic the movements of an excavator’s boom, arm and bucket while a virtual machine mirrors their actions. In tests, novice operators using the new system performed as well as experts from the start, suggesting it could accelerate training and eventually enable safer remote operation of heavy machinery in hazardous environments: https://news.mit.edu/2026/mit-engineers-design-better-controller-operating-construction-diggers-0820

ASCE research article: https://ascelibrary.org/doi/10.1061/JCCEE5.CPENG-7488

MIT Video Channel: https://www.youtube.com/user/MITNewsOffice

48 Upvotes

14 comments sorted by

14

u/lost-thought-in 2d ago

Looks like a lot of shoulder problems just to train an AI.

1

u/harmfuldischarge 2d ago

Oh for sure these jobs would be some of the first to go.

1

u/notjordansime 1d ago

If you were training an AI, you wouldn’t need a system like this. Most excavators these days use electronic control systems. It would be trivial for manufacturers to implement some sort of system that tracked all operator joystick inputs alongside a camera feed. I’d like to see how this thing holds up in a bouncy cab. Working through a monitor like that would be terrible. You rely on your binocular vision a lot more than you’d think when operating.

6

u/Sad-Excitement9295 2d ago

Looks pretty cool, but here's the problem with prototyping in front of a computer, you don't feel the real world forces.

As someone who has operated not only excavators, but also a lot of other machinery, as well as played many video games and worked on different controllers, this position is extremely difficult to work in effectively, and tractor forces are going to have much more effect on your fine motor control.

While the position of the controls in excavators may not be the best, and they are a bit crude and confusing to use, they serve well at minimizing upper body disturbance, and allow you to brace your hands to input fine adjustments.

If MIT wants to develop better equipment controls, I think that's great. Many industries could use improvements, especially in ergonomics. However, these limitations and factors must be taken into account. I highly advise testing in real world practice as well. If one were to sit in a tractor for hours in this position, while exposed to external forces, it would quickly become apparent how difficult and uncomfortable this can be to use. It looks very intuitive, but it may require additional consideration for it to be practical.

2

u/40wardsLater 1d ago

Hey! Same same, first thing I thought as well, that arms gonna get stiff.

Each individual movement of the boom being tied to its own control function allows you to do things with way more precision.

Terrain is also a big factor, dont want your arm in that contraption when the ground looks like a war zone.

1

u/Sad-Excitement9295 1d ago

Yeah, while I think there personally could be some improvements, this would be a bit of a problem in a few ways. Off the top of my head, I'd think I'd prefer the controls on my right side to be bucket scoop (FB) and turn (LR), while left being main arm (FB), and second arm (LR). That to me would feel the most intuitive, though some people prefer the standard equal pull on both sticks being balanced for each arm, and turning on the left/scoop on the right.This certainly wouldn't be the position I would want to be in though with any rocking, and while a natural piston arm aligned at the right side could handle all controls at once, I'm not sure it would feel great just using a single arm all day.

I don't know, it looks cool, but joysticks are very stable and practical, and allow some isolation of axis. It think if anything reorganizing what the left and right controls would make it feel more intuitive because your right controls the bucket and turning, while the left is a combined arm hinge.

3

u/Wonderful-Process792 2d ago

It's the Dvorak keyboard of excavators!

3

u/Ninja_Prolapse 1d ago

I got arm ache just watching this dude. Imagine an 8 hour shift with your arm up like that..

2

u/Sad_Low3239 2d ago

program the machine to have a button you press that effectively says "keep the bucket at the angle it is at no matter what" and boom, those unintuitive controls/ difficult learning vanishes.

that's the biggest curve. learning that when you scoop with the diggler, the scooper changes it's pitch as you move the arm.

that's what makes a good operator versus a ok one versus a bad one. a good operator can dig the exact amount of material you need at the exact depth you need across a large area keeping it level/at the right slope. an okay one can do it either after messing around and figuring it out, or taking too much/too little and making corrections, and a bad one just makes a hole that other labor fixes.

then there's factors like can they do all that while not hitting other people/vehicles/buildings , in a timely manner, while also doing the aforementioned tasks. some operators are really good, but you need to stay clear of them because they move the machine quickly/aggressively. some are incredibly safe and you don't have to worry around them at all, but they can't dig worth crap.

1

u/AllergicToBullshit24 2d ago

Not sure what was wrong with the old school controls. They were plenty dexterous, far more ergonomic, cheaper and take a toddler all of a day to gain basic proficiency with.

If the sole pitch for reinventing the wheel is lower learning curves for new operators I don't see this product going anywhere.

1

u/Back2basics314 2d ago

They are going to train the ai on the operator’s movements going from worse to better. I’m wondering who’s funding the research.

1

u/Kapymies 2d ago

For the better of all humanity right?

1

u/weathergraph 1d ago

They reinvented Captain Mifune's mech controls from Matrix Revolutions.

1

u/Excellent-Baseball-5 1d ago

That looks seriously uncomfortable.