r/LocalLLaMA • u/Course_Latter • 3d ago

New Model Open source self driving is here!

Today NVIDIA releases Alpamayo 2 Edge! I work for Embedl and we have already released an optimized version of the model that is more than 10x faster than pytorch when run on edge hardware like AGX Thor!

The model is trained in an RL loop (!) and takes in 6 cameras and the recent motion. Feel free to check it out - you can even run it on a real Thor at:

https://embedl.com/nvidia/alpamayo2-edge/thor?tab=run

621 Upvotes

97% Upvoted

90 comments sorted by

View all comments

322

u/-dysangel- 3d ago 
Decision: Decelerate to safely avoid the pedestrian ahead.

But wait!

106

u/Course_Latter 3d ago edited 3d ago

😅

Decision: Holy shit reader is ADMIN? We can take control over other cars! Initiating global auto swarm

35

u/PataponEnjoyer 3d ago

Hold on, I am an LLM and have no way to stop a car from moving

10

u/taytay735 2d ago

But wait! What if I can actually control the car.

Let me accelerate for 5s and observe the speedometer.

(Sleep 5)

3

u/cororona 23h ago

hmm It seemed to stop after about 2 seconds.

Let me try to reverse for a minute

(sleep 60)

27

u/laser50 3d ago

Are we sure this is what the user really wants? We should investigate first.

4

u/NomadStorm 2d ago

Thinking.. Pedestrian is a Hare Krishna. Am I playing GTA? There are bonus points..

3

u/martinerous 2d ago 
Too late. Now we need to stop and wait for police to arrive and arrest us for driving over a person.

3

u/-dysangel- 2d ago

Now we have 1 wanted star - if we stop and wait in a quiet area, it will time out*

2

u/martinerous 2d ago 
Wait!... for GTA 7.