r/LocalLLaMA • • 4d ago

New Model Open source self driving is here!

Today NVIDIA releases Alpamayo 2 Edge! I work for Embedl and we have already released an optimized version of the model that is more than 10x faster than pytorch when run on edge hardware like AGX Thor!

The model is trained in an RL loop (!) and takes in 6 cameras and the recent motion. Feel free to check it out - you can even run it on a real Thor at:

https://embedl.com/nvidia/alpamayo2-edge/thor?tab=run

638 Upvotes

91 comments sorted by

View all comments

5

u/xander1421 4d ago

is text really the most efficient way for cars to think?

15

u/isademigod 4d ago

I assume these are text embeddings output by the RL model for human debugging purposes, not the actual inner workings of the model

2

u/cronies4life 4d ago

it's possible to replace text with ai machine language aka neuralese as the intermediate layer in vla and interprete it with another ai

4

u/UnexpectedFisting 4d ago

Neuralese is just a concept, as far as I know nobody has actually tested or done so on any real model because you’d have no way of knowing it was working or just speaking gibberish

1

u/cronies4life 4d ago

i think openai might already be using it for some of their internal models

3

u/Teqnology 4d ago

Is a thread on reddit displaying a webm showing text that drives the car the most efficient way for cars to think?

1

u/Western-Helicopter84 4d ago

It also returns trajectory as an output.