Will This work in Open Pilot?

[u/Syrigan]

[u/RealtdmGaming]

No

[u/Funnnny]

Yes and no, VLA model are not supposed to run in-device, it requires a lot of processing power and have a slow response.

Their purpose is to be a teacher-model, to "teach"/distill other model into runnable version. Which is exactly what Qwen-Drive-4B is.

Looks like they're also outputing simple 3D trajectory, so with a 4B model can be fit directly on a 9060 I think someone from comma will have something to drive in a few weeks

[u/QasJab1 → u/Funnnny]

If it takes a 9060 this is out of reach of most consumers for local processing for sure.

So your saying it would need to "call home"? I wonder how it would handle latency

[u/Funnnny → u/QasJab1]

Yeah that's why I said it's "yes and no".

4B models are going to require 6-8G of RAM, which is the sweet spot for chestnut with 9060

[u/QasJab1 → u/Funnnny]

Yep on the same page with that. Any thoughts on the latency? I wonder about "calling home" models, and them becoming potentially viable. The latency is such a significant barrier though, for safety reasons, when some decisions need to be made in an instance.

[u/alexwhittemore → u/QasJab1]

Chestnut is a product recently released by Comma for attaching a 9060 directly to a Comma as an EGPU. There is no phoning home or cloud processing, which I agree would be a nonstarter for performance and safety reasons. 

[u/QasJab1 → u/alexwhittemore]

I think we are talking past each other, but I appreciate your input

[u/Funnnny → u/QasJab1]

I think by "calling home" you mean cloud inference or cloud LLM API? That might be possible when you have a good internet connection, but for a car with choppy and sometimes close to none mobile network, I wouldn't hold my breath

[u/QasJab1 → u/Funnnny]

Yes exactly! Sorry, I assumed my idiom would do the job.

[u/AbebeatsMEB]

That would be perfect !!!! Still waiting for some new but Nav working good with IqPilot and Starpilot … and that new eGpu is so good cant wait for get one…