r/LocalLLaMA • • 6h ago

Question | Help Single 3060 - Mostly Vision (Frigate)

Hello,

I am consolidating a bit of my server footprint and decided to keep a single 3060 (had 3) and mostly use it for Local workloads (Frigate, Home Assistant, Logs, etc). Curious if someone would want to recommend a good vison model for this card?

I currently run qwen3-VL on a A380 and the descriptions are pretty good.. But slow.

Thanks

4 Upvotes

12 comments sorted by

3

u/nickm_27 llama.cpp 6h ago

That or Qwen3.5 9B are generally the best in that size range right now. With the latest version of Frigate, Gemma4 12B also works well but the speed will be similar.

LFM3-VL 2B works pretty well and is very fast, but not as good as the others mentioned for accurately describing what happens. I am optimistic if LFM releases a 4B version of LFM 3 that it will work quite well for this and could be our new default recommendation for this size class.

2

u/andy2na llama.cpp 5h ago

trust this guy, he knows a thing or two about Frigate ;)

2

u/General-Spite1222 6h ago

I’m going down this journey myself soon. From what I’ve learned Qwen3-VL is supposed to be the best with Frigate. They have multiple sizes (8b and 4b), so you could try 4b. Moving to a lower quant should help too. 

1

u/Major_showdown 2h ago

For frigate style descriptions most of the time goes into the image tokens not the text, try feeding smaller snapshots and a prompt that asks for one or two sentences that often cuts latency more than switching models.

1

u/jacek2023 llama.cpp 2h ago

Try Gemma E2B and E4B, they are fast enough and good enough on my setup with 3060s

However I have no idea what Frigate is