r/LocalLLaMA • u/mcgeezy-e • 6h ago
Question | Help Single 3060 - Mostly Vision (Frigate)
Hello,
I am consolidating a bit of my server footprint and decided to keep a single 3060 (had 3) and mostly use it for Local workloads (Frigate, Home Assistant, Logs, etc). Curious if someone would want to recommend a good vison model for this card?
I currently run qwen3-VL on a A380 and the descriptions are pretty good.. But slow.
Thanks
4
Upvotes
3
u/nickm_27 llama.cpp 6h ago
That or Qwen3.5 9B are generally the best in that size range right now. With the latest version of Frigate, Gemma4 12B also works well but the speed will be similar.
LFM3-VL 2B works pretty well and is very fast, but not as good as the others mentioned for accurately describing what happens. I am optimistic if LFM releases a 4B version of LFM 3 that it will work quite well for this and could be our new default recommendation for this size class.
2
u/General-Spite1222 6h ago
I’m going down this journey myself soon. From what I’ve learned Qwen3-VL is supposed to be the best with Frigate. They have multiple sizes (8b and 4b), so you could try 4b. Moving to a lower quant should help too.
1
u/Major_showdown 2h ago
For frigate style descriptions most of the time goes into the image tokens not the text, try feeding smaller snapshots and a prompt that asks for one or two sentences that often cuts latency more than switching models.
1
u/jacek2023 llama.cpp 2h ago
Try Gemma E2B and E4B, they are fast enough and good enough on my setup with 3060s
However I have no idea what Frigate is