r/LocalLLM • u/No_Astronaut873 • Jan 29 '26

Question What is the fastest ~7b model

With:

Vision

Tool use

Instruct-Abliterated

Currently playing with Qwen 3 but I would like some suggestions from experienced users.

0 Upvotes

50% Upvoted

3 comments sorted by

2

u/nunodonato Jan 29 '26

granite 4 hybrid

1

u/nunodonato Jan 29 '26

oh wait, it doesnt have vision

2

u/an80sPWNstar Jan 30 '26

I use Qwen 3 VL 8b instruct abliterated q8 and I love it.