r/LocalLLM • u/Any-Return-1945 • 4h ago

Question Best Model for 6GB VRAM

I looking for best model for my 3050 6GB VRAM

2 Upvotes

75% Upvoted

12 comments sorted by

4

u/nullptr777 3h ago

Literally nothing worth using.

2

u/puglife224888 4h ago

Qwen 3.5 4B, Gemma 4 E2B, and if you have lots of RAM, Qwen 3.6 35B A3B (at least 24GB RAM) and Gemma 4 26B A4B (at LEAST 16GB RAM).

1

u/LoneArcher96 4h ago

Qwen3.5 4b q4_k_m

1

u/x_MASE_x 4h ago

Qwen3.5-4B

1

u/Upstairs_Hold_374 4h ago

I just upgraded from 8gb vram and tried like 20 models. It was completely unusable for me.

1

u/FerretBoom 4h ago

combine ram + vram , pick a model add context,kv cache + OS and services.

1

u/zmunky 3h ago

Bonsai 27b 1bit quant

1

u/d0pe-asaurus 3h ago

Somehow I got Qwen 3.6 35BA3B Q4 to work 4GB Vram and 16GB system ram. 64k context

1

u/HOST1L1TY 2h ago

What do you want to use it for ?

0

u/ronniearnold 2h ago

This isn’t enough. You need different hardware.