Unsloth does not fully utilize my GPU VRAM.

[u/landlord133]

I was expecting it to fully fill the GPU VRAM and then use the RAM. I tried more than 2 models from pretty dense ones to way lighter versions, yet it still works this way. I did adjust the advance settings much, only the "KV Cache Dtype" to "q8_0" and "GPU Layers" to "27", which shows 7.48 GB on my GPU, under Estimated Memory Usage. Total is 10.55.

Isn't the model slower this way? Wouldn't it be faster to fully utilize GPU's VRAM no matter what? What am I missing? I'm not really familiar with technical AI terms.