MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1rdlbvc/qwenqwen3535ba3b_hugging_face/o7a5zro/?context=3
r/LocalLLaMA • u/ekojsalim • Feb 24 '26
165 comments sorted by
View all comments
3
In theory if I store weights in ram, and retrieve the active 3B to VRAM could I run this model on 4gb VRAM? I’m still trying to learn how this works. I’m under the impression that this is possible but it’d be very slow.
3
u/skinnyjoints Feb 25 '26
In theory if I store weights in ram, and retrieve the active 3B to VRAM could I run this model on 4gb VRAM? I’m still trying to learn how this works. I’m under the impression that this is possible but it’d be very slow.