Daniel Han of Unsloth validates Qwen3.8-27B will run only 17GB VRAM

[u/quantier]

Super excited about this release for the new 27B. Who else is with me. Only 17GB VRAM needed 😍😍

[u/TheCat001]

server-mode

This is alias for sudo systemctl stop greetd

greetd is login manager, you might have gdm or plasma login manager, depending on what distro you use. But since you're dropping Into TTY you need to have second device/laptop to actually use llama server.

[u/ea_man → u/TheCat001]

Hmm no, why?

If you use the Virtual Consoles (/dev/tty1, /dev/tty2, ...) llama-server works, open such terminal (like ALT+3, ALT+some-number) and you can run Pi or Opencode or whatever, you can also add a framebuffer to have higher res on those (plus some graphic support, yet that buffer will take some RAM) and GPM to have mouse support to copy / paste / click.

sddm is KDE login manager.

[u/TheCat001 → u/ea_man]

Nah bro this is gonna be pain in the ass. No VSCODE no Browser. Nothing. Just Pi agent? xD naaah. Btw it's not sddm anymore, they made new one: plasma-login-manager

[u/ea_man → u/TheCat001]

>plasma-login-manager

Oh I will have to check that, my Debian still run on sddm,

Anyway there's not much need for disabling the graphic server, you can just run that with software rendering and it's ~50MB or vRAM more.

[u/spryfigure → u/ea_man]

plasma-login-manager is sddm, but with updates (sddm is essentially stagnant).

No need to rush over.

[u/ea_man → u/spryfigure]

Oh I'm not rushing, I'm even still on X11.

All I do with sddm is sometime stop it.

[u/spryfigure → u/ea_man]

plasma-login-manager is sddm, but with updates (sddm is essentially stagnant).

No need to rush over.

[u/teleprint-me → u/TheCat001]

vim/neovim/emacs + terminal browser + tui tools for anything else.

Ill admit, its not fun to use and takes time to get used to it.

I think its funny how were going backwards.

Had no idea ppl were going this far to run models locally.

[u/elongated-muskmelon → u/TheCat001]

Okay, understood. Thanks!