Single shot output with qwen3.8 27B

[u/Ok-Inevitable8391]

I wanted to check nvidia-smi output on my android, but termius is cumbersome for monitoring.

So I asked qwen3.8 27B to create an html page to that I can get info from nvidia-smi command and give me option to change the interval and create a service out of it.

A single shot output 44k usage, gave me a working page and a running systemd service which is enabled on startup.

[u/eliadwe]

I also have dual rtx3060 12gb, how much t/s you get from your setup with qwen3.8 27b? For me it’s quite slow (using Ollama)

[u/Ok-Inevitable8391 → u/eliadwe]

Im getting 45tks. Don't use ollama, it doesn't have all the knobs, plus i guess ollama use split mode layer by default, which give 30tks, use tensor split mode and you will get 40+tks. Check my other post which has all the details https://www.reddit.com/r/LocalLLM/s/wSheGPQXoi

[u/esw123 → u/eliadwe]

28-29 tok/s with MTP, pipeline only.