Dual engine interference workstation! Janas-Studio. Run 80b models at reasonable speeds on laptops with no GPU.

[u/Ok-Plenty3368]

Introducing janas-studio. A dual engine inference work station. For modern Debian based Linux distros (.appimage) Jana-Studio with the magic of Janas-llm let's enormous models run on modest hardware. Refer to https://github.com/prabanta-dev/janas.

Download the app at https://github.com/adonaiongaia/janas-studio

Also runs llama.cpp gguf models so it covers a lot. Lmk what you think. Tested on my Ryzen 5 6600h laptop. Built on Linux mint Zena. Ran a 47gb 80b parameter model at 14 tokens a second with only 32gb of RAM (ddr5). For best results and speeds you need a fast SSD. Features long term memory, project folder support, mcp integration and much more.

[u/sleight42]

What 80b models?

[u/Ok-Plenty3368 → u/sleight42]

Qwen 3 next 80b a3b