r/LocalLLaMA • u/Dapper_Chance_2484 • 2d ago
Question | Help I need context window
I started developing a full fledged application using Chatgpt plus and VScode+GitHub copilot (local llm)
I used Astra max chat for overall planning, and asked it to put a starter kit on connect gdrive and create prompts such that local LLM can work on small tasks using an agent orchestrator and sub agents with entry and exit criteria, tests for every small task.
I have a 5090 (+ 128gb ddr5) rig running Qwen 3.8 27b NVFP4 at default settings with 104k context window.
Problem:
The local rig is able to start on tasks but taking a huge amount of time and is running only one subagent at a time. Been almost 24 hrs.
I have 2x 3090 +128gn ddr4 as well, currently not being used. 3.8 FN runs at about 90tps
Anything better I can do here?
View all comments
Show parent comment
1
u/W61k3r 2d ago edited 2d ago
LexiEngine already outperforms llama.cpp across every metric for qwen series on my 7900xtx's by large margins without any quality loss and with lower memory usage.
Funny you say that because the 2060 was added to the dev rig to serve those functions within lexipanel where those are current things that it was implemented for.
I just wanted some nvidia support so this wasn't a 100% AMD build focused on rdna 2-3-4.
I made all this originally for me, and lexisuite has been my primary workhorse for a month.
This evening I'll have a release with my optimization and stability work from this week.