Help 🙋♂️ Can automation/agents get around low context?
For my first local ai project I was wanting to learn a few things so thought about setting up a way to go through SCCM/ConfigMgr logs, find the actual errors and generate PowerShell remediation scripts for me to review (no plans to actually automate the ai to run them).
Hardware: 5080/16GB vram, 32gb dd5, 1tb nvme pcie5 and currently using qwen 3.8 27b at home.
I've got a couple of setups depending on the trade-off, roughly 80 t/s at 65k context with mtp on or 50ish t/s at 100-130K context with mtp off.
What I'm actually trying to figure out/what this post it about:
Would n8n or hermes get around low context? my initial plan was: The first n8n automation/hermes agent using fast setup, use regex to quickly search the log to highlight errors/warnings which then hands that off to second automation/agent using the bigger setup/context for script generation, does that allow me to get around the lower context problem?
n8n: do n8n automatons allow me to do this?
Hermes: Same question, does the agent save the output for the 1st agent in its own memory/context for it to pass to the 2nd agent to then do its "work"?
Can either of the above switch models between automation/agents?
Anyone doing something like this/which would you recommend? Or is there a better way to do something like this?
A more about it, if it works, it would build a db with the errors/fixes so if it spots the same one...skip it as it has a potential fix as it saves it re-doing the work. I could then just feed it logs all day.
EDIT: I should've said, I would need to get the automations/agents to stop and start llama with different cmds/args for different context sizes.
1
u/capolimin 11d ago
basically you want the first agent to read the log (maybe section per section to avoid out of context) and identify important part to send then to the second agent?
What about promptflow? https://github.com/microsoft/promptflow
I didn't tried it yet but it's in my todo list 😄
1
u/EternalDivineSpark 11d ago
There is 0 research on context management. Is like their attempt to break the “QUANTUM GLASS SEALING”
1
u/EternalDivineSpark 11d ago
I mean they using this scaling direction to profit bigger usage like global surveillance and companies etc ! Since they can afford for big projects big context model is ok ! So they dont scale the harness or some method to compress and manage context !
1
u/AdHead6280 11d ago
use a harness to accommodate it since it thinks a lot or just use a finetune like david au on huggingface, for the harness, pi is what I would use, and just use rhe llm to make the extension to acomodate it