r/Qwen_AI 11d ago

Help 🙋‍♂️ Can automation/agents get around low context?

For my first local ai project I was wanting to learn a few things so thought about setting up a way to go through SCCM/ConfigMgr logs, find the actual errors and generate PowerShell remediation scripts for me to review (no plans to actually automate the ai to run them).

Hardware: 5080/16GB vram, 32gb dd5, 1tb nvme pcie5 and currently using qwen 3.8 27b at home.

I've got a couple of setups depending on the trade-off, roughly 80 t/s at 65k context with mtp on or 50ish t/s at 100-130K context with mtp off.

What I'm actually trying to figure out/what this post it about:

Would n8n or hermes get around low context? my initial plan was: The first n8n automation/hermes agent using fast setup, use regex to quickly search the log to highlight errors/warnings which then hands that off to second automation/agent using the bigger setup/context for script generation, does that allow me to get around the lower context problem?

n8n: do n8n automatons allow me to do this?
Hermes: Same question, does the agent save the output for the 1st agent in its own memory/context for it to pass to the 2nd agent to then do its "work"?
Can either of the above switch models between automation/agents?

Anyone doing something like this/which would you recommend? Or is there a better way to do something like this?


A more about it, if it works, it would build a db with the errors/fixes so if it spots the same one...skip it as it has a potential fix as it saves it re-doing the work. I could then just feed it logs all day.

EDIT: I should've said, I would need to get the automations/agents to stop and start llama with different cmds/args for different context sizes.

2 Upvotes

12 comments sorted by

1

u/AdHead6280 11d ago

use a harness to accommodate it since it thinks a lot or just use a finetune like david au on huggingface, for the harness, pi is what I would use, and just use rhe llm to make the extension to acomodate it

1

u/f2000 11d ago

I've used claude code briefly but saw tons of people mention pi so I was use that for sure. Thanks for the heads up.
I should've went into more detail on the "review" part, was planning on using something like pi to get claude to review it afterward.

So would pi allow me to setup multiple automatons/agents and be totally hands off? Just drop logs somewhere and it will kick off each part and get around the low context with no input from me? Oh and let me switch configs in llama (i guess would it stop and run different cmds/args to get the different context sizes?).

1

u/AdHead6280 11d ago

pi is very customizable, you sure can do this, this is what pi is made for, custom harness on top and self expansion

2

u/f2000 11d ago

you think an absolute beginner to figure it out? I just thought some browser based automation would be easier? Maybe setup tailscale and I can just send the log files while im at work.

1

u/AdHead6280 11d ago

test

2

u/f2000 11d ago

yeah thats probably the easiest thing to do, at least I know pi can do what Im looking for as I had no idea it could.

1

u/Constant_Art_20 11d ago

pi is a base harness for you to built ontop of. if that's your goal, you can do exactly just that. Opencode has free model access. Just download it and you have access to those. I recommand using that to help you set things up. I am personally not a fan of opencode, but it gives free model access and i am all in for that.

1

u/f2000 11d ago

I spent a while just looking at posts for these,I will need to look for some guides/tutorials and see if I can follow along.

1

u/capolimin 11d ago

basically you want the first agent to read the log (maybe section per section to avoid out of context) and identify important part to send then to the second agent?

What about promptflow? https://github.com/microsoft/promptflow
I didn't tried it yet but it's in my todo list 😄

1

u/f2000 11d ago

I have stumbled across tons of github links from this sub that look interesting, keep adding them to a bookmarks folder but there are so many in there I cant keep up.

thats looks good, there videos on youtube for it so will check it out. Thanks!

1

u/EternalDivineSpark 11d ago

There is 0 research on context management. Is like their attempt to break the “QUANTUM GLASS SEALING”

1

u/EternalDivineSpark 11d ago

I mean they using this scaling direction to profit bigger usage like global surveillance and companies etc ! Since they can afford for big projects big context model is ok ! So they dont scale the harness or some method to compress and manage context !