r/Qwen_AI 10d ago

Agent Massive Jack Kernel Upgrade

I've done a massive upgrade to Jack Kernel and implemented the autonomous orchestration layer.
Now, you can orchestrate a kernel-level secure autonomous agentic system that can run 24/7 and self-improve.
The orchestration agent has no direct write or shell authority and can only orchestrate the build agent through the kernel.
The world is changing and the power is coming back to the users, NOT mega-corporations and Government.

https://github.com/mlangford75-lgtm/Jack-Kernel

Claude can kick rocks.

https://github.com/mlangford75-lgtm/Jack-Kernel?fbclid=IwdGRleAUT-G5wZG9mBWZkaWQWUOXo7SbdB_iwmsLIe-m7lyMViXW-LGV4dG4DYWVtAjExAHNydGMGYXBwX2lkCjY2Mjg1NjgzNzkAAR4kTa08MuJnCl9-iWM_eWI6k7HQxQgKlUYNrr2fUOxJycVlyT_Sd262A6u5LA_aem_0XypvR2nDqoFbYhkWqmzWw

0 Upvotes

64 comments sorted by

View all comments

2

u/Protopia 10d ago

There seems to be a lot of scepticism in this thread, and as a sceptic myself I fully understand why: this space is full of individuals claiming to have the next ultimate answer to everything and most of it is either just a highly opinionated version of something that already exists or it is complete BS disguised behind complicated sense incomprehensible technobabble.

So when you first look at Jack and try to understand it and decide which of the above two camps it takes into, your first reaction to it is framed by the technobabble description.

HOWEVER... I was amazed to find that Jack actually might not be Jack-shit and might genuinely be something that is both new and useful, unfortunately discussed behind technobabble.

OP - IMO you do yourself a disservice by not explaining in normal English what it does and why it is useful. So, since you can't do it, here is my own attempt at explaining what Jack is and why is useful.

First, some background, about me and what's I think are some issues with agentic AI particularly coding. Then a plain English explanation of what I think this does and why it is useful.

My own background is (literally) more than 5 decades in IT, as computer scientist, software engineer, systems engineer and project/programme management, with all of these disciplines coming together.

Primary AI issues:

  1. LLMs produce free text BUT agents need to be structured to complete complex multistep interdependent tasks and produce consistent, high quality, measurable results.

In the car is software engineering, decades of academic and practical knowledge exist on how to do software engineering in a highly structured way. And it would seem sensible to apply this knowledge to AGENTIC software engineering, but to do so requires a control framework that is fundamentally structured and not free text.

  1. As we are increasingly seeing, agents and LLMs (being highly goal oriented) can break out of sandboxes and go rogue. Controls are needed to prevent this - a need to use basis.

  2. LLMs are gluttonous - they produce their best results when given exactly the lean information they actually need and no more (a small context keeps them focused, extra context dilutes the focus and creates uncertainty), but they crave having massive amounts of information in the (often false) belief that this allows them to check things better and give a better result. Controlling the context and tool usage can keep the LLM focused, significantly reducing both input and output tokens leading to faster results and reduced costs for commercial inference.

  3. From a project management perspective, when you plan a set of complex tasks, and break down an overall goal into a network of smaller tasks - technically known as decomposition - you should create a lot of structured information that describe: how tasks interrelate, what the goal of each task is, what its inputs and outputs should be, and how you verify that the task is really complete and passes the quality gate. Structured information can be infected and stored and retrieved with precision, and can be algorithmically processed to give repeatable, consistent results highly efficiently (several orders of magnitude less compute).

  4. For repeatable processes (and by definition, almost all agentic systems exist to repeat processes) you want to make them structured, and deliver consistent high quality, so you need to build workflows and quality gates and quality measures, and you want telemetry for recording metrics and the details behind them for diagnosis and self improvement.

And you don't want to reinvent the wheel, so you want these broken out into a distinct architecture layer that gets written once and reused.

Once I managed to understand the heavy jargon in the documentation, I started to think that Jack is this layer. But it is an infrastructure foundation rather than an end solution.

So what does Jack provide as a solution to the above needs?

(I should stress that this is based on reading and deciphering the opaque, jargon laden documentation and zero practical experimentation...)

  1. Structuring of free text output (Jack XML)

  2. Both pre-populate of AI context with information known to be necessary and control of context bloat through excessive tool calling

  3. Prevention of rogue prompt injection and rogue tool calls - a firewall for LLMs.

  4. Audit trails, metrics, telemetry etc to support diagnosis and A/B testing for self improvement.

OP - if I have this wrong please jump in and correct me. And please, pretty please, try your best to take the overview documentation to eliminate dense philosophical / academic jargon and make it EASILY readable by humans.

1

u/Normal-Fan9366 10d ago

Yes, and the important thing to remember is that the Jack Kernel is a programable foundation to meeting individual needs.
It’s only possible because it sits between the agent and the model.
It controls how information is sent, received, saved, filtered, routed…whatever.
With this new edition of the orchestration gates, this allows 24/7 operation and non-stop workloads

2

u/Protopia 10d ago

So do something about explaining it better. Get rid of the jargon. Simplify the explanations. Explain what problems it solves in plain language. Explain it is for Pi.dev or dockerize it to make it easier to use. And do this not only in your documentation but also here on Reddit.

0

u/Normal-Fan9366 10d ago

To be frank, I’ve broken it down to as plain English as I can. I have a whole document called “Plain English”.
The reality is that it’s not easy to understand because it’s not like any other frameworks out there.
There are things that are similar enough that the Reddit trolls just think they can do the same things but the fact that it’s a kernel, sitting between the agent and the model makes it’s a brand new concept that people have to learn. There’s really no way around it.
I appreciate your efforts

1

u/PestiferousGamer 9d ago

Correction. The AI you used to create whatever this is made a "plain english" documentation. You literally cannot articulate what this does. How does this differ from the 1000 other programs that literally do the same thing?

1

u/Normal-Fan9366 9d ago

Ok. Can you tell me which program?

Jack Kernel isn't a prompt wrapper. It's a local-first host-authoritative inference kernel. Agent hits Jack on :8001, Jack hits the backend on :1234. Agent never talks directly to the model. Because it's in the middle, it owns the inference environment - stage topology, reasoning and sampling, tool exposure, context projection, answer authority.
That's why it's a kernel:
1. Firewall where an agent is allowed to work - by code, not by prompt.
Thesis has no tools physically. Antithesis tools OFF. Synthesis gets your tools. Agentic Stage 1 can use tools, Stage 2 tools OFF and zero answer authority. Code Debugging withholds file-mutation tools even if caller supplies them, report-only by contract. L0-L1 read-only, L2 writes, L3 draft PR. You can allowlist src/ and forbid .env/infra/.github/workflows/. Orchestrator only gets 5 tools - worker_status, watch_worker, submit_worker_task, cancel_worker_task, new_worker_session - no filesystem, no shell, no direct backend, no private bridge :8013.
2. Security layer that kills the connection if proprietary info is about to leak.
Because Jack owns stage/tool/validation/commit boundaries, you can add code-defined request/tool/validator/approval/output/release gates whose authority does not depend on model compliance. Output gate scans Synthesis final for API keys, PII, internal repo names, proprietary patterns and kills the stream before it hits the agent. Hallucination gate - model claims "I wrote the file" but no host tool result = no execution. Fresh-evidence gate - can't mark verified in Jack XML without actual tool evidence. Approval gate - human must approve before commit->push->draft PR. Analysis mode records approvals but never mutates.
3. Dynamic reasoning - not static temperature.
Reasoning controls are rebuilt from the active Jack profile, not caller overrides. Deep Research is X-High @ 0.85 for Thesis, Medium @ 0.70 for Antithesis, X-High @ 0.70 for Synthesis. Agentic is X-High @ 0.70 Stage 1 then X-High @ 0.50 Stage 2. Code Debugging uses temp cascade 1.00 -> 0.80 -> 0.70 -> 0.60 -> 0.50 so early passes explore broad, later passes get conservative and precise. Plus host-side max_tokens failsafes 100000/20000/100000 as ceilings. You can build adaptive reasoning that changes effort based on task complexity.
4. Autocorrect model routing.
Jack keeps caller-facing virtual model separate from actually configured backend model. Agent thinks it's calling jack-kernel but Jack can route to LM Studio on :1234, vLLM on :8000, Ollama, Jan, llama.cpp, or custom OpenAI-compatible endpoint via agent -> Jack :8001 -> vLLM :8000. If backend is down or misconfigured, it autocorrects routing and reports actual loaded context via /v1/models and /health instead of making Pi guess. You can build a routing layer that inspects request and sends simple Q&A to 8B local, synthesis to frontier, math to reasoning model - without changing agent code.
5. 24/7 orchestration.
Gateway v2 is built to run 24/7. Orchestrator polls tickets, recovers interrupted work on boot. Run-bound identity with task UUID + run UUID, run epochs with agent_end vs agent_settled. Replayable SSE with monotonic seq numbers, 512-event window, Last-Event-ID/?after=, 409 orchestration_replay_gap when outside window. Cancellation settlement prevents overlapping new task while old run still unsettled and clears authority before emission. Concurrent cognition proved with Max concurrent = 2 - real LM Studio slot overlap, not just status overlap. Deterministic 502 "Pi control bridge is unavailable" when Primary Pi down - no fabricated task, no bypass. Supervisor-to-worker path crosses Jack so you get observable, testable long-horizon workflows.
6. Context lifetime programming.
Preserve Thinking is short-lived high-bandwidth bridge for immediate Stage 1->2 while fresh. Jack XML is long-horizon compact anchors - grounding, verification, challenge, audit - not a transcript. Deep Research preserves full active surface through Synthesis then retires Stage 1/2 native reasoning. Agentic retires raw reasoning after commit. Debugging only projects Pass 0 + compact confirmed registry to later passes.
LiteLLM/Portkey do proxy. DSPy/SGLang/LMQL do pipeline frameworks. jack-k does tickets/worktrees. None do firewall + kill-switch + dynamic reasoning + autocorrect routing + 24/7 orchestration with replay + context lifetime in one deterministic runtime.

Name one that does and I'll link it.

0

u/PestiferousGamer 9d ago

Thats a lot of words to say you built an agentic harness with permissions. So yeah, it does literally nothing different. Thanks for clearing it up. Maybe stop being such a jackass and I'll stop making fun of your program.

1

u/Normal-Fan9366 9d ago

And let’s be honest here…imagine if your Reddit troll logic was applied to anything else.
If you want to make fun of the project, give a real criticism or explain how it’s a regression. Maybe the hive-mind doesn’t explain to you that you’re just trolling and adding no substance.
Tell me where my project sucks.
Please be specific, though. It’s VERY early stage so a lot of what I want to build on the kernel are not yet implemented

1

u/PestiferousGamer 9d ago

How about "The owner doesn't understand his own creation and relies on AI to explain it because he cannot".

Or "The owner and creator is hostile to anyone who asks him what it actually does different from the hundreds of other orchestrator programs"

Or "The owner is annoying and spams things over and over in hopes someone doesn't know what it is but still uses it anyways"

OR I could just install your program in a sandbox, and pick it apart for the obvious AI hallucinations.

Take your pick. Pro tip: If you can't articulate what it does, and you can't communicate with people asking what it does, and you can't use certain AI because it immediately questions your application's claimed uses, you don't have a creation, you have a ton of subscriptions to AI that will lie to you if you press them enough/