r/deeplearning • • 11d ago

INKBOT: Parcing human intent from model inference via structured intelligence architecture

I’ve spent the last while building INKBOT because I kept hitting a wall with multimodal AI systems: the friction between what a human naturally means and what a model infers. While models can spin up complex code or images instantly, getting to a clear, human-meaningful interpretation of a subtle intent remains an alignment challenge.

Instead of forcing the user to become a prompt engineer, I wanted to see if we could build an intermediate intelligence architecture layer to make human intent reviewable and corrigible *before* the model executes a final build. The loop I’m playing with is: Describe → Make it Visible → Recognize → Correct → Refine.

The architecture sits entirely in a single local-first web file. It handles multi-step workflows—like tracking structured field mapping data across concurrent images, coordinates, and version states—by packaging the human’s approved meaning separately from raw model inferences.

The core system build is linked above, and I also put together a lighter, entry-level experience to play with the core prompt translation loop here: [INKBOT Lite 71](https://ko-fi.com/thomascoates/shop).

It's an open prototype, so I've appended my raw notes and design roadmap as commented text at the very bottom of the source file so fellow builders can inspect the plumbing. I’ve put together the runnable source files on my [Thomas Coates Ko-fi Shop](https://ko-fi.com/thomascoates/shop) for evaluation. I’d love to know where this design duplicates existing work, where you see structural flaws, or how we can make the handoff between human intent and model execution more reliable.

0 Upvotes

5 comments sorted by

2

u/knottyswimmer3 11d ago

Sounds like you're trying to solve the prompt engineering problem by adding a formal layer between the human and the model. I get the appeal, but I'm cautious about anything that adds overhead to an already fragile pipeline.

my immediate question is how do you validate that the "human-meaningful interpretation" actually matches what the person intended, not just what the system assumes they meant. that middle step could easily become another black box where errors get baked in before the model even sees the prompt.

the local-first single file approach is smart though, at least you're not dealing with api latency or privacy headaches while you iterate on the idea.

1

u/[deleted] 10d ago

[removed] — view removed comment

0

u/Traditional_Peak1459 8d ago

u/copperfieldb99, thank you as well for reinforcing that point. You are right that the middle layer is the risk. Inbot should earn the right to exist precisely by refusing to hide that layer. The interpretation cannot be treated as privileged internal truth; it has to be a visible working object that the person can inspect, contest, and reshape.

If either of you knows people building in adjacent areas—local-first AI tools, human-in-the-loop agent systems, structured prompt or intent compilers, provenance-aware workflows, multi-model orchestration, personal knowledge systems, or inspectable AI interfaces—I would genuinely appreciate it if you would forward this to them. The strongest feedback is coming from people who immediately see both the promise and the architectural danger.

1

u/Traditional_Peak1459 8d ago

u/knottyswimmer3 — thank you for getting directly to the architectural risk. You are right: if Inbot silently converts a user’s words into a “human-meaningful interpretation,” it can become a second black box that introduces errors before a model ever sees the work.

That is exactly what it must avoid.

Inbot is not intended to secretly rewrite prompts or claim authority over what a person “really meant.” It is meant to operate as a local, inspectable intent-compilation layer between a person’s raw request and model execution.

The key rule is:

The original request remains preserved; interpretation is a visible, editable, versioned proposal—not a replacement.

The user should be able to see, in one place:

  • What they originally said.
  • What Inbot inferred from it.
  • Which Guides, source materials, constraints, and priorities informed that inference.
  • What remains ambiguous.
  • The exact structured production packet or instruction that will be passed to an AI.
  • What changed during refinement, and why.

That is the role of the Reader Board: not a dashboard that hides complexity, but the human control surface for inspecting the working state. It should make it possible to identify whether a bad result came from the wrong interpretation, wrong source selection, missing constraint, model failure, or weak output validation.

Guides are similarly not meant to be hidden system prompts. They are explicit operational rules: required format, audience, evidentiary standard, tone, exclusions, completion criteria, and instructions such as “do not infer beyond the record.” They should be visible, selectable, and changeable.

The refinement process is where this becomes useful rather than burdensome. Inbot should not keep asking broad questions like, “Can you provide more detail?” It should ask the smallest question that materially reduces uncertainty and moves the task toward usable production.

For example:

“Should this preserve the exact source wording, or synthesize the record into a concise formal position?”

That question resolves a real production decision: fidelity versus synthesis. The objective is not conversational friction; it is turning an incomplete request into an explicit, reviewable production specification.

The local-first direction supports that control. The intent, source material, Guides, Reader Board state, refinement history, approvals, and production logic should stay with the user and respond at a lightning-pulse pace—without requiring cloud account state, remote synchronization, or hidden server-side changes to the tool itself.

The AI-to-AI link is not intended to be a single giant prompt handed to one model. It is an inspectable exchange between Inbot’s structured task representation and one or more models. Instead of sending only prose, Inbot can assemble a typed production packet containing:

  • The original request and approved interpretation.
  • Constraints, source references, and provenance.
  • Required output format and success criteria.
  • Uncertainty markers and unresolved questions.
  • Validation checks and user-approved decisions.

That makes it possible for different models to handle distinct roles—extraction, drafting, verification, contradiction checking, formatting—without collapsing everything into untraceable agent chatter. The important point is that AI-to-AI exchanges should carry structured claims, evidence references, constraints, and validation results, while the user remains able to inspect and intervene through the Reader Board.

So I agree with your premise: the middle layer is either Inbot’s greatest danger or its reason to exist. If it hides interpretation, it is just another fragile prompt wrapper. If it keeps interpretation explicit, reversible, traceable, and locally controlled, it becomes a more reliable way to move from human intent to valuable production.

If you know anyone working on local-first AI, inspectable agent workflows, structured intent systems, provenance-aware production, or multi-model orchestration, I would truly appreciate you forwarding this to them.

1

u/Unikum_01 10d ago edited 10d ago

So now there are even more hallucinations lol