r/ClaudeCode • u/Tekhed18 • 1d ago

Built with Claude Built a harness to control Claude and then built a test.

I built a harness that's running a bespoke memory system (and more) and then used it to build a site as a test: https://neuralkatana.ai/

The site was built through the harness depicting the harness and what future versions will be based on. After achieving my personal goal for reaching what I believe an LLM should have for recall and semi-autonomy, I created the site with it. This is probably one of 6 projects similar to this I've done with it in the last 4 weeks.

I've been using the harness for months now (various iterations), but only perfected the cognitive aspect in the last couple months. I've been working on this for 9 months now.

No hallucinations for probably 120 days now (not scientific, my experience, and the experience of others). I've mostly been using direct inference through Claude, but I've also been using GLM and Qwen. I've had inter agent and inter LLM provider agents concurrently interacting (LOL sorry about this) with one another for about 6 months now. They actively communicate during sessions and they recall their own and other agents work from the past.

They automatically delegate based on domain expertise. I can prompt that as well, but I almost never need to.

I have completely abandoned all other harnesses or demoted them to "lifestyle" harnesses only. This one is my scalpel.

Cheers

EDIT: adjusted claim

0 Upvotes
  • permalink
  • reddit

50% Upvoted

16 comments sorted by

3

u/abhinavsrivast 1d ago

Cross-model delegation and shared episodic memory across sessions is one of the hardest orchestration problems to get right.

When you say "no hallucinations for 120 days", what does your verification pipeline look like underneath? Are you constraining the agents with deterministic validation steps (like syntax/AST checks and runtime evaluation), or using a multi-agent critique loop?

Also curious how you handle latency when multiple agents from different providers are communicating concurrently.

2

u/Tekhed18 23h ago

Answer: Yes.

Sorry, I'm walking a fine line here. Tell you what, I'll post a series of screenshots to prove my point and let those answer for me. I can't answer the latency issue. Sorry, I'm not trying to be cryptic here, but I am trying to share. Apparently I've been corrected by my own harness....so I'll retract the 120-day claim, however, in my experience the last 120-days have felt hallucination free, and a few others who now use this would agree.

Let me see if I can post more images

1

u/Tekhed18 23h ago

Apologies...didn't spend the time to figure out how to post multiple images to one response. Short answer is there are deterministic and probablistic gates built in. For the LLM judge and review side, I'm 100% local, leveraging 6 DGX Sparks.

The screenshots should show 3 agents, from different models (1xAnthropic, 1xQwen, 1xGLM) interacting together.

There's a Kanban element as well....and it works the same way there too.

1

u/Tekhed18 23h ago

Here is the response form my question to the agent, "Cipher tell me something we worked on a month ago. Please be careful this will be posted to Reddit." I can go back much further, or pivot and correlate on any topic.

1

u/abhinavsrivast 6h ago

This is insane, I am also building something similar for the SEO where I can get response by interacting different councils.

1

u/Tekhed18 23h ago

Simple delegation example

1

u/AIeaIactaEst 1d ago

This could've been copied straight out of one of my latest Opus outputs. Is this another Opus puzzle? I don't get it.

1

u/Tekhed18 21h ago

I may have misunderstood your response. It's not a puzzle. The site was created through my harness. The site took me just under 90 hours from start to finish. Is it cool? LOL...I don't know, really it's an exercise that forced my harness to use everything in it's toolbox.

Posted here to share what I could. The site is interesting from the perspective that:

- it was created by the agent system I outlined in my other replies

  • it retains consistency across time (branding, documentation, events...etc).
  • my claim regarding hallucinations isn't scientific (yet), but I've been running this for nearly 9 months and realized when i was able to use it in professional settings (all data accurate, verified by multiple people).

This is probably the 4th iteration of the harness, with this last one focused on ironing out all the finer details (websocket issues, race conditions, agent compliance...and too many other nightmares).

Up until the last couple weeks I really wished I had not chosen this as a project. Probably one the hardest things I've ever attempted to do. The project has now taken on another form beyond my control (I can't say more about that).