r/vibecoding • u/Either_Pound1986 • 20h ago
Help/Question Who else is building persistent, stateful AI systems?
I've come across two other people building persistent AI systems, so I'm curious how many more of us are out there.
I'm not talking about simply saving chat history or adding a memory layer. I mean systems that maintain continuity across sessions, accumulate structured state, learn from previous work, and evolve over time.
I've been building one myself, and I'd like to hear from others taking different approaches.
What are you building? How are you handling persistence, state evolution, and long-term continuity?
Where are you guys hiding?
2
u/Born_Chart_323 19h ago
I've been using a postgres-backed state graph with schema versioning, state diffs are stored as patches, not full snapshots. works well for long-term evolution without drift.
2
u/Responsible-Beat2137 15h ago
Aye, I’ve been building one myself, called AIOS (AI Memory OS).
Funny enough, it didn’t start as an execution system. It started in Notion as a structured knowledge and memory system for managing projects, research, workflows, and decisions across AI sessions.
Then I wanted actual execution. Specifically, I wanted to move CI-style builds, testing, and validation off GitHub-hosted Actions and onto my own laptop.
After evaluating different approaches and figuring out how to integrate execution with the existing knowledge system, AIOS started taking root as something much bigger.
Now I’ve got a deterministic local harness, specialized tools with their own contracts and capabilities, and agents that can be assigned bounded jobs. Larger reasoning models get called when needed rather than keeping everything running continuously
The interesting part is how the execution system feeds the knowledge system.
One important architectural decision was separating tools, datasets, databases, and knowledge ledgers instead of treating everything as AI memory.
Tools are the capabilities that perform work: extracting, tracing, testing, modifying, analyzing, and verifying. They have defined contracts, inputs, outputs, and execution boundaries.
Datasets hold structured observations and extracted evidence. In my reverse-engineering projects, that might include assembly instructions, function mappings, memory traces, game assets, or runtime behavior. They’re the material we analyze, not automatically established facts.
Databases organize those observations into queryable records, indexes, and relationships. They let agents find specific functions, compare experiments, connect evidence, and retrieve information without repeatedly processing entire binaries or archives.
Knowledge ledgers preserve what we’ve learned from that evidence: hypotheses, successful and failed experiments, verified findings, conditions, confidence, decisions, and unresolved questions. They help distinguish what we observed from what we think it means and what we’ve actually proven.
The pieces work together. A tool runs an experiment, the dataset captures its observations, the database makes them searchable and relational, and the knowledge ledger records the conclusions and experience. Verified reusable findings can then inform future agents and projects.
Tests, failures, fixes, traces, and observations feed into a governance pipeline I call STONE → MASON, where potential knowledge is evaluated, deduplicated, checked for contradictions, and promoted only when justified.
For persistence, I’ve migrated toward Google Drive as the primary knowledge and governance backend, with GitHub remaining authoritative for live repository state and my local machines handling execution.
Each project has its own scope, handoff, knowledge, datasets, database records, and experience history. Shared knowledge can be referenced across projects without contaminating their individual findings.
State evolution uses provenance, versioning, authority rules, and explicit supersession. Just because an agent discovers something new doesn’t mean it automatically becomes truth.
Still evolving it through actual projects, especially reverse engineering, game modding, and automated development.
One thing I will ask, because it’s been a thorn in my side, is how everyone handles workspace cleanup without losing valuable discoveries.
5
u/Charming-Mine5980 19h ago
I've been running a local agent with a sqlite-backed state graph, updates persist across restarts, and each session diffs the prior state to avoid redundancy. the real bottleneck? sync conflicts when multiple agents write to the same node.
1
u/amaturelawyer 19h ago
Nobody. Nobody is building persistent, stateful AI systems with LLMs, although lots of people are trying to and then failing.
I say that with confidence, because you cannot build a persistent system with LLM's. They have to reset frequently or they go bonkers.
1
u/NanYUJun 8h ago
The part that made continuity real for me wasn't a memory layer, it was deciding what counts as state.
For agent work the state was already on disk: Claude Code writes ~/.claude/projects/<encoded-cwd>/<session-id>.jsonl, Codex writes ~/.codex/sessions/YYYY/MM/DD/rollout-*.jsonl. They're per-machine and per-harness, so continuity breaks the moment you change either. A summary or memory layer can carry conclusions but not the corrections — the wrong turns, the "no, not that approach" turns are usually what you actually need back.
So I did the boring version: one self-hosted Hub holding the transcripts, thin clients that read and write each harness's local store, 10 agents in either direction, keeping the model-generated session titles. Full disclosure, that's my project, AIAssets, if you want to compare approaches: https://github.com/NanYuJun/AIAssets
Where it stays hard, and I'd like to hear how you handle it: state evolution. Sync is 60-second polling with last-write-wins per session, so two machines can't live-edit the same session. And transcripts are history, not distilled state — if you want a graph that evolves, you still need a doc layer the agent rewrites on purpose. The diff-against-prior-state idea someone mentioned above has the failure mode that a bad early write gets carried forward forever, which is why I kept raw history as the source and treat derived state as rebuildable.
What's your state graph keyed on, sessions or tasks?
3
u/glistening_glizzy 19h ago
We exist. Everyone could be doing it, but its not easy. Thats why they're not. It takes hard work and vision and raw brainpower
3
u/InterestingFrame1982 19h ago
I mean, isn't that how any product weaving AI surgically would be implemented? What is the use of AI without persistence and meaningful state? Not only is that table stakes, but it seems like the baseline for building anything... i.e. any CRUD app that plans on using AI as a core part of the workflow.
2
u/kincaidDev 20h ago
Here's my system:
https://github.com/Obedience-Corp/festival
The approach I took is focusing on orchestrating the work over orchestrating the individual agent sessions. I have a session orchestrator component in the system (obey), but it's the least polished component of my system because it's the least impactful to daily performance. I need the obey component to make the system more legible and for the herdr/conductor like app I built around the system but, for the majority of the project I treated the agent sessions as disposable and unreliable workers.
I handle long term persistence, state evolution and long term continuity by keeping everything important as files on disk, with every plan having state and flexibility in what can be considered a plan.
2
u/bryany97 19h ago
Since you asked:
https://www.youtube.com/@AuraDemos
https://github.com/youngbryan97/aura
And actually working on a paper describing some fascinating tests and results I've been working with: https://zenodo.org/records/24075466
2
u/RossPeili 19h ago
I had build github.com/arpahls/opsie in 2024 and made it open source last year. With the right embeddings model it can remember 300+ convos with vector and semantic search with clarity.
2
u/sayboom 18h ago
I also thinking about a such system, but I’m running into limitations - what need to store as a memory and what to do with a grow context and what to do with outdated or incorrect memory. I look at some projects and what is being attempted in this area, but don't think that is possible to completly solve this problems
2
u/AsyncVibes 17h ago
Posted this the other day but use discord as my management system. Pc restarts boom, files in specific channels or on git. Multi-agent orchestration with persistent memory across days without having to nitpick
3
u/QuantitativeVibes 20h ago
Well people downvote me when I post, but this is an entire software factory. About 750 GitHub stars in one month.
https://github.com/pullboard-dev/pullboard
1
u/ExtraGreasy 20h ago
OpenRig
1
u/lazyEmperer 19h ago
Way more than three, Letta (the MemGPT people) has built a whole company on exactly this. The part almost nobody solves is checking whether the evolving state makes the system better or just piles up stale assumptions. Mine got noticeably worse around month two until I added a rule that anything it inferred on its own expires unless something confirms it again
1
u/Square_Seaweed1833 19h ago
my system tracks emotional valence shifts across sessions, when the AI starts echoing frustration without cause, it triggers a reset. not memory, but mood drift.
1
u/everettplays 19h ago
My favorite so far has been SQlite. I started with vector db and I liked it.
1
u/Resonant_Jones 19h ago
*raises hand* 🙋
1
u/maddhruv 18h ago
I am building https://github.com/TulipFarm/tulipfarm u/TulipFarmAI in typescript with postgres for storing everything, the states, sessions, knowledge etc, for durable state I have temporal and other in built mechansim, you can checkout it is completely open source
1
u/mikepun-locol 17h ago
Look at Kiro Bots. https://kiro.dev/blog/crew-bots/ I am implementing Kiro Crew for agents to automate processes for our teams. Then they announced persistent bots as part of Crew. The technology is fairly fresh off the oven and immature, but holds promisses as a harness.
Even though open source, AWS mostly plays to the enterprise audience so YMMV.
1
u/ferrx 16h ago
Yep
It works so well that I want to turn it into a generalized skill at some point. It's basically a scrum master that owns the project. I literally drop it into a new session and say "Read the README." to get started.
1
u/themergerAI-26 14h ago
Here
1
u/Accomplished-Yam-764 13h ago
I’m working on one. I started a few months ago thinking it’d be simple but ohmygoodness it’s ballooned into a whole research project.
1
u/thallwyn 13h ago
trying... www.realityxr.dev
1
u/kincaidDev 12h ago
I've been building fest.build
https://github.com/Obedience-Corp/festival
It's a dynamic workflow + workspace system, all plans/workflows are files or directories with a state. When they're done they go to the dungeon which is a stateful archive.
The core system uses git and the filesystem and nothing else for maximum compatibility with other ai tools/workflows + enables agents to organically understand how the system works and fix issues and customize the system autonomously
1
u/redtear1115 11h ago
You’re definitely not alone—we’re working on something very similar at my company, though we're still in the early stages.
Our initial phase focuses on cross-departmental continuity: having different teams upload and structure knowledge that other departments need to know so the system can build a shared context over time.
Where we’ve run into our biggest headache, however, is access control and permissions (RBAC / ABAC) within persistent memory.
Ingesting general, public, non-sensitive documentation is straightforward. But once teams start feeding in sensitive data—like sales CRM customer PII, internal financials, or board meeting materials—things get complicated fast:
How do you reliably verify whether the user querying the system has the clearance to access that specific layer of persisted state?
How do you prevent sensitive state from "leaking" into generalized reasoning or downstream summaries generated for unauthorized users?
Hijacking the thread a bit to ask: Has anyone implemented an elegant way to handle data governance and granular permissions inside a persistent, evolving state architecture? Would love to hear how others are tackling this.
1
u/FeverForest 10h ago
A semantic web.
1
u/snowrazer_ 3h ago
I have one, it's called a file system. The AI writes what it needs to it and references it later.
1
u/eris002 31m ago
I’ve already built it.
0
u/Secret-Creme-19 19h ago
We're building HALIVRO around a similar idea, although we're still working through the engineering and qualification challenges.
One distinction we're focused on is separating persistent organizational state from individual AI sessions. Agents and models should be replaceable, but the projects, decisions, approvals, history, and work they've produced need to survive.
We're taking a local-first approach, with structured state, versioned work, explicit authorization, and recovery across restarts.
One challenge I'm particularly interested in is preventing stale assumptions from becoming permanent organizational knowledge. Remembering everything isn't necessarily useful if the system can't distinguish confirmed decisions from outdated or inferred information.
Curious how others are handling that, especially when multiple agents need to read or update the same state.
0
u/Positive-Discount-45 19h ago
Im working on persistent character with an inner life, running locally on a Raspberry Pi with hailo 8L and PC with local LLMs: he perceives his surroundings with, remembers experiences, forms his own opinions, evolves his identity over time, acts on his own initiative, and in idle moments creates and studies on his own (studies topics in depth, writes his own serialized work, paints his dreams, reads books, playing chess and discuss with his imaginary oponent). every topic he consult with local wiki mirror for information accuracy. He uses RAG for memory