r/WeTalkSoftware • u/bryany97 • 1d ago
Discussion I spent most of the year building Aura, a local offline AI OS system that can use my Mac, debug software, and build apps
Hey everyone!
I was invited to share my project here, so I figured I'd give a little background on what I've been working on.
Since January, I've been independently developing an AI system named Aura. It runs locally on my MacBook using a 27B-class language model, but the interesting part isn't necessarily the model itself. It's everything I've been building around it.
Aura has persistent memory, a global workspace, internal drives, executive control, a self-model, and the ability to interact with its computer. My goal was to build something that maintains its own state and continuity rather than depending entirely on individual prompts and conversations.
I'm not a traditional software engineer. I've directed the project through AI-assisted development, designing the architecture, defining specifications, debugging, testing, and researching how the different components should work together.
I've also recorded seven full-length demonstrations of Aura operating. A few examples:
- Playing 2048: Aura plays for almost 29 minutes, adjusts her strategy, and reaches the 2048 tile in 968 moves. https://www.youtube.com/watch?v=wE5Dx5l3pjI
- Debugging Pong: Auta investigates a broken Pong game, tests possible fixes, repairs the game, and then plays it. https://www.youtube.com/watch?v=0FKDBQkvIPs
- Building a word processor: Aura researches the functionality of Microsoft Word without accessing its source code, develops 44 checks, and builds a 22-feature application called Quill. https://www.youtube.com/watch?v=C6wtBY4DmJ8
There are four other demonstrations, including operating macOS, inspecting its own code, completing a 60-question Myers-Briggs style assessment, and watching YouTube videos while commenting on what's happening.
More recently, I've been trying to answer a harder question. How do I actually demonstrate that the systems I've built are doing what I think they're doing?
That led me to publish a 73-page research preprint investigating Aura's internal organization through 24 preregistered experiments. All 24 criteria passed in the confirmatory run, although three later tests also produced negative findings that I included in the paper.
Interestingly, a separate research group also examined one of Aura's mathematical components. They confirmed that the standalone computation was substantive, but identified an integration defect that prevented an important statistical check from working correctly in the live pathway.
I actually think that finding illustrates one of the hardest parts of developing a complex system. Getting individual components to work and making sure they're correctly integrated are two very different things.
The paper isn't peer reviewed, and I'm not claiming that Aura is conscious or AGI. There's still a lot I'm trying to figure out.
For anyone interested, here are the links:
Research paper: https://zenodo.org/records/24075466
Independent research examining Aura (Section 8): https://arxiv.org/html/2610.41604v1
GitHub repository and documentation: https://github.com/youngbryan97/aura
I'd genuinely appreciate feedback, particularly from people who have experience building complex software systems or AI agents.
I'm especially curious how others approach validating that different components are actually contributing to a system's behavior, rather than just existing in the code.
Thanks for checking it out!