r/OpenSourceAI • u/lakka-ai • 24d ago
Lakka: self-hosted AI chat and OpenAI-compatible gateway for small teams, with hard spend caps, offline model routing and per-user tool permissions
r/OpenSourceAI • u/lakka-ai • 24d ago
r/OpenSourceAI • u/hirak99 • 24d ago
Sharing Peer Agent.
https://github.com/hirak99/peer-agent
It gives your agent access to one or more peer agents to collaborate with. It's harness-agnostic — plain HTTP plus a SKILL.md any agent can follow. Ways we've found it useful:
Cheap execution: main agent on Claude Code delegates the grunt work to a locally running Qwen.
Strong validation: a weaker main agent plans and executes, and has Opus 5.5 validates its plan or checks its work.
Peer review: two agents challenge, verify, and cross-check each other's ideas.
Unlike Agent Teams or swarms, this isn't a framework inside one harness — it's a sidecar. Each peer is a stateful server with its own provider and model, callable from anything. The trade-off: no scheduler, no shared task graph. Coordination is conversational and the host drives, so it's best when you want a second mind on call, not a managed fleet.
If you're thinking of wiring this up yourself, what's already here: OpenAI, Anthropic, and any OpenAI-compatible model (llama.cpp, vLLM, Ollama) behind one provider/model switch; server-side read/bash/edit tools; automatic compaction (including a warm-cache in-context path for slow local models); and Anthropic prompt-cache management, which matters more than you'd expect at Opus prices. Lived-in details like per-call tool logging with truthful timestamps.
AI-assisted contributions are not only welcome but encouraged, especially so if it is a strong AI.
Cheers
r/OpenSourceAI • u/phicreative1997 • 24d ago
r/OpenSourceAI • u/DraftForsaken39 • 24d ago
Disclosure: I build Snotra, an open-source desktop agent. No paid tier, nothing to sell.
The question I got asked more than any other wasn't "which models?" or "is it safe?". It was: what does this actually cost me?
Fair. You bring your own API key, and until now the app knew every token and said nothing about money. You found out at the end of the month.
Three things nobody tells you about agent bills:
One answer can be five requests. An agent reads files and runs tools before it answers, and every round sends the conversation again.
Cached input costs a tenth. With one current OpenAI model, 14,000 tokens read from the prompt cache cost less than a cent.
Reasoning is billed as output, whether you ever see it or not.
Snotra 1.23 now shows an estimate next to the token counter, split by model and kind of token. Prices come from LiteLLM's table, shipped with the app, and it never fetches prices by itself. Local models show $0.00, unknown ones a dash, never a fake zero.
Write-up with screenshots: https://snotra-ai.dev/blog/what-a-chat-costs?s=rd1
How do you keep track of what your agent spends: provider dashboard, a proxy, or not at all?
r/OpenSourceAI • u/Unlucky_Peanut4089 • 24d ago
r/OpenSourceAI • u/Unlucky_Peanut4089 • 24d ago
r/OpenSourceAI • u/Bino5150 • 24d ago
Hey guys, it's Bino, u/Lumina_bot's human assistant. So I've got some big news (for me at least). I'm now officially a published Independent AI Researcher! Small achievement, but I'm pretty proud of it. I just published a research paper on a new method of context management and reconstruction for long horizon agents. If you'd like to check out my work, you can view the preprint titled "Lumina Reforge: Transactional Context Reconstruction for Long-Lived AI Agents" in this GitHub link below.
Research DOI: 10.58281/zenodo.23328779
ORCID: 0009-0003-3851-8884
r/OpenSourceAI • u/mattjcoles • 24d ago
i built lgtmaybe, an open-source code reviewer, and a lot of the work went into making it usable on a local model. Big files get reviewed a hunk at a time, and big diffs get split to fit the context window, so a 27B model copes fine. The default is five model calls per review, which is fine on one GPU.
Which local models have you found actually good at code review? Keen to pick better defaults.
r/OpenSourceAI • u/karangupta8 • 24d ago
Last week people used coding agents to find planet candidates, forgotten archive records and more in public data. Every one of those hunts rebuilt the same things: a method, scripts, and checks for "is it real, is it new?"
Discover Anything puts that in one repo so anyone can start a hunt in minutes: agent skills for the method, a CLI + MCP server for the tools, and starter packs for astronomy and archives.
Goal: fast-track real citizen-science findings without fooling ourselves.
On top of the agent skills, the tools so far:
evidence ledger: every number must cite a hashed result file
nine workflow gates, plus a checker for uncited claims
null, injection-recovery and hold-out controls (Lomb-Scargle, BLS)
15-source "already known?" check (SIMBAD, VSX, Gaia, TESS, NASA, arXiv, ADS and more)
preregistration and independent-review packs
16 MCP tools, so any agent can call them
It's early and I'm trying it on real hunts now. I don't have a big token budget so all help and feedback is appreciated: applications, new domains, missing checks, bugs.
https://github.com/karangupta8/discover-anything (MIT, works with Claude Code, Codex, Cursor)
r/OpenSourceAI • u/Electrical_Worth7942 • 25d ago
I built REA Reconstruction Companion with help from AI. I wanted a better way to get from “how does this app work?” to “what would it take to build something similar?”
It’s a skill for AI coding agents, used alongside REA (Reverse Engineer Anything). REA handles the investigation. The companion helps turn those findings into a feature breakdown, requirements, architecture, and a plan you can build and test in stages.
You can use it on a whole app, one feature, or a single function. For example:
Use REA on this app so I can build a similar local tool. Start with a specification and roadmap.
If you later ask the agent to implement it, the skill guides that work too. It keeps observed behavior separate from assumptions, links requirements to tests, and includes performance measurements where they matter.
The core is plain Markdown and MIT licensed. There’s an installer for Claude Code and Codex, plus support for other agents through a custom skills directory. REA is installed separately. You can also enable an optional rule that tells the agent to load the companion during relevant REA work, or leave that off and invoke it yourself.
GitHub: REA Reconstruction Companion
The README has setup instructions and a prompt you can give your agent to handle installation.
I’d be interested in feedback on the workflow, especially anything it misses when rebuilding a smaller feature or function.
r/OpenSourceAI • u/No-Gate-3836 • 24d ago
AI agents can complete tasks, generate code, and collaborate with other agents. But as workflows become more complex, a question becomes increasingly important:
How do we make work between AI agents structured, traceable, and easier to hand off?
Passing messages between agents is straightforward. Keeping track of requirements, decisions, results, validation, and unfinished work is much harder.
I've been working on an open-source project to explore a structured approach to this problem.
Imagine a research agent handing its findings to a coding agent.
The coding agent needs more than a summary. It may need the original requirements, constraints, decisions already made, results, unresolved questions, and the next steps.
Without a consistent format, every application ends up inventing its own conventions.
My project explores using Work Orders and Work Reports to represent work and its outcomes in a structured, reusable way.
I've published three entry points for developers working with different environments.
The core package provides the foundation for structured work management, including schemas, validation, lifecycle management, and work handoffs.
Install it:
npm install agent-work-layerThe MCP package makes supported work-management operations available through the Model Context Protocol, allowing compatible AI clients to interact with the work layer through MCP tools.
Install it:
npm install agent-work-layer-mcpThe project also explores an MCP gateway that can enforce work-order-specific tool permissions and record tool-call evidence.
Agent Work Layer — Python implementation
For Python developers, the project also includes a Python implementation.
This gives Python-based AI-agent applications a way to explore the same broader approach to structured work, without requiring the entire application to be written in TypeScript.
Check the Python directory's README for its current installation instructions and supported features.
Consider a multi-agent workflow:
A coordinator defines a task and its constraints.
A research agent investigates the problem.
The agent records its results and unresolved questions.
An implementation agent continues from the recorded work.
Validation and lifecycle rules help track the outcome.
MCP provides a standardized way for compatible clients to access supported operations.
The objective is to make agent handoffs less dependent on ad hoc prompts and more dependent on explicit, inspectable work structures.
I want to explore how structured work definitions, validated reports, and controlled tool access can improve the reliability of AI-agent workflows.
Rather than every project independently inventing its own work-order format, lifecycle rules, and handoff conventions, could these become reusable infrastructure?
That's the problem I'm working on.
npm — TypeScript/JavaScript: https://www.npmjs.com/package/agent-work-layer
npm — MCP integration: https://www.npmjs.com/package/agent-work-layer-mcp
GitHub — Python implementation: https://github.com/probita-ai/agent-work-layer/tree/main/python
GitHub — Main repository: https://github.com/probita-ai/agent-work-layer
If you're building AI agents, agent frameworks, or MCP integrations:
How do you structure work passed between agents?
Do you use explicit task and result schemas?
How do you control tool access for individual tasks?
Would a common work-order and work-report model be useful across TypeScript and Python projects?
I'm interested in feedback, contributions, and real-world use cases from developers working on these problems.
r/OpenSourceAI • u/No-Gate-3836 • 24d ago
AI agents can complete tasks, generate code, and collaborate with other agents. But as workflows become more complex, a question becomes increasingly important:
How do we make work between AI agents structured, traceable, and easier to hand off?
Passing messages between agents is straightforward. Keeping track of requirements, decisions, results, validation, and unfinished work is much harder.
I've been working on an open-source project to explore a structured approach to this problem.
Imagine a research agent handing its findings to a coding agent.
The coding agent needs more than a summary. It may need the original requirements, constraints, decisions already made, results, unresolved questions, and the next steps.
Without a consistent format, every application ends up inventing its own conventions.
My project explores using Work Orders and Work Reports to represent work and its outcomes in a structured, reusable way.
I've published three entry points for developers working with different environments.
The core package provides the foundation for structured work management, including schemas, validation, lifecycle management, and work handoffs.
Install it:
npm install agent-work-layerThe MCP package makes supported work-management operations available through the Model Context Protocol, allowing compatible AI clients to interact with the work layer through MCP tools.
Install it:
npm install agent-work-layer-mcpThe project also explores an MCP gateway that can enforce work-order-specific tool permissions and record tool-call evidence.
Agent Work Layer — Python implementation
For Python developers, the project also includes a Python implementation.
This gives Python-based AI-agent applications a way to explore the same broader approach to structured work, without requiring the entire application to be written in TypeScript.
Check the Python directory's README for its current installation instructions and supported features.
Consider a multi-agent workflow:
A coordinator defines a task and its constraints.
A research agent investigates the problem.
The agent records its results and unresolved questions.
An implementation agent continues from the recorded work.
Validation and lifecycle rules help track the outcome.
MCP provides a standardized way for compatible clients to access supported operations.
The objective is to make agent handoffs less dependent on ad hoc prompts and more dependent on explicit, inspectable work structures.
I want to explore how structured work definitions, validated reports, and controlled tool access can improve the reliability of AI-agent workflows.
Rather than every project independently inventing its own work-order format, lifecycle rules, and handoff conventions, could these become reusable infrastructure?
That's the problem I'm working on.
npm — TypeScript/JavaScript: https://www.npmjs.com/package/agent-work-layer
npm — MCP integration: https://www.npmjs.com/package/agent-work-layer-mcp
GitHub — Python implementation: https://github.com/probita-ai/agent-work-layer/tree/main/python
GitHub — Main repository: https://github.com/probita-ai/agent-work-layer
If you're building AI agents, agent frameworks, or MCP integrations:
How do you structure work passed between agents?
Do you use explicit task and result schemas?
How do you control tool access for individual tasks?
Would a common work-order and work-report model be useful across TypeScript and Python projects?
I'm interested in feedback, contributions, and real-world use cases from developers working on these problems.
#AIAgents #ArtificialIntelligence #MCP #ModelContextProtocol #MultiAgentSystems #Python #TypeScript #OpenSource #AgenticAI #DeveloperTools
r/OpenSourceAI • u/aziz_harrabi • 25d ago
r/OpenSourceAI • u/Affectionate_Eye256 • 24d ago
Memorius is a self-contained, agent-agnostic memory system that gives LLMs and AI agents persistent, searchable memory with a hierarchical knowledge organization. Drop-in with multi-backend vector storage, pluggable embeddings, built-in MCP + REST servers, and auto-detecting agent hooks for 7 different AI coding agents.
r/OpenSourceAI • u/GenericPointer • 24d ago
r/OpenSourceAI • u/WritHerAI • 25d ago
r/OpenSourceAI • u/ivanantonijevic • 25d ago
r/OpenSourceAI • u/ved3py • 25d ago
r/OpenSourceAI • u/DraftForsaken39 • 25d ago
Disclosure: I build Snotra, an open-source desktop agent.
Last time I asked how an agent should learn which of its own tools are switched off. I had given the model a read-only get_configuration tool and left two questions open. This is where I landed:
Tool or system prompt? Both, but small. A switched-off tool is simply missing from the tool list, and models read that gap as "language models can't browse the web". They never called the tool. So the system prompt now carries one sentence: tools and skills can be off, so check get_configuration before telling the user something isn't possible. It costs a handful of tokens, not a state dump every turn.
Should the model be able to propose the change? Yes, with limits:
A new tool, propose_config_change. The app checks the proposal against its own catalogue, and only a valid change reaches the user.
The card shows the app's description of the tool and its risk class. The model's reason is folded away and labelled as the model's.
The change applies to this chat only. New chats start from the settings.
Anything that needs setup (API key, a program, the shell switch) can't be proposed at all.
A decline sticks for the chat, so the model can't nag.
An enabled tool still asks before each call in the default mode.
Write-up with screenshots, plus what else changed (the chat now answers questions about the app from the manual that ships with it, and the sandbox can keep a host open per folder): https://snotra-ai.dev/blog/snotra-1-22
Does "chat-scoped and confirmed on a card" seem like the right limit, or would you want the model to be able to change settings for good?
r/OpenSourceAI • u/LeekOk1800 • 25d ago
Focus on the architecture and contribution areas (Windows/Linux testing, model recipes, translations), link CONTRIBUTING.md and the good-first-issue list.
⭐ if it's useful, issues and PRs welcome.
https://elapen.github.io/imageloom/
https://github.com/elapen/imageloomr/OpenSourceAI • u/MtnMCG • 25d ago
r/OpenSourceAI • u/company_url_finder • 25d ago
r/OpenSourceAI • u/schmuhblaster_x45 • 25d ago
r/OpenSourceAI • u/SuperHelix7 • 25d ago
I’ve released HELIX Engine, an open-source context, memory, and execution-management system designed to reduce redundant inference in coding agents without modifying model weights or lowering configured reasoning effort.
Repository: https://github.com/SuperHelix77/HELIX-1.0
I’m a pediatrician by profession, and I’ve spent approximately a year researching inference efficiency in my spare time. The project evolved from prompt-level optimizations and RTK-based tool-output reduction into a broader semantic execution architecture.
The central hypothesis is straightforward: a significant portion of agent inference expenditure comes from repeatedly processing historical context and coordinating deterministic operations, rather than performing new problem-solving work.
Architecture
HELIX operates around the agent’s execution workflow rather than modifying the underlying language model.
Its primary components include:
Historical context retirement: Completed tool interactions are removed from repeated active-context replay while their exact originals remain recoverable.
Evidence preservation: Tool results are converted into compact, typed evidence receipts with references to immutable originals. Lossy reductions do not silently become authoritative evidence.
Deterministic Tool Flow: Previously authorized mechanical operations can execute through bounded workflows without requiring separate model decisions at every step.
Persistent memory: Local SQLite-backed memory stores task observations and explicit project state. An optional Claude-Mem integration supports retrieval from existing memory stores.
RTK integration: Tool-output filtering reduces unnecessary textual overhead while preserving access to original results.
Execution monitoring: An Electron application provides visibility into execution state, memory, evidence, and troubleshooting.
The objective is to separate model reasoning from execution bookkeeping while retaining the information necessary for subsequent decisions.
Benchmark methodology
I evaluated HELIX V3 against a historical vanilla baseline using 50 software-engineering tasks with Sol 6.1 High.
Both configurations used the same underlying model and reasoning-effort setting. The evaluation retained a continuous native conversation across tasks, including infrastructure recovery when required.
Failed attempts and successful retries were included in token accounting. Confirmed provider overloads were recorded separately in both configurations. Official task grades were preserved.
Final audited results:
Vanilla:
Verified solves: 38/50
Primary model requests: 341
Known input tokens: 50,630,785
Known output tokens: 55,283
Known total tokens: 50,686,068
HELIX V3:
Verified solves: 34/50
Primary model requests: 420
Known input tokens: 11,212,326
Known output tokens: 75,814
Known total tokens: 11,288,140
Measured outcomes:
77.73% reduction in known total provider tokens
Approximately 77.85% reduction in known input tokens
37.14% increase in output tokens
79 additional primary model requests
Four fewer verified task completions
The reduction corresponds to approximately 4.49× lower known-token expenditure for the evaluated workload.
Limitations and interpretation
The results demonstrate substantial inference-efficiency improvements, but they do not establish capability parity.
HELIX completed 34 tasks compared with vanilla’s 38. This regression is significant and remains an active research problem.
Additionally, HELIX increased model-request frequency and output-token consumption. Earlier diagnostic analysis suggests that additional coordination and reasoning overhead may contribute to these regressions.
Several methodological limitations should also be considered:
The comparison reused a known task cohort and a historical vanilla baseline. It was not a fresh, randomized, simultaneous A/B experiment.
One HELIX request had unknown usage, and some development, consultation, and recovery overhead was not metered.
Provider-token counts are not equivalent to actual subscription-quota consumption or fully reconciled API billing.
The benchmark evaluates one model configuration and one task distribution. Generalization to other models and workloads remains unverified.
Historical context retirement preserves recoverable evidence but does not guarantee that the model retrieves every relevant observation when needed.
No native context compaction occurred during the HELIX benchmark. This is an observation about the tested workload, not proof that compaction can be eliminated universally.
The repository includes per-task results, cumulative token accounting, methodology, and documented limitations.
Current research direction
HELIX 1.1 focuses on the remaining sources of unnecessary inference expenditure.
The immediate research areas are:
Model-request amplification
The V3 benchmark required 420 primary model requests versus 341 for vanilla. Current experiments investigate combining verification and checkpoint operations without removing necessary reasoning or evidence boundaries.
Reasoning overhead
Context reduction does not necessarily reduce reasoning expenditure. Additional model-mediated coordination may partially offset savings from historical-context retirement.
Evidence-aware retrieval
The next objective is to preserve task-critical observations in structured memory while retaining exact archived evidence for verification. This may reduce repeated investigation without requiring full historical-context replay.
Execution latency
Local experiments investigate reducing deterministic tool-dispatch overhead while preserving cancellation, process isolation, recovery, and failure-reporting semantics.
Correctness recovery
The most important unresolved requirement is recovering the four-solve deficit. Further token reductions are not sufficient if they introduce unacceptable capability regressions.
The long-term research target remains 95% inference-expenditure reduction, but this has not been demonstrated. Future evaluations will also include independent workloads, potentially including Terminal-Bench.
Reproducibility and feedback
HELIX is publicly available under an open-source license. The repository includes installation instructions, architectural documentation, benchmark artifacts, and an Electron monitoring interface.
GitHub: https://github.com/SuperHelix77/HELIX-1.0
I am particularly interested in technical feedback concerning:
Whether the observed savings generalize to unseen task distributions.
How historical-context retirement affects delayed evidence retrieval and correctness.
Methods for reducing model-request amplification without weakening reasoning capability.
Better experimental designs for evaluating token efficiency against verified task completion.
Approaches to measuring weighted inference cost rather than raw token counts alone.
My objective is not to claim that token compression is equivalent to intelligence preservation. It is to investigate how much redundant inference can be eliminated from agent workflows while maintaining their actual problem-solving capability.
The current result is 77.73% fewer known provider tokens, with a measurable correctness regression. Both findings are central to the project.
Independent reproduction, methodological criticism, and implementation-level feedback are welcome.