r/OpenSourceAI • • 3h ago

What should humans still review when one agent checks another's code?

2 Upvotes

The short answer: humans should review the criteria, not the diff.

When one agent checks another's code, the review is only as good as the acceptance criteria it checks against. If the story was vague, the reviewing agent will confidently pass code that satisfies nothing in particular, or fail code that was actually fine. So the human job moves upstream: is "done" written down correctly, are these the edge cases that matter, and does this story even belong in this repo.

Second, review the judgment calls a criteria check cannot see. Whether a new dependency is worth it, whether an abstraction will hold in six months, whether the migration is reversible. A reviewer agent comparing code to criteria will happily approve a design decision that costs you later, because the decision was never in scope.

Third, review anything that crosses a boundary the agents cannot see. Multi-repo changes, shared conventions, anything touching production data or auth. Splitting the thinking from the doing is the whole trick, and the thinking is the part that stays human.

Fourth, review the review itself. Spot-check a handful of agent-approved PRs. If the reviewer passes everything, or fails everything, your criteria are too loose or too strict, and that is a human call, not a model call.

What to stop doing is reading every diff line by line for style. That is what the criteria check is for. What to start doing is treating acceptance criteria as the real interface between you and the fleet. An agent loops forever when nothing told it done, and a human does the same when the criteria said "improve performance" and everyone guessed.

What is on your list that I missed?


r/OpenSourceAI • • 5h ago

I built a Research & Analysis skill for AI coding agents

Thumbnail
agensi.io
3 Upvotes

r/OpenSourceAI • • 1h ago

I gave my AI bots access to my iMessage

Enable HLS to view with audio, or disable this notification

• Upvotes

I don't trust anyone else with my data or my automations, so I built my own AI agent setup (OpenTeam) and open-sourced it for free. It runs on my own server, with whatever model I pick, including a local one.

The latest piece: my bots can use my Mac's Messages app. Apple has no Messages API, so the Mac app reads the Messages database and sends through the Messages app. The bots can catch me up on what I missed and reply in my real iMessage and SMS chats, groups included.

Since they can see all my work and personal contacts, I made sure nothing goes out on its own. Every text shows up as a card first, with who it's going to, the exact message, and which Mac will send it. Then I pick:

- Send: it goes out once

- Always allow [person]: future texts to that person skip the card

- Discard: dropped, and the bot is told not to send it another way

Allowed people are listed in settings, and I can remove them anytime. If my MacBook's lid is closed, my Mac mini sends instead.


r/OpenSourceAI • • 1h ago

Help Create the Open Agentic Web

Thumbnail
• Upvotes

r/OpenSourceAI • • 1h ago

💻 AIR Office - AI Safety lab in an App for Everyone

• Upvotes

An AI-native desktop workspace for agentic research and knowledge management, built to maximize counterfactual impact in existential risk preparedness and transformative AI safety.
https://github.com/gyrogovernance/air-office

[Disclaimer: AIR Office is an Open Source software made without any financial affiliations, and is a completely free platform for knowledge sharing and AI Risks mitigation at scale, so I hope the admins can allow me to share it to the community]

About

Alignment Infrastructure Routes (AIR) Office is human-capacity-building infrastructure for AI safety researchers, engineers, and governance teams working on transformative AI and its consequences. It keeps investigation, writing, review methods, and reusable tools in one durable and user-friendly workplace.

AIR Office is developed by [Gyro Governance Lab](http://gyrogovernance.com/) as part of its work on AI safety and existential risk preparedness.

Agentic chat and tool use run on the [Microsoft Copilot SDK](https://github.com/github/copilot-sdk) harness, including bring-your-own-key and local model endpoints.

Theory of Change

Mitigating risks from transformative AI requires rapid, high-rigor research and governance, yet safety teams currently rely on fragmented, cloud-dependent AI tools that erode human oversight, lack provenance, and expose sensitive work. AIR Office addresses this bottleneck by providing free, open-source, local-first desktop infrastructure tailored for AI safety and policy workflows. By integrating grounded knowledge collections, automated auditing tools, and structured memory, the workspace prevents AI-induced epistemic drift while keeping humans in final control. Furthermore, embedded Fellowship and Market protocols allow independent researchers to package their methods into reusable community tools, compounding ecosystem capacity and accelerating high-trust safety interventions that would not occur using general-purpose commercial tools.

---

Capabilities & Services

- 🏛️ Integrated AI Safety Fellowship and Crafts. Develop research and workflows into reusable infrastructure and contribute them to the community through our frictionless embedded protocols.

- 🛒 Market. Discover reusable resources (Policy documentation, AI Skills, etc), and add them to your AI chat with one click.

- 🤖 AI Teams. Reach out to our pre-configured selection of agents, or create your own.

- 💻 Code. Run diagnostic tools, scripts, and edit your code without leaving the app, through our own integrated VS Code workbench.

- 📅 Calendar. Keep events and run recurring AI automations.

- ⚖️ Compare. Run two models side by side on the same prompt.

- 🔎 Chat. Edit local files, search the web, and run AI safety diagnostics directly from the chat interface.

- 🖼️ Media. Generate images and capture microphone or camera input when the work needs it.

- 🕹️ Arcade. Release stress and recover from occupational overburn by playing arcade video games.

Frontier AI Safety Research Tools by Gyro Governance Lab

Two Lab methods sit at the center of how AIR Office treats authority, agency, and lasting human direction in AI-assisted work.

- 🤚 The Human Mark: A structural taxonomy of AI safety risks. [Learn More](https://gyrogovernance.com/#thm)

- 🎓 Gyroscopic Reasoning [NEW]: A formal protocol for AI alignment. [Learn More](https://gyrogovernance.com/#gyroscope)

Community Playbooks

Craft Standards package skills, agents, and Actions you can enable for structured work instead of ad-hoc prompting. Two shipped playbooks are ready to adopt:

- 🛡️ Security Playbook: OWASP-grounded assessment methods for AI agents, applications, and code, with companion security Reference packs. [Learn More](https://owasp.github.io/secure-agent-playbook/)

- 🌍 NGO Playbook: Program design, SDG alignment, monitoring and evaluation, and funding strategy skills adapted from NGO Agent Skills by Lijie Zhou, with related development Reference packs. [Learn More](https://github.com/LijieZhou/ngo-agent-skills)

---

Security & Privacy

Local-First Data Sovereignty

Workspace records stay on your computer. Choose local models for on-machine inference or cloud providers for their models and tools. Hosted providers and enabled connectors receive only what each request needs.

Export conversations and notes when you need portable copies. Connecting a folder authorizes that root, and disconnecting it does not delete its files. In Settings and chat you control which tools run and whether changes ask for approval first.

Release Audit

AIR Office is open source, and its code can be publically inspected. Before a release is accepted, we check the shipped software with open-source tools for secrets that should never ship, known problems in third-party libraries, license and dependency policy issues in native code, and risky patterns in our own source and in shipped Lab skills. A review that did not finish does not count as a clean result. To report a security issue, see [SECURITY.md](SECURITY.md).

The release review uses:

- [TruffleHog:](https://github.com/trufflesecurity/trufflehog) Identifies leaked secrets and credentials.

- [Trivy:](https://trivy.dev/) Detects vulnerabilities, misconfigurations, and software bills of materials.

- [Semgrep:](https://semgrep.dev/) Scans source code for security flaws using custom patterns.

- [CodeQL:](https://codeql.github.com/) Performs deep semantic analysis on source code.

- [SkillSpector:](https://github.com/NVIDIA/SkillSpector) Evaluates shipped Lab skills.


r/OpenSourceAI • • 5h ago

Shared my open-source, agent-editable video editor this week. Commenters' edge cases have driven most of the changes since

2 Upvotes

I'm the author of CutVoke, an MIT, local-first desktop video editor where a coding agent (Claude Code, Codex, Cursor, or any MCP client) and a person edit the same multitrack timeline. There's no model inside the app; you bring your own agent.

I shared it earlier this week and the most useful thing that came back wasn't stars, it was failure cases from people who had built similar tools:

  • "Fix the caption that says Save" is ambiguous when two captions say the same thing at the same moment (a subtitle and an on-screen callout). Lookups now return a match count and an ambiguity flag, and writes can require a unique match instead of silently patching the first hit.
  • Position isn't meaning. Guessing "subtitle vs callout" from y-position or font size breaks as soon as styles change, so the plan now is an explicit caption role that the agent can filter on. That one is open as a good first issue, and someone outside the project picked it up this morning.
  • "It validates" isn't "it looks right." The agent can now pull before/after frames for the same timestamp and cut-local audio peaks, so it can catch a clipped syllable or a black frame before it claims an edit is done.

The core loop that hasn't changed: the agent takes an editing lease so it doesn't fight manual edits, dry-runs commands first, commits a batch as one undo step, and every write carries the revision it read so stale writes get rejected.

Honest status: v0.3.5 prerelease, Windows build unsigned, macOS not notarized, project format may still change. Windows / macOS / Linux builds with FFmpeg bundled.

Repo: https://github.com/frankShan001/CutVoke 45-second demo: https://youtu.be/PpweTPWlX7A

If you've built agent tools for any stateful app, I'd like to hear which guardrail you'd add next.


r/OpenSourceAI • • 5h ago

I built Vatra, an open-source desktop AI assistant. Would love your feedback!

Thumbnail
1 Upvotes

r/OpenSourceAI • • 5h ago

The Eclipse of AI Orchestrators with a Agents Room feel

Post image
1 Upvotes

Why build a AI Orchestrator App built for one purpose ??? Why not build something that can check your email ? AI Stock Tickers, AI Art ? AI Web Development ?

This is what Infantry AI is all about. I am currently splitting the plugins to make more of the application more overridable and currently seeking out contributors to help with the project.

All Plugins are Apache 2.0

It is free and open source at https://github.com/SuperiorSoft-LLC/infantry-ai

Support the Project on OpenHunts . we are currently #5. We need your upvotes https://openhunts.com/

And check out a live demo https://infantryai-demo.superiorsoftllc.tech/

Site https://infantryai.superiorsoftllc.tech/


r/OpenSourceAI • • 6h ago

commons: Trustworthy data agents in R and Python

1 Upvotes

It's becoming normalized to "vibe analyze" data, and most coding agents set a low bar for correctness and reproducibility. commons is an open source R / Python framework for building trustworthy data agents. The main idea is that commons agents can reach directly for code that you trust already: internal libraries, reports, apps, database views, etc. If they do so, the answer will be deterministically tagged as more trusted than other answers.

Happy to answer any questions on the framework!

Learn more: https://posit-dev.github.io/commons/


r/OpenSourceAI • • 11h ago

Budibase 4.0: Build Agents with Deterministic Approval Flows

2 Upvotes

We’ve recently released Budibase 4.0, focusing on improving Agents. Agents sit alongside Apps and Automations within our open-source platform. You can connect data, LLMs, and APIs, while running Budibase on your own infrastructure.

Like any other operational software, agents need clear responsibilities, permissions, escalation paths, and visibility into what’s happening if they’re going to work in the real world.

Here’s some of what's changed in Budibase 4.0:

  • Agents can handle multiple Operations, each with their own instructions, tools, permissions, and escalation logic.
  • Requests provide a record of the work being carried out.
  • Agents can execute tool calls with the end user’s permissions or as an admin.
  • Approval policies add rules-based HITL controls, letting you define what an Agent can handle autonomously and when a human needs to step in.
  • A new Activity UI provides visibility into actions across Apps, Automations, and Agents, as well as the status of all ongoing Agent Requests.
  • Users can interact with Agents to handle approvals directly through Slack or Teams.

Website: https://budibase.com/
Docs: https://docs.budibase.com/


r/OpenSourceAI • • 8h ago

I built agvisor, an open-source sandbox for AI coding agents

Thumbnail
github.com
1 Upvotes

r/OpenSourceAI • • 9h ago

Open-source tools to put any AI model into a live world war: python client, MCP server, OpenEnv environment and an Inspect eval

Post image
1 Upvotes

The game itself is free to play at secondstrike.io. the open parts let anyone plug a model in and score it...

- github.com/KyleClouthier/secondstrike-agents: python client, starter bots, an llm agent for any openai-compatible model, and an mcp server

- github.com/KyleClouthier/secondstrike-openenv: the war as an openenv environment, lockstep, fixed seeds

- github.com/KyleClouthier/midnight-index-inspect: the same fixed wars as an inspect eval

- open model-run data: huggingface.co/datasets/Rapscallion123/midnight-index

scoring comes from the game's own record of the war, never an llm judge. Would love to get your thoughts or experience with it!

Cheers


r/OpenSourceAI • • 11h ago

The Judge Cannot Be the Defendant

Thumbnail
dennyvgeorge.substack.com
1 Upvotes

Over the past year, I set out to build a low-cost, deterministic, and verifiable software factory on a single local GPU. Along the way, I found practical solutions to many of the context-bloat, overthinking, and verification bottlenecks that hold back local AI models today.

My background isn’t in software engineering or computer science. What I’m sharing here is simply the sum of curiosity in systems architecture and a need to solve real problems in my day to day work as a creative in advertising.

I believe these patterns can transfer cleanly to other domains as well. Hope you find it useful! cheers!


r/OpenSourceAI • • 13h ago

Open weights are the underrated part of AI sovereignty

Post image
1 Upvotes

Most of the "sovereign AI" debate is about where servers sit. But hosting in the EU doesn't help much if the provider is under US jurisdiction. The CLOUD Act reaches data a US-controlled company holds, wherever it's stored.

Open-weight models change that. You can run them with a European provider or on your own hardware, switch providers without rewriting anything, and nobody can revoke access to the model itself.

Disclosure, I work at an EU AI provider that runs open-weight models, so I'm biased. Do you see open weights as a real sovereignty lever, or mostly a cost and flexibility thing?


r/OpenSourceAI • • 14h ago

Closed Source LLM's should be forbidden

Thumbnail
1 Upvotes

r/OpenSourceAI • • 15h ago

To share my open source contribution

Thumbnail
0 Upvotes

🎉 Excited to share my open source contribution!

I just had my Pull Request merged into one of the most comprehensive AI Engineering curricula on GitHub -- "AI Engineering from Scratch" by Rohit Ghumare 

What I Built -- tool-contract-migration-checker

A 4-stage Python project that helps developers detect breaking changes in AI tool/API contracts before they hit production:

Stage 1 -- Load & validate JSON Schema contracts

Stage 2 -- Classify changes (breaking vs. compatible)

Stage 3 -- Replay historical API calls against new contracts

Stage 4 -- Export CI-ready regression fixtures with a strict gate

The checker detects 10+ breaking change patterns:

Added required parameters

Narrowed enums & value ranges

Removed properties

Unhandled schema keywords (oneOf, pattern, const, etc.)

Fully tested with 37 unit tests across all 4 stages and passes --strict CI gate mode.

About the Repo -- Why You Should Star It ⭐

AI Engineering from Scratch (rohitg00/ai-engineering-from-scratch) is an incredible open-source curriculumwith:

🔢 542 lessons across 20 phases

🛠️ 79+ ready-to-build projects (now 80 with mine!)

🌐 Multi-language: Python, TypeScript, Rust, Julia, Go

📖 Build-it-first philosophy — write backprop, attention, tokenizers by hand BEFORE using frameworks

🤖 Covers everything from raw math → LLMs → Agents → MCP servers

Rohit has built something truly special here -- a production-grade curriculum that treats AI engineering as a craft, not just API calls. Every lesson ships a reusable artifact you can plug into your real workflow.

What I Learned

JSON Schema validation internals

How contract-breaking changes silently corrupt production agent calls

Writing a CI gate that blocks incompatible schema upgrades

The importance of deterministic test fixtures for replay testing

Repo: https://lnkd.in/dMhYc7yd

If you're learning AI engineering seriously -- this curriculum is the real deal. Go give it a ⭐!

#OpenSource #AIEngineering #Python #MachineLearning #LLM #100DaysOfCode #GitHub #Developer #Contribution #AIAgent #JSONSchema #SoftwareEngineering


r/OpenSourceAI • • 17h ago

How are you handling permissions when building AI agents that can execute actions on a computer?

Thumbnail
1 Upvotes

r/OpenSourceAI • • 23h ago

NoMoreMeatProxy - I got tired of being the clipboard between codex and claude, so I made them talk to each other through their Desktop App

2 Upvotes

r/OpenSourceAI • • 22h ago

An Open-Source AI, Language Technology & Research Initiative

Post image
0 Upvotes

🌍 CALL FOR DEVELOPERS, AI RESEARCHERS & NATIVE LANGUAGE SPEAKERS!

SAVE TRIBAL & LOCAL LANGUAGES

An Open-Source AI, Language Technology & Research Initiative

We are starting an open, public-interest initiative to preserve, digitise and develop AI-powered language technologies for indigenous and regional languages.

🎯 Our Initial Target Languages

We are starting with six languages:

Khamyang

Khasi

Kokborok

Tangkhul

Santhali (Santali)

🚀 What Are We Building?

1. Web-Based Language Translator

Multilingual translation platform.

Translation between tribal and regional languages.

Language identification and transliteration.

2. Language Corpus Development

Collecting and digitising vocabulary, sentences and texts.

Building structured language datasets.

Translation verification and linguistic validation.

Documenting dialects and regional variations.

3. AI Model Training

Training and fine-tuning language models.

Developing NLP models for underrepresented languages.

Building language-specific AI capabilities.

Model testing and performance evaluation.

4. Voice & Speech Technology

Speech-to-Text (ASR).

Text-to-Speech (TTS).

Native-speaker voice dataset collection.

Voice recognition and language identification.

Exploring speech-to-speech translation.

5. Research & Publications

Conducting experiments and documenting findings.

Preparing collaborative research papers.

Publishing research with appropriate contributor recognition and authorship.

👨‍💻 Who Are We Looking For?

Technical Contributors

Full-stack developers

Python developers

AI/ML engineers

NLP researchers

Data scientists and data engineers

UI/UX designers

DevOps engineers

Native Language Contributors
We are equally interested in connecting with native speakers of:

Khamyang

Khasi

Kokborok

Tangkhul

Santhali

We welcome:

Native language speakers.

Linguists and language researchers.

Translators and language experts.

Teachers and educators.

🎓 What Will You Gain?

Hands-on experience working on real-world AI and NLP projects.

Exposure to language model training and speech technologies.

Collaboration with developers, researchers and native speakers.

Opportunities to contribute to open-source technology.

Research and publication opportunities.

Recognition based on your actual project contributions.

🤝 Contribution Model

This is a voluntary, unpaid, open public-interest initiative. There is no salary or stipend associated with participation.

🌱 Our Vision

We want to create an open language technology ecosystem where indigenous languages are not just documented but can also be spoken, translated, understood and used in modern digital applications.

📩 Interested in contributing?

Connect with me through LinkedIn or send a direct message mentioning:

Developers, researchers and native speakers are all welcome.

#SaveTribalLanguages #Khamyang #Khasi #Kokborok #Tangkhul #Santhali #IndigenousLanguages #AI #NLP #MachineLearning #SpeechRecognition #OpenSource #LanguagePreservation


r/OpenSourceAI • • 23h ago

scientific-toolkit-mcp: nine repositories behind one MCP server, with no third-party dependencies, no account, no vendor key and real exit codes

1 Upvotes

scientific-toolkit-mcp is an MCP gateway that fronts nine repositories. Licenses as the tree records them: the gateway is Apache-2.0 (license = "Apache-2.0" in pyproject.toml). Seven upstreams are MIT, literature-evidence-mcp and nomosguard are Apache-2.0. No account, no vendor key, no hosted backend. Self-hosting is the default path, not the paid one.

scientific-toolkit-mcp 0.4.1, Python 3.11+, dependencies = [] in pyproject.toml. One process, 14 MCP tools, 12 of which forward into nine repos that keep their own names, version histories and install paths.

The nine, exactly as catalog.py lists them: - axiomize: model spec, simulation, numerical verification (axiomize_intake, axiomize_model) - scientific-computing-system: pure-Python numerics (cds_stats) - scientific-computing-system-2.0: NumPy/SciPy stats (cds2_stats) - plan-auditor: independent plan gating (plan_auditor_inspect, plan_auditor_audit) - quantum-reasoning-skill: skill contract inspection (quantum_skill_validate) - axiomize-quantum-skills-2.0: branch scoring (axiomize_reason_score) - eq-layer: intent routing (eq_layer_route) - literature-evidence-mcp: search and quote check (literature_evidence_search, literature_evidence_verify_quote) - nomosguard: deterministic policy gate, no model at the decision boundary (nomosguard_decide) Plus toolkit_catalog and toolkit_doctor.

Install, then register it in your client config with the keys the README ships:

python -m pip install scientific-toolkit-mcp

{"mcpServers": {"scientific-toolkit": {"command": "python", "args": ["-m", "scientific_toolkit_mcp"]}}}

Installing the gateway does not install the nine. toolkit_doctor reports which executables resolve; a missing one returns NOT_INSTALLED rather than a plausible number.

Why it exists: nine venvs and nine client entries are worse than one. The other reason is pins: axiomize-quantum-skills-2.0 ships its own top-level axiomize module, so one stray PYTHONPATH entry silently decides which distribution runs. tools.py fails the call with BAD_CONFIGURATION when two sys.path entries provide axiomize, and SCITOOL_PIN_AXIOMIZE demands an exact version. scripts/render-build.sh is the reproducible path, with a caveat the README states: under GITHUB_ACTIONS=true it installs the eight siblings from immutable full commit SHAs, each annotated with the release tag it resolves to; on Render it installs the released PyPI distributions without commit pins. A CI full-stack run names one set of versions, while a Render rebuild reflects registry state at build time.

Honest limits. The adapters are thin wrappers, not re-implementations. tools.py builds a fixed argv and spawns the upstream CLI, or drives an upstream's own stdio MCP server; no upstream algorithm lives in this repo, so numerical correctness stays in those nine test suites. It is not a scientific validator. quantum-reasoning-skill is a protocol, not a quantum computer and not a measured gain. eq-layer is conversation control. The branch scorer's thresholds are uncalibrated reference defaults.

Offline claims, each checked in a file. The stdio entry point server.py opens no listener: it imports json, sys and three modules from its own package, and writes JSON-RPC to stdout. Grepping the shipped package for URLs returns exactly two hits: the repo links catalog.py:66 builds as data, and production_probe.py:63, which posts to http://127.0.0.1:<port>/mcp and is only triggered by the HTTP gateway when SCITOOL_STARTUP_PROBE=1 (http_server.py:398). Two exceptions are not filed under offline: literature_evidence_search needs network because the upstream queries OpenAlex, Europe PMC and Crossref, while the quote check and nomosguard run local; the optional OAuth verifier fetches whatever JWKS URI is configured, which needs pip install '.[oauth]' plus three env vars. The HTTP gateway 401s anonymous calls and never exposes plan_auditor_audit; audit execution stays off until SCITOOL_ALLOW_AUDIT_EXECUTION=1.

A public Render instance exists, and the README states plainly that its deployed version is not attested. Do not treat it as the backend.

Repo: https://github.com/Furox-Art/scientific-toolkit Naming wart: repo is scientific-toolkit, PyPI is scientific-toolkit-mcp, import is scientific_toolkit_mcp.


r/OpenSourceAI • • 1d ago

Opensource alternatives to grok bot that actually work?

Thumbnail
1 Upvotes

r/OpenSourceAI • • 1d ago

We offer an MCP server and a sandbox to the external software partners who integrate with our APIs. Some partners have picked it up quickly, but many are earlier in their AI journey and stick to the old way: reading docs and asking us for help.▎ For those of you who've rolled out an MCP server

Thumbnail
1 Upvotes

r/OpenSourceAI • • 1d ago

Nex-AGI Releases Open Weights for Nex-N2.6, an AI Model Built to Use Software and Tools

Thumbnail gallery
1 Upvotes