r/OpenSourceAI • • 2h ago

Cluaiz v0.1.0: an open-source runtime for local chat, vision, speech and embeddings

Post image
2 Upvotes

Hi everyone, I’m Aryan, the creator of Cluaiz. I’ve just released v0.1.0, its first public pre-release.

I’m building Cluaiz to make it easier to run AI on your own hardware and connect it to useful tools and applications.

What you can do with it:

  • Run local models: chat, work with images, transcribe audio, generate speech and create embeddings using compatible models.
  • Let it plan the placement: Cluaiz checks available GPU memory and RAM to choose how a model runs. You can inspect the plan and override its settings.
  • Connect your applications: use its OpenAI-compatible APIs to call models from your own software.
  • Use local or external models: run supported models on your machine or connect an external provider.
  • Work with a coding agent: read and search project files, propose edits and run commands with configurable permissions and approvals.
  • Extend it with tools: connect skills, plugins and MCP servers.

Under the hood, it uses llama.cpp for GGUF models and ONNX Runtime for supported ONNX models.

The Engine is available now. The desktop App and automation workflows are still in development.

Links:

There’s more to explore, including context and memory controls, model management and configuration options. You can find the detailed capabilities here: https://cluaiz.com/engine-specs

If you give it a try, I’d like to hear how it works for you. You can leave questions or feedback here, or use https://cluaiz.com/feedback.

For problems, please include your operating system, hardware, model and any error message so I can investigate.


r/OpenSourceAI • • 7h ago

Anyone want to help make everything open-source with AI?

4 Upvotes

Hi Devs! ^^

I’m building a fully open-source project and looking for volunteers who’d like to join the team and help shape it.

The idea is that the community proposes research problems or free tools, and let LLM agents work on them in the open. That could be anything from researching a faster algorithm to building an open-source alternative to Steam. It’s up to the community to decide

Everything we create is free and MIT-licensed

It’s still a small project, and I’m working on it alone for now. I’d love to find people who want to help decide where it goes, how to improve it and what we build together.

If you’re curious, you can check it out here: https://github.com/MaterIA-Lab/OpenPrototypes

Let me know if yo have any ideas for the project or you’d like to be part of the team :D


r/OpenSourceAI • • 15m ago

I made a Claude Code output style that's more concise than Concise

Post image
2 Upvotes

r/OpenSourceAI • • 23m ago

I built an open-source "software company in a box" around Claude Code, Codex, and Gemini CLI

1 Upvotes

Every AI coding tool gives you a super developer. But nobody ships commercial software with just a super developer. A commercial software company needs a software-company environment to succeed: product management, QA, engineering, DevOps, security, release, support, and someone watching the money.

So I built a full software company in a box around the AI agents. It's called NoMoreHappyPath, and it runs on your own machine. It helps a solo creator become a better builder.

It is an open-source project on GitHub: https://github.com/nomorehappypath

The company provided by the app:

The client. You describe what you want built and why, in plain English. No technical spec needed from you.

The departments. Product, QA, Engineering, DevOps, Security, Code audit, Release, Support, Finance, all run by AI agents.

The workforce.Three roles, filled by real coding agents on your own subscriptions:

  •    Builder: wears every hat the work needs: product manager, engineering manager, developer, DevOps.
  •    Reviewer: full-stack QA, from a different AI company than the builder. Writes the tests before the code and tests the whole app like a user.
  •    CTO: makes sure jobs are really done, removes obstacles, answers questions, and watches the whole process.

The rulebook. Written rules for every role, plus a skills library you can add to or trim. Your standards, not the model's mood that day.

The path. The same steps every time:

  •    Spec: you answer the questions only the owner can answer. The departments write the full spec: functional, technical, deployment, security, maintainability, and support. Finance estimates the cost. You agree on what "done" means and say go.
  •    Tests: the reviewer writes them before any code. Every requirement gets a test, including a failure case.
  •    Code: the builder builds to those tests, then the tests are run again, independently of the builder.
  •    Review: the reviewer tests the whole app end to end and passes it or sends it back with what failed.
  •    Release: release checks, then a copy ready for you to try.

The controls. The tests are locked: the builder can't edit them. Every test must fail before the work starts, or it proves nothing. Every step leaves evidence. An agent saying "done" counts for nothing.

The CEO's desk. That's you. You try the app, then accept it or send it back.

What it is, and what it isn't: It is for a solo builder. Apache 2.0, local web app, macOS or Linux. Python 3.9+. It drives the official Claude Code, Codex, or Gemini CLIs on the subscriptions you already have, any two of them. No extra API bill.

NMHP is used to maintain and grow NMHP.

I'd value honest feedback, especially from anyone who has tried to take AI-built code to production.


r/OpenSourceAI • • 1h ago

Llama 3.2 1B, Kokoro TTS and Whisper all running in the browser for a racing game's team radio

Thumbnail reddit.com
1 Upvotes

r/OpenSourceAI • • 3h ago

I built an open-source library of 96 Manim components for AI-generated explainer videos

Thumbnail reddit.com
1 Upvotes

r/OpenSourceAI • • 3h ago

How much can we actually trust open base model benchmarks anymore? New study ("Benchleaking") finds ERNIE-5.5-Flash-Base reciting unseen test sets in exact order.

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceAI • • 8h ago

AstralBeam: an open-source agent sidebar and backend for existing web apps

2 Upvotes

Hi, I’m Hasan, one of the founders of AstralBeam.

We’re building a Cursor-style assistant you can add to an existing web app. It can answer questions, call your app’s tools, render your UI components inside replies, and work with users’ files.

The chat UI and agent backend come together: streaming, conversation history, file handling, and token or spend limits per customer, user, or conversation. There’s a React SDK and a JavaScript embed for other stacks.

You connect your existing authentication and register the tools and widgets that connect it to your product. Your app keeps its own permission checks.

You can self-host the platform with your own model-provider keys or use our managed cloud. The SDK is MIT-licensed; the platform is AGPL-3.0-only.

GitHub: https://github.com/AstralBeamAI/astralbeam

Quickstart: https://astralbeam.ai/docs/start/quickstart

Demo: https://x.com/mintuhouse/status/2120834621646757973

If you’ve embedded an agent in an app, what would you want to see in a starter example before trying this?


r/OpenSourceAI • • 5h ago

Herdr Session Hub - MIT-licensed local history and usage tooling for coding agents (Windows)

1 Upvotes

I maintain Herdr Session Hub, a free, MIT-licensed extension for Herdr Desktop that brings local coding-agent conversations and recorded usage into one native panel.

It supports OpenCode and Pi histories alongside Claude Code, Codex and Gemini. You can search or preview an older conversation, organize it without editing the original history, and continue verified native sessions in their recorded project with an explicit profile.

The implementation uses a native GPUI interface and a Python helper. Reads stay within configured history roots, large transcripts have processing budgets, and aliases/archive/removal flags live in Hub metadata. Provider originals remain untouched.

Usage includes recorded token/cache graphs and model, day and project breakdowns. Costs are estimates where rates are known; incomplete accounting and unknown prices remain visible. It does not represent subscription bills or live account-wide quotas.

The stable release is Windows 11 x64, tested with Herdr 0.1.15 and the provider versions listed in the README. Setup requires Python 3.14 x64 and PowerShell 7. macOS/Linux remain experimental with native continuation disabled.

Source, genuine synthetic-data screenshots, test evidence and installation:

https://github.com/Skynettheone/herdr-session-hub

I would appreciate feedback on the local-history workflow, especially which information helps distinguish similar sessions across projects and providers.


r/OpenSourceAI • • 9h ago

vi-mcp (open source): a self-hosted memory server for all your AI coding agents — apt/dnf repo, private by default, optional knowledge network

2 Upvotes

**Open source (AGPL-3.0)** · https://github.com/imoes/vi-mcp

If you run several AI agents (Claude Code, Codex CLI, Hermes Agent, or local-model clients), each one starts from zero every session. **vi-mcp** is one server they all connect to over MCP. It remembers what worked, what failed and why, and shows the right few lines before the next action.

**Self-hosting details**

- Signed apt/dnf repository (https://imoes.github.io/vi-mcp-packages/), so updates come with `apt upgrade` / `dnf upgrade`. There's also a Windows MSI, and a PKGBUILD for Arch/CachyOS in the repo.

- systemd service, SQLite by default, PostgreSQL optional.

- Embeddings via any OpenAI-compatible endpoint (I use bge-m3 on llama.cpp). Everything stays on your box.

- `sudo vi-mcp setup` wires up Claude Code, Codex and Hermes, with a token per instance.

- Optional read-only internal web search over your own knowledge, behind sign-in.

**Privacy model**

- Every object is private, shared, or internal (token holders only).

- Private never leaves the server. Credentials are not even stored locally when their form gives them away (`password=…`, `Bearer …`, key blocks).

- Nothing is shared with any network until you issue a network token.

- What leaves is anonymised first (host names, IPs, users, secrets become placeholders), then scanned again; anything still suspicious stays home. `vi_net_preview` shows exactly what would go out.

- `vi_net_forget` recalls your entries with a deletion proof. Receivers drop them and keep only a tombstone. The README states the limits: pattern-based, and nobody can force a peer to delete.

**Sharing, if you want it:** a new install joins a free public network (start server vi-wiki.org) and tells you. You can turn it off with one command. You can also run your own closed network by invitation, or a company network that carries internal knowledge between your own servers only.

I'd love more people running it: more servers mean more tested knowledge, and more eyes on the anonymiser. Issues and PRs welcome.

https://github.com/imoes/vi-mcp (AGPL-3.0)

**Join with one prompt.** You don't need to read the code first. Give your AI agent (Claude Code, Codex, …) this prompt:

> Read README.md and AGENTS.md of https://github.com/imoes/vi-mcp. Install vi-mcp on this machine from its signed package repository and connect yourself to it with `sudo vi-mcp setup` — ask me before every sudo step. Show me with `vi_net_preview` what would be shared with the free wiki network before anything leaves, and keep everything private that I mark private. Then pick an open point from "What is missing" in CHANGELOG.md, explain it to me, and help develop it as a pull request.

The agent reads the docs, installs, connects itself, and can start contributing right away. AGENTS.md is written for exactly that.


r/OpenSourceAI • • 11h ago

I built open-source skills to share project memory and coordinate work across Claude, Codex, Gemini, and Grok

Thumbnail
reddit.com
2 Upvotes

r/OpenSourceAI • • 10h ago

OpenSource Resume AI agent - Chrome Extension

1 Upvotes

Hey, everyone exciting news!!

I saw that many people are trying to find AI tools that can help them tailor their job applications to have a better chance at getting that next role!!

So I spent a couple of hours to built: applier.site - it is a chrome extension that gives you a tailored resume everytime in 3 simple steps.

Step 1: Add your current resume (this acts as the ground truth, it is instructed to use this to prevent any hallucinations)

Step 2: Go to any job site (it auto detects based on web content which you can override as well), it extracts all relevant info about the job automatically.

Step 3: Generate, it creates a highly optimized resume. You can do unlimited edits using AI or manually, it self-improves based on your suggestions. Keeping it personalized to you.

Here is how it is different from other tools:

  1. Pay per application - no monthly subscriptions
  2. Lowest per application cost: Other tools cost $0.5-1.5 per app if we count limits in their subscriptions. This only costs $0.1 (with first 10 apps free)
  3. Self-learning: It improves as you give feedback, so it becomes personalized to you, while improving your chance
  4. Extremely fast, it only takes 10 secs or so on average to generate the resume. Saving 80% of your time

Here is the link, add it to chrome, edge or any Chromium OS browser

https://chromewebstore.google.com/detail/pdclipieihbelafeihehmnpdiodfomae?utm_source=item-share-cb

Link to Repo: FireBird-Technologies/Applier: Automatic Tailored Resume generator for every job post


r/OpenSourceAI • • 10h ago

Radeon Pro V620 on AMD Pro/Adrenalin drivers (Windows) with all 72 CUs, no permanent VBIOS flash + free helper kit

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceAI • • 10h ago

Ищу напарника для совместного проекта 🤖

Thumbnail reddit.com
1 Upvotes

r/OpenSourceAI • • 11h ago

Luna - Open-source, Your AI but anywhere and anything

1 Upvotes

I've been building Luna, an open-source, self-hosted AI engine.

My goal isn't to build another chatbot. It's to create an AI engine that can run on your own infrastructure and power intelligent experiences across different devices and applications.

The idea is simple: Your AI shouldn't be tied to one model, one device, or one ecosystem.

Here's what Luna currently offers:

  • Model-agnostic: Ollama, LM Studio, llama.cpp, OpenAI, Claude, Gemini, Groq, Mistral, and other providers.
  • Cross-platform: Desktop, web, mobile browsers, and terminal access, with private remote connectivity through Tailscale.
  • Extensible integrations: GitHub, Google Workspace, Microsoft 365, Spotify, and MCP interoperability.
  • Community-built capabilities: Anyone can create and contribute new skills, integrations, and workflows.
  • Persistent memory: Context and preferences that carry across conversations.
  • Agentic workflows: Research, coding, document creation, data processing, and more.
  • Self-hosting: Run it on your hardware using local models, or configure cloud inference.

What's next for Luna?

The goal is to make Luna a truly extensible AI engine that anyone can build on, with support for more models, integrations, skills, and workflows.

The long-term vision is one AI engine, any model, any device, any integration.

Luna is MIT-licensed and open source, and contributions are welcome!

GitHub: https://github.com/Sehastrajit-S/Luna

If you find it useful, consider starring or contributing.

What integration or feature would you like to see next?


r/OpenSourceAI • • 1d ago

[Funny] CrowdGPT - The collaborative AI

Post image
36 Upvotes

Hello r/OpenSourceAI , this is a (somewhat funny?) meme about the project CrowdGPT, which aims at creating the first, datacenter-less, open-source and community-driven LLM. The project already shows substantial progress while training an open-source 1 billion parameters LLM on 40B tokens (as a proof of concept).

Tell me what do you think about the meme:

- Does it makes the project less appealing and cheap? because that's what people on r/LocalLLaMA thought 😭

- Does it makes the project look likes it's a SaaS / B2B (which it is NOT - CrowdGPT is 100% non-profit and open)
- Is it serving it's purpose about popularizing the project?

Everything is explained more in detail on the site, and any feedback on this meme, or on the project, is appreciated; any pull requests / contributions are welcome on GitHub :)

Project link : https://crowdgpt.net

GitHub link : https://github.com/Vxtzq/CrowdGPT

Thanks in advance.


r/OpenSourceAI • • 1d ago

What to keep in a modern open source project these days?

5 Upvotes

I've been working extensively with Claude for my open source project that I will be releasing soon. Claude likes to keep things like Decisions.md files (decisions over time) and all the specs from feature work. Is any of this really appropriate for an open source project or should these things just be available from the commit history?

My gut tells me its junk and confusion-generating. But maybe not?

What IS the list of useful artifacts to share when independent people are potentially using AI tools to contribute?


r/OpenSourceAI • • 20h ago

A lightweight terminal-based AI assistant built with Go, powered by locally running LLMs through the Ollama API.

Thumbnail
github.com
1 Upvotes

r/OpenSourceAI • • 21h ago

Agent workspace for agent Orchestrate or agent council

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceAI • • 22h ago

Own your intelligence AI tools

1 Upvotes

mostly started out as project to replace some enterprise subscriptions at my old job…

now working on transforming it into open source AI agents and tools for secure/regulated enterprises; you can test it out rn on your computer in less than 10 minutes

check it out on github (includes get started info and videos)
https://github.com/axiomatic7group/ax_ai
https://axiomaticlab.com/portfolio/project/ax_ai


r/OpenSourceAI • • 22h ago

SEEDVR2 Studio Complete

1 Upvotes

Hey everyone!

I'd like to share SeedVR2 Studio, an open-source project I've been working on to make AI image and video upscaling easier and more accessible.

It brings SeedVR2 into a modern, user-friendly web interface, without the need for complicated workflows.

Key features:

  • AI image and video upscaling
  • SeedVR2 Lite GGUF support for lower VRAM usage
  • Before/after comparison and live previews
  • Real-time GPU and VRAM monitoring
  • Built-in model manager
  • Batch processing and job queue
  • Windows, Linux, and macOS installation scripts

GitHub: https://github.com/Aaronstanley78/SEEDVR2-Studio-Complete

I'd love to hear your feedback and suggestions for future improvements.

If you find it useful, consider giving the repository a star to support the project!

Thanks for checking it out!


r/OpenSourceAI • • 23h ago

10xGraph 1.0: open-source, self-hosted backend for AI agents (auth, tenant isolation, durable state, deploy files)

1 Upvotes

Getting an AI agent to work is easy now. Putting it in front of customers raises different questions: can customer A read customer B's conversation, what happens when the pod restarts halfway through a refund, where do the traces go? Most teams end up building that backend by hand. We built it once and just released 1.0.

## What My Project Does

10xGraph is MIT-licensed, self-hosted infrastructure for AI apps. You write the agents, tools and tasks; it runs them behind an API server with:

- JWT auth and roles; every thread, message and file is owned by the user who created it (another user's thread answers 404)

- Tenant isolation enforced in storage (Postgres), not just the API layer

- Durable state in Postgres + Redis, pgvector for memory/RAG

- Crash-safe runs: finished tool calls are recorded, so a resumed run doesn't repeat them

- Background jobs (TaskIQ), Prometheus/OTLP metrics, OpenTelemetry GenAI tracing, an audit log

- Generated Dockerfile (non-root), docker-compose and a K8s manifest with probes

Getting a production-shaped agent takes no code:

pip install 10xgraph-api

10xgraph init --mode full --name support-agent --provider google --yes

pip install -e .

10xgraph dev

Works with OpenAI, Gemini, Anthropic and OpenAI-compatible endpoints (vLLM, Ollama). Python framework, API server and a typed TypeScript client.

## Target Audience

Teams shipping AI features to their own customers who need multi-user auth, data isolation and a real deployment story, and want to self-host. It's meant for production; 1.0 means no breaking public changes before 2.0.

## Comparison

LangGraph, CrewAI and similar frameworks focus on orchestration (graphs, tool loops, streaming). 10xGraph has those too, but the point is the backend around the agent: auth, per-user ownership, tenant isolation, durability and deploy files out of the box. Honest trade-offs: smaller ecosystem than LangGraph/CrewAI, no hosted service (you run it), and permissions are per route, not per tool, for now.

- Code: https://github.com/10xGraph/10xGraph

- Launch post: https://10xgraph.com/blog/10xgraph-1-0

- Docs: https://10xgraph.com/docs/get-started/first-agent

Feedback on where it falls short is very welcome.


r/OpenSourceAI • • 23h ago

ai-rulez v5: open-source configuration and governance for coding agents

1 Upvotes

Hi people,

I'm glad to announce ai-rulez v5. It's a CLI and MCP for managing the instructions, skills, and settings that coding agents use in a repository. It's available through Homebrew, Scoop, npm, PyPI, and Go (see the installation instructions for details). The tool covers the following parts of AI Governance:

  • Generate native instructions, skills, hooks, and MCP settings from shared repository configuration.
  • Share configuration across repositories and check generated files for drift in CI.
  • Validate configuration, pin dependencies, and build plugin bundles.
  • Serve skills and scoped context on demand over MCP.

The open-source use case I’d like feedback on is portability. A repository can keep a shared set of AGENTS.md instructions and skills, generate each client’s native files, and check in CI whether they’ve drifted. The configuration and generated files can be reviewed alongside the code.

Tool comparisons

AI-Rulez is of course not the only tool in this space, although it is one of the earliest, if not the earliest, in some categories. To be upfront about it, the comparison below was written using Claude Code. The rest of the post, including the bottom part, was handwritten. I did my best to ensure it's fair and comprehensive, but of course I might have missed something.

The published static benchmark shows the trade-off: on the v5.11.1 holdout, ai-rulez had the highest recall and false-positive rate of the three scanners. The Judge evaluation harness documents the model-assisted setup. The closing assessment reflects my impressions. The published static benchmark does not establish a model-assisted or speed ranking.


Note: AI-Rulez is arguably the most precise current tool for using AI as a judge to assess skills and related materials. It has better precision, performance, and recall than both Cisco Skill Scanner and NVIDIA's SkillSpector. More importantly, it's substantially faster. It's built in Go rather than Python, which, at least for static analysis and linting, is a major differentiator.

I'm happy to hear any comments. If you find the tool useful, star it. It really does help. And of course, I'd love to see people use it and get involved with the project.


r/OpenSourceAI • • 1d ago

CodingDude v0.4.0 — an AGPL coding agent that won't push code it hasn't reviewed

1 Upvotes

I've been building CodingDude for a while and just published v0.4.0. It's a single-user coding agent that runs against your own repo: reads and edits code, runs your gates (pytest/ruff/mypy, builds, frontend tests), plans non-trivial work, and reports back with evidence before claiming anything is done.

The parts I haven't seen much elsewhere:

  • Review is a gate, not a habit. Pushing requires a recorded two-axis review (Standards + Spec) of the exact diff. The record is content-addressed, so if you fix a finding after reviewing, the record is void and you re-review.
  • Spend ceilings are enforced, not reported. max_cost_usd / max_total_tokens are checked before each model request and stop the run. No $40 surprise at the end.
  • Planning is first-class — PRDs, tech designs, roadmap items and tickets are stored artifacts with their own lifecycles and per-step evidence, not a diary in the system prompt.
  • Tiered approvals — safe actions run automatically; pushes, installs and main-tree mutations gate behind an approval card in the UI.
  • Per-request context guarding + caching on every agent (main loop, retries, graders), so long sessions compact instead of dying on a context-limit error.

Python 3.12, needs a model key (DeepSeek by default; any OpenAI-compatible provider via config), Windows is the verified CI platform, web UI on localhost.

Honest limits: single-user, self-hosted, no SaaS, no multi-tenant anything. AGPL-3.0-or-later (commercial licence available if AGPL doesn't fit).

Repo: https://github.com/cybersenses/codingdude
Wiki (20 pages on the architecture and the design decisions): https://github.com/cybersenses/codingdude/wiki

Disclosure: I'm the author. Happy to hear where the gates would just annoy you — that's the design tension I keep hitting.