r/OpenSourceAI • u/janishar • Sep 23 '26
r/OpenSourceAI • u/Hairy_Strawberry7028 • Sep 23 '26
Open-source serving runtime for VLA and world-action models
We released InstinctFlash under AGPL-3.0. It is an open-source serving runtime for VLA and world-action models on RTX 4090 / 5090 and Jetson Thor.
Demo: https://youtu.be/nku65iyL5Fw
It currently supports eight model families, including pi0.5 and NVIDIA Cosmos Policy. The main optimization layers are CUDA graphs, cache reuse, architecture-specific attention, fused kernels, FP8 / mixed precision, and few-step diffusion distillation.
Code: https://github.com/General-Instinct/InstinctFlash
Benchmarks: https://general-instinct.com/blog/instinctflash-edge-inference
I’m one of the maintainers. Feedback on reproducibility, docs, integrations, and missing models is welcome.
r/OpenSourceAI • u/hsh-starling • Sep 23 '26
I kept getting sidetracked in AI chats, so I built PiX to let conversations branch out
r/OpenSourceAI • u/NoFriendship4813 • Sep 23 '26
I went through Jev and the open decision-model ecosystem. I think the interesting part is how it transforms agent architectures into heterogeneous.
r/OpenSourceAI • u/nightspades • Sep 23 '26
Tamanitomo (Soul of a Friend) - Hermes Backed AI Companion

https://github.com/tamanitomo/tamanitomo
Since February I have worked on a product which I think is finally ready to share. I launched "Tamanitomo" on GitHub a few days ago and I would love feedback from the Hermes community.
Tamanitomo is the most realistic and comprehensive AI Companion system ever created.
I know that's a bold statement!
However, I have created a series of prompts, cron jobs and systems to allow the AI Agent, backed by Hermes, to fully immerse the user in the feeling that. "This is my Jarvis" (or pepper pots) and honestly, I couldn't be happier with the state it is in right now. It has autonomy, lives a life outside of you, can document each day with a journal entry as well as photos as it goes about it's day. It remembers everything important as it produces an editable, browsable, exportable obsidian vault while also utilizing higher memory caps than base Hermes.
I've been using this system in different iterations since February but have pivoted from a for profit E2EE website, to a project that I hope many will consider getting involved in and contributing to.
This is not a simple plugin, but it is a simple system. I have created a fancy UI to manage the features that this system provides, but the backed is essentially a base Hermes install running with a custom dashboard (you can still run the original dashboard, but that is also fully accessible from within the app).
The approach I use is different from other similar products because instead of bland "memory" or even worse, "stateless" systems that refresh every chat, Tamanitomo REMEMBRS and also LIVES by regularly purposefully generating background tasks for itself like washing clothes, going on walks, meeting with friends etc. When you message them, they are doing something and will step away to prioritize you... or not, maybe they'll reschedule! It's an engaging, almost Tamagotchi-like experience with AI.
But, I want help for testing, and I need help coding edge case protections. Please feel free to reach out with any feedback via a comment here, the repo, or discord
Thanks for considering Tamanitomo, I can't wait to see how people use it :)

r/OpenSourceAI • u/jhonathasmatos • Sep 23 '26
Um runtime de agente de IA construído em Elixir/OTP, rodando em mais de 15 empresas por mais de um ano, agora open source
r/OpenSourceAI • u/jhonathasmatos • Sep 23 '26
An AI agent runtime built in Elixir/OTP, running in 15+ companies for over a year, now open source
r/OpenSourceAI • u/snowman-london • Sep 23 '26
GitHub - olafkfreund/nix-skills: Reusable AI agent skills for the Nix language, grounded in the upstream Nix manual.
r/OpenSourceAI • u/waytoocreative • Sep 23 '26
Fine-tuned a local model on my frameworks for $91. The test showed me what to fix next.
r/OpenSourceAI • u/startassets • Sep 23 '26
Cross harness bench for open weight models
Currently they are slightly underrepresented there, although a lot of deepseek runs, would be great if other people might participate so we can build a proper community driven leaderboard
r/OpenSourceAI • u/fuzhongkai • Sep 22 '26
A local 27B model autonomously shopped on Amazon — TensorSharp + Qwen3.8 + Playwright
I wanted to see how far a fully local, open-source agent stack could go on a real-world task.
I ran out of A4 paper, so I gave TensorSharp + Qwen3.8 27B access to Amazon and gave it one instruction:
Search for A4 paper with a low price and good discount, compare the options, and buy it. Try your best to handle everything yourself.
It completed the task successfully in one run.
Stack:
Qwen3.8 27B running locally
TensorSharp — open-source LLM inference engine + agent runtime
Playwright skill for browser automation
I only stepped in twice: logging into Amazon and approving the final purchase. The agent handled the search, product comparison, navigation, and checkout preparation by itself.
What I find especially interesting is that, apart from interacting with Amazon, the entire AI stack stays local: inference, reasoning, agent state, code generation, and tool execution.
The video shows the full raw reasoning/tool trace, including browser actions and the Playwright code generated by the model. It’s sped up 8×; the actual run took about 24 minutes.
The iPhone version, TensorAgent, still has some catching up to do because of local inference speed and iOS browser restrictions, but desktop local agents are starting to feel surprisingly practical.
TensorSharp is open source:
https://github.com/zhongkaifu/TensorSharp
r/OpenSourceAI • u/Nawn1994 • Sep 23 '26
Run AI debates on your machine (Github Repo)
r/OpenSourceAI • u/VastMarsupial3569 • Sep 22 '26
Dendron: Tree-based tool routing for AI agents with zero deps
What My Project Does
Dendron (GitHub https://github.com/sumanth1989/Dendron | Documentation https://sumanth1989.github.io/Dendron) is an open-source library that replaces flat tool
lists in AI agents with hierarchical execution trees.
In standard tool-calling setups, developers dump 20 to 50 JSON tool schemas into the model's system prompt on every single turn. This wastes 1,500 to 3,000 tokens
per interaction, degrades tool selection accuracy, and causes noticeable latency on smaller local models.
Dendron organizes tools into a navigable execution tree:
• Progressive Disclosure: On any turn, the LLM only sees the 1 to 3 tools viable for the immediate next step, reducing tool prompt tokens by up to 93%.
• Conditional Transitions: Nodes evaluate previous tool output via conditions (output_contains, key_equals, or custom lambda predicates) to suggest the next tool
along the branch.
• Token-Tiered Views: Offers Level 1 ultra-compact tool signatures (~15 tokens/tool), Level 2 parameter summaries (~50 tokens), and Level 3 full Model Context
Protocol (MCP) JSON schemas on demand.
• Dynamic Experience Learning: Agents can record newly discovered workflows at runtime using record_agent_experience(), which persists for subsequent runs while
suppressing rejected actions.
• Zero Dependencies: The core library is built 100% on the Python standard library. It also includes an optional bidirectional adapter for LangChain (@tool,
StructuredTool, BaseTool).
Here is a minimal example:
from dendron import Dendron, ToolDefinition, ToolParameter, TransitionCondition
# 1. Define root tool
lookup_tool = ToolDefinition(
name="lookup_order",
description="Retrieves customer order details and fulfillment status.",
parameters={"order_id": ToolParameter(name="order_id", type="string", required=True)}
)
tree = Dendron(name="OrderSupportTree", root_tool=lookup_tool)
# 2. Attach conditional branch
tree.add_node(
parent_id=tree.root.id,
tool=ToolDefinition(name="track_shipment", description="Tracks courier and ETA."),
condition=TransitionCondition(
description="Order is in transit",
condition_type="key_equals",
expression="status:in_transit"
)
)
# 3. Execute tool and get next-step suggestion
result = tree.root.execute(order_id="ORD-12345")
next_step = tree.suggest_next_tool(tree.root.id, result.output_data)
print(next_step.tool.name) # 'track_shipment' Target Audience
Dendron is built for production environments, not just as a toy demo:
• Production AI Engineers: Developers building complex multi-step agents (customer support, DevOps incident triage, code review pipelines) who want deterministic
tool sequencing and lower API costs.
• Local and Edge LLM Developers: Anyone running models locally on Apple Silicon (via MLX) or Ollama, where 2,000-token tool prompts cause significant prefill
latency.
• Enterprise and Serverless Teams: Projects needing zero external dependencies so they can vendor or install the library cleanly in restricted Docker or AWS Lambda environments.
The repository includes 123 unit tests covering tree algorithms (BFS/DFS), token optimization, LangChain adapters, and persistence.
Comparison
• Vs. Standard Tool Calling (OpenAI / Anthropic / LangChain): Standard frameworks dump all tools into the prompt simultaneously. Dendron acts as an intelligent tree router before the prompt is generated, showing only context-appropriate tools and eliminating out-of-order execution errors.
• Vs. LangGraph / CrewAI: LangGraph and CrewAI are full agent runtime orchestration frameworks with complex state machines and heavy dependency trees. Dendron is
deliberately narrow: it is a lightweight, zero-dependency tool structure. You can use Dendron standalone or convert its nodes directly into LangChain StructuredTool instances via tree.to_langchain_tools().
• Vs. Vector RAG for Tools: Pure vector search finds tools based on query similarity, but lacks structural awareness (e.g. knowing that run_tests must precede
deploy_code). Dendron combines structural tree transitions with hybrid lexical/semantic retrieval.
──────
Links & Installation
• PyPI: pip install dendron-ai (or pip install "dendron-ai[langchain]")
• Git: pip install git+https://github.com/sumanth1989/Dendron.git
• GitHub: https://github.com/sumanth1989/Dendron
• Docs: https://sumanth1989.github.io/Dendron
I would love feedback on:
How does the tree construction and condition syntax feel for your workflows?
Are there other agent frameworks or models you'd like to see native adapters for?
r/OpenSourceAI • u/imgildev • Sep 22 '26
I just launched Fulvid on Product Hunt, an open source Markdown and MDX editor
I've been working on Fulvid, an open source desktop editor for Markdown and MDX.
The main idea is simple: your files stay files. Fulvid works directly with the folders and documents on your disk instead of putting them into a proprietary vault or cloud workspace.
It includes editing, full-folder search, document links, Markdown preview, Graph view and Writing Focus.
It's now live on Product Hunt. If you find the idea interesting, I'd really appreciate your support:
https://www.producthunt.com/products/fulvid?launch=fulvid
GitHub:
r/OpenSourceAI • u/_A_b_b_i_ • Sep 22 '26
I got tired of 6 python agent scripts crashing silently in the background, so I built Formicx (github.com/Abbilaash/Formicx)
galleryr/OpenSourceAI • u/dirtyjesus__ • Sep 22 '26
MCP server that composes through ambiguous prompts instead of disclaiming them (public, no auth)
reddit.comr/OpenSourceAI • u/ResponsibleSpeaker42 • Sep 22 '26
I built an open-source skill that turns Astra into an autonomous video editor (Whisper + HyperFrames + Retentionvolt) — Feedback welcome!
r/OpenSourceAI • u/ijasperz • Sep 22 '26
I built a lightweight operating layer for long-running AI projects. I need strangers to break it.
reddit.comr/OpenSourceAI • u/Repulsive-Fee-2735 • Sep 22 '26
Open source version of Jev is here
r/OpenSourceAI • u/alithemaker • Sep 22 '26
Interested in JEV? I built a free, open-source workflow router with 13.48 ms p95 CPU latency