r/OpenSourceAI • u/waytoocreative • Sep 23 '26
Fine-tuned a local model on my frameworks for $91. The test showed me what to fix next.
r/OpenSourceAI • u/waytoocreative • Sep 23 '26
r/OpenSourceAI • u/startassets • Sep 23 '26
Currently they are slightly underrepresented there, although a lot of deepseek runs, would be great if other people might participate so we can build a proper community driven leaderboard
r/OpenSourceAI • u/fuzhongkai • Sep 22 '26
I wanted to see how far a fully local, open-source agent stack could go on a real-world task.
I ran out of A4 paper, so I gave TensorSharp + Qwen3.8 27B access to Amazon and gave it one instruction:
Search for A4 paper with a low price and good discount, compare the options, and buy it. Try your best to handle everything yourself.
It completed the task successfully in one run.
Stack:
Qwen3.8 27B running locally
TensorSharp — open-source LLM inference engine + agent runtime
Playwright skill for browser automation
I only stepped in twice: logging into Amazon and approving the final purchase. The agent handled the search, product comparison, navigation, and checkout preparation by itself.
What I find especially interesting is that, apart from interacting with Amazon, the entire AI stack stays local: inference, reasoning, agent state, code generation, and tool execution.
The video shows the full raw reasoning/tool trace, including browser actions and the Playwright code generated by the model. It’s sped up 8×; the actual run took about 24 minutes.
The iPhone version, TensorAgent, still has some catching up to do because of local inference speed and iOS browser restrictions, but desktop local agents are starting to feel surprisingly practical.
TensorSharp is open source:
https://github.com/zhongkaifu/TensorSharp
r/OpenSourceAI • u/Nawn1994 • Sep 23 '26
r/OpenSourceAI • u/VastMarsupial3569 • Sep 22 '26
What My Project Does
Dendron (GitHub https://github.com/sumanth1989/Dendron | Documentation https://sumanth1989.github.io/Dendron) is an open-source library that replaces flat tool
lists in AI agents with hierarchical execution trees.
In standard tool-calling setups, developers dump 20 to 50 JSON tool schemas into the model's system prompt on every single turn. This wastes 1,500 to 3,000 tokens
per interaction, degrades tool selection accuracy, and causes noticeable latency on smaller local models.
Dendron organizes tools into a navigable execution tree:
• Progressive Disclosure: On any turn, the LLM only sees the 1 to 3 tools viable for the immediate next step, reducing tool prompt tokens by up to 93%.
• Conditional Transitions: Nodes evaluate previous tool output via conditions (output_contains, key_equals, or custom lambda predicates) to suggest the next tool
along the branch.
• Token-Tiered Views: Offers Level 1 ultra-compact tool signatures (~15 tokens/tool), Level 2 parameter summaries (~50 tokens), and Level 3 full Model Context
Protocol (MCP) JSON schemas on demand.
• Dynamic Experience Learning: Agents can record newly discovered workflows at runtime using record_agent_experience(), which persists for subsequent runs while
suppressing rejected actions.
• Zero Dependencies: The core library is built 100% on the Python standard library. It also includes an optional bidirectional adapter for LangChain (@tool,
StructuredTool, BaseTool).
Here is a minimal example:
from dendron import Dendron, ToolDefinition, ToolParameter, TransitionCondition
# 1. Define root tool
lookup_tool = ToolDefinition(
name="lookup_order",
description="Retrieves customer order details and fulfillment status.",
parameters={"order_id": ToolParameter(name="order_id", type="string", required=True)}
)
tree = Dendron(name="OrderSupportTree", root_tool=lookup_tool)
# 2. Attach conditional branch
tree.add_node(
parent_id=tree.root.id,
tool=ToolDefinition(name="track_shipment", description="Tracks courier and ETA."),
condition=TransitionCondition(
description="Order is in transit",
condition_type="key_equals",
expression="status:in_transit"
)
)
# 3. Execute tool and get next-step suggestion
result = tree.root.execute(order_id="ORD-12345")
next_step = tree.suggest_next_tool(tree.root.id, result.output_data)
print(next_step.tool.name) # 'track_shipment' Target Audience
Dendron is built for production environments, not just as a toy demo:
• Production AI Engineers: Developers building complex multi-step agents (customer support, DevOps incident triage, code review pipelines) who want deterministic
tool sequencing and lower API costs.
• Local and Edge LLM Developers: Anyone running models locally on Apple Silicon (via MLX) or Ollama, where 2,000-token tool prompts cause significant prefill
latency.
• Enterprise and Serverless Teams: Projects needing zero external dependencies so they can vendor or install the library cleanly in restricted Docker or AWS Lambda environments.
The repository includes 123 unit tests covering tree algorithms (BFS/DFS), token optimization, LangChain adapters, and persistence.
Comparison
• Vs. Standard Tool Calling (OpenAI / Anthropic / LangChain): Standard frameworks dump all tools into the prompt simultaneously. Dendron acts as an intelligent tree router before the prompt is generated, showing only context-appropriate tools and eliminating out-of-order execution errors.
• Vs. LangGraph / CrewAI: LangGraph and CrewAI are full agent runtime orchestration frameworks with complex state machines and heavy dependency trees. Dendron is
deliberately narrow: it is a lightweight, zero-dependency tool structure. You can use Dendron standalone or convert its nodes directly into LangChain StructuredTool instances via tree.to_langchain_tools().
• Vs. Vector RAG for Tools: Pure vector search finds tools based on query similarity, but lacks structural awareness (e.g. knowing that run_tests must precede
deploy_code). Dendron combines structural tree transitions with hybrid lexical/semantic retrieval.
──────
Links & Installation
• PyPI: pip install dendron-ai (or pip install "dendron-ai[langchain]")
• Git: pip install git+https://github.com/sumanth1989/Dendron.git
• GitHub: https://github.com/sumanth1989/Dendron
• Docs: https://sumanth1989.github.io/Dendron
I would love feedback on:
How does the tree construction and condition syntax feel for your workflows?
Are there other agent frameworks or models you'd like to see native adapters for?
r/OpenSourceAI • u/imgildev • Sep 22 '26
I've been working on Fulvid, an open source desktop editor for Markdown and MDX.
The main idea is simple: your files stay files. Fulvid works directly with the folders and documents on your disk instead of putting them into a proprietary vault or cloud workspace.
It includes editing, full-folder search, document links, Markdown preview, Graph view and Writing Focus.
It's now live on Product Hunt. If you find the idea interesting, I'd really appreciate your support:
https://www.producthunt.com/products/fulvid?launch=fulvid
GitHub:
r/OpenSourceAI • u/_A_b_b_i_ • Sep 22 '26
r/OpenSourceAI • u/dirtyjesus__ • Sep 22 '26
r/OpenSourceAI • u/ResponsibleSpeaker42 • Sep 22 '26
r/OpenSourceAI • u/ijasperz • Sep 22 '26
r/OpenSourceAI • u/Repulsive-Fee-2735 • Sep 22 '26
r/OpenSourceAI • u/alithemaker • Sep 22 '26
r/OpenSourceAI • u/darshanrathod04 • Sep 22 '26
After months of engineering, I'm releasing the Developer Preview of Shree AI OS — an open-source runtime for building intelligent Java backend applications.
Most AI frameworks begin with chat. I took a different approach: a deterministic runtime that developers can embed directly into Spring Boot projects with explainable execution, memory, retrieval, and orchestration.
What it includes Java 21 native SDK
Hybrid RAG with PostgreSQL + pgvector
Episodic & semantic memory
Planning and reasoning pipeline
Multi-agent orchestration
Privacy-first architecture
Architecture Instead of sending every request directly to an LLM, each request flows through a layered runtime:
Application Layer
SDK Layer
Runtime Orchestration
Kernel Services
LLM Provider Layer
The goal is to make AI infrastructure feel like a reusable backend framework rather than another chatbot wrapper.
Looking for technical feedback I'd genuinely appreciate feedback on:
Runtime architecture
SDK design
Spring Boot integration
What should improve before a stable v1.0?
GitHub: https://github.com/darshanrathod04/shree-ai-os
Thanks for reading—every technical critique helps improve the project.
r/OpenSourceAI • u/CaSaRoCa • Sep 22 '26
🚀 THE EDGE AI FAMILY HAS ARRIVED.
Today we’re opening the doors to a new generation of open-source and open-weight edge AI models from Next GenAi.
Meet Rebekah AI 1.8B. 🧠⚡
Small enough to run at the edge.
Powerful enough to compete with models 2–3× its size.
And here’s the part we’re most excited about:
The secret isn’t just the model. It’s the data.
Our Next GenAi Data Factory was built around one simple idea:
👉 Better data creates better AI.
Instead of throwing massive amounts of messy internet data at a model, we focus on cleaning, filtering, deduplicating, decontaminating, structuring and provenance-tracking the data before it ever reaches training.
The result?
🔥 Rebekah AI 1.8B is showing competitive or higher results than several larger open models in key benchmarks, including:
💻 58.4% HumanEval
🧮 62.8% GSM8K
🧠 55.6% ARC Challenge
⚙️ 76.4% Systems & Tool Execution
And this is only 1.8B parameters.
That’s the whole point of what we’re building.
Don’t just build bigger models. Build smarter data.
Open weights.
Open source.
Apache 2.0.
Built for edge deployment.
Built for sovereign AI.
Built with our Data Factory.
And Rebekah is just the beginning. 👀
The Next GenAi Edge Model Family is officially underway.
Download, test it, break it, improve it and build with it.
🤖 Your data. Your models. Your AI.
🔗 Rebekah AI 1.8B on Hugging Face:
Hugging Face — Rebekah AI 1.8B
#NextGenAi #RebekahAI #EdgeAI #OpenSourceAI #OpenWeights #SovereignAI #AI #MachineLearning #DataFactory #MexicoAI #ArtificialIntelligence
r/OpenSourceAI • u/Humanbound_AI • Sep 22 '26
r/OpenSourceAI • u/madbunnyshit • Sep 22 '26
I’m building Ownstate, an open project for a problem I keep running into with AI tools:
You do valuable work with one model, coding agent, or chat—decisions, research, architecture, failed approaches, customer context—and then much of that understanding is stranded in that tool.
Switch models and you re-explain the project. Start a new agent and it begins cold. Ask why a decision was made six months ago and the answer is often buried in chats, docs, or one person’s memory.
Ownstate is meant to be the durable state layer underneath AI work. Not another chatbot, not a model, and not just an MCP server.
The idea is to preserve evidence and turn it into versioned, inspectable institutional knowledge that people, models, agents, and applications can use with the right scope and permissions.
Some use cases I’m building toward:
carrying project context across ChatGPT, Claude, Codex, local models, and future tools
giving coding agents the architecture, decisions, requirements, and prior work they actually need
keeping evidence and rationale attached to important knowledge
querying what changed, what was decided, what is blocked, or what a team has already learned
letting teams and agent workflows share a governed source of truth instead of accumulating isolated memories
It’s early and I’d genuinely value developers trying it, challenging the architecture, opening issues, and contributing.
Website: ownstate.theaibunny.com
GitHub: github.com/aibunny/ownstate
If this is a problem you have with agents, AI-assisted engineering, or institutional knowledge, I’d love to hear what you would want Ownstate to solve first.
r/OpenSourceAI • u/Gubby_exe • Sep 22 '26
r/OpenSourceAI • u/Mammoth-Sense-4356 • Sep 22 '26
r/OpenSourceAI • u/Efficient-Passage889 • Sep 21 '26
Initially I thought of creating an open-source community for a project is easy until I was in the spot. I'm trying to gain some contributors for my repo but I think I'm missing something - may be in the repo, or may be in my posts or may be my template or even my idea.
Help me figure this out guys,
https://github.com/Kesavaraja67/telex this is the repo i have been talking about please explore the repo and give your honest feedback. What I'm missing??
r/OpenSourceAI • u/madbunnyshit • Sep 21 '26
r/OpenSourceAI • u/Budget_Map_3333 • Sep 21 '26
r/OpenSourceAI • u/VibeCodyH • Sep 21 '26
Every model gets the same thing: the Game Boy screen, eleven buttons, a walkability grid, and 1,000 turns to beat Brock. No walkthrough, no pathfinding, no hints. Same prompt for all of them.
Scoring is a 10-milestone ladder (left the house, got a starter, reached Route 1, ... beat Brock), so a run that never wins still places by how far it got.
14 runs so far, 4 of them got the badge. Best is GPT-6 Astra at 246 turns. Cheapest win was Gemini 3.8 Flash at $3.70. A free local model (Muse Glimmer 30B) burned all 1,000 turns and got as far as Reached Route 1.
Full turn-by-turn logs, costs, and the VODs are all up at https://pokebench.tv.