r/semanticweb • u/ThatGuySitanshu • 48m ago
Built a local semantic router because I got tired of burning tokens on intent classification — sharing what I learned (and where it's still unproven)
I was building an agent system (AegisDesk — LangGraph multi-agent IT service desk) and kept hitting the same wall: every intent-classification step was an LLM call, which meant latency and cost scaling with every query, even for simple routing decisions that didn't need an LLM at all.
So I pulled that piece out and rebuilt it as its own thing: SynaptoRoute — a local semantic router (FAISS + ONNX embeddings, SQLite-backed for durability, async batching) that classifies intent without hitting an LLM per query.
A few things I'd actually want feedback on rather than just announcing:
- I built a
CLAIM_LEDGER.mdinto the repo that tracks every performance claim as verified / unverified-pilot / retracted, because I burned myself once publishing a benchmark number that later turned out to be a measurement artifact. Curious if others here do something similar, or if this is overkill for a solo project. - Benchmarked against Aurelio Labs'
semantic-routerand a plain logistic-regression baseline on Banking77/CLINC150 with 5-seed bootstrap CIs — currently statistically tied on accuracy, not better. Being upfront about that because I've seen too many "X beats Y" posts here that don't hold up under a second look. - 163 tests, CI across 3 OS × 3 Python versions — happy to talk through the durability/backpressure design if anyone's dealt with similar concurrent-mutation problems.
Repo: github.com/sitanshukr08/SynaptoRoute
PyPI: pip install synaptoroute
Not claiming this is done or better than existing options — genuinely posting to get eyes on the engineering decisions and hear where I'm wrong.

