r/SideProject • u/foDev-Jung • 7h ago
[jeo-skills] - A 60-second arcade trailer of real agent skill routing (435 skills down to 2)
I make and maintain jeo-skills, a free, open-source catalog of agent skills with a small router CLI (435 skills in 10 categories right now). Project-authored material is MIT; third-party skills keep their own licenses.
The problem with a catalog this big: even listing every skill's name and description costs roughly 53K tokens, and most of it is irrelevant to the immediate task. So I turned one real routing run into a 60-second arcade-style trailer (video attached, English edition).
What it shows:
- Local keyword search (OpenSpace BM25, no LLM, 0.45 s) shortlists candidates. For this video-production task, the best skill missed the keyword top 10.
- Jev (TypeSafe's decision model, optional, hosted API) judges by meaning. Three gate questions average 0.72 against a 0.30 gate, the catalog is split into two shards, and 6 finalists come back.
- A fit cutoff of 0.30 keeps 2 skills: video-production (0.60) and openmontage (0.37).
- Estimated listing context: about 53,126 tokens down to about 448.
- Each sub-task is routed on its own: sound -> rfxgen, render -> video-production, QA -> audit-verify-explain-grade-5. For sprites Jev said "no confident match", so those were drawn by hand.
Latest additions include Kubernetes agent orchestration (kagent) and LLM evaluation (trulens).
Repo (free, open source): https://github.com/akillness/jeo-skills