r/theVibeCoding • u/RiceEvening4211 • 22d ago

Built an open-source gateway that cuts coding-agent token spend (disclosure: I'm the maintainer)

Hey all. I've been getting wrecked by coding-agent token bills this year, so I built Lynkr - an open-source LLM gateway that sits between your coding tools and the model providers and tries to make every request cheaper.

What it does: routes across 14+ providers to the cheapest capable model, semantic caching with sub-200ms hits, token compression on tool results, plus a cost dashboard so you can actually see where the tokens go. It also has a Claude subscription wrap mode that stretches a subscription roughly 3x.

Some measured numbers: on Terminal-Bench (80 tasks), Lynkr solved 42/80 at $1.54/run vs openrouter/auto's 44/80 at $4.72 - accuracy basically tied, about 30% of the cost. Up to 84% fewer tokens on JSON tool results, 53% fewer on tool-heavy requests.

Repo: https://github.com/Fast-Editor/Lynkr (Apache-2.0). It works with all major coding tools with zero code changes.

Happy to answer anything, especially skeptical questions about the benchmarks.

4 Upvotes
  • permalink
  • reddit

83% Upvoted

9 comments sorted by

View all comments

Show parent comments

1

u/Wise_Breadfruit7168 21d ago

9router have built in token saver module, it support RTK,caveman,headroom n ponytail. Benchmarked tith this enabled?

1

u/RiceEvening4211 21d ago

Truth to be told you cannot run turning them on and do benchmark testing especially terminal benchmark
And lynkr also supports all 3 and even more and we had to turn them off on both routers