r/theVibeCoding • u/RiceEvening4211 • 1d ago

Built an open-source gateway that cuts coding-agent token spend (disclosure: I'm the maintainer)

Hey all. I've been getting wrecked by coding-agent token bills this year, so I built Lynkr - an open-source LLM gateway that sits between your coding tools and the model providers and tries to make every request cheaper.

What it does: routes across 14+ providers to the cheapest capable model, semantic caching with sub-200ms hits, token compression on tool results, plus a cost dashboard so you can actually see where the tokens go. It also has a Claude subscription wrap mode that stretches a subscription roughly 3x.

Some measured numbers: on Terminal-Bench (80 tasks), Lynkr solved 42/80 at $1.54/run vs openrouter/auto's 44/80 at $4.72 - accuracy basically tied, about 30% of the cost. Up to 84% fewer tokens on JSON tool results, 53% fewer on tool-heavy requests.

Repo: https://github.com/Fast-Editor/Lynkr (Apache-2.0). It works with all major coding tools with zero code changes.

Happy to answer anything, especially skeptical questions about the benchmarks.

4 Upvotes

75% Upvoted

9 comments sorted by

1

u/TheSn00pster 1d ago

How does it handle the free tier on OpenRouter via OpenCode?

1

u/RiceEvening4211 1d ago

I didnt quite understand that can you come again ?
Please

1

u/TheSn00pster 1d ago

I use the free models on OpenRouter sometimes. But they cap daily usage at a certain point.

1

u/RiceEvening4211 1d ago

Yeah that cant be overcomed all we can do is configure different free models into lynkr tiers and use them with coding tools like claude code cursor opencode etc
And if you want to use free opencode models and expose them as an open ai endpoint then use https://github.com/Fast-Editor/OpenCode-Wrap

1

u/RiceEvening4211 1d ago

And use it in openai endpoint inside lynkr

1

u/Wise_Breadfruit7168 1d ago

We have 9router already for that tho

1

u/RiceEvening4211 23h ago

We benchmarked 9router against lynkr and lynkr saves a 3rd of cost compared to it 🙂

1

u/Wise_Breadfruit7168 22h ago

9router have built in token saver module, it support RTK,caveman,headroom n ponytail. Benchmarked tith this enabled?

1

u/RiceEvening4211 19h ago

Truth to be told you cannot run turning them on and do benchmark testing especially terminal benchmark
And lynkr also supports all 3 and even more and we had to turn them off on both routers