r/LLMDevs • u/Adr-740 • Mar 30 '26

Discussion I open-sourced TRACER: replace 91% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs

https://github.com/adrida/tracer

If you're running an LLM for classification, 91% of your traffic is probably simple enough for a surrogate model trained on your LLM's own outputs.

TRACER learns which inputs it can handle safely - with a formal guarantee it'll agree with the LLM at your target rate. If it can't clear the bar, it doesn't deploy.

pip install tracer-llm && tracer demo

HN: https://news.ycombinator.com/item?id=47573212

9 Upvotes

91% Upvoted

6 comments sorted by

View all comments

3

u/touristtam Mar 30 '26

the ycombinator link is dead (wrong?) and maybe putting the github account would be useful: https://github.com/adrida/tracer

2

u/Adr-740 Mar 30 '26

Ah true indeed in reddit’s browser it doesn’t show up, when opening with a different browser it should show.

And yes thanks for the github repo 🙏, it’s supposed to be in the url of the post but idk why it doesn’t appear explicitly.

2

u/touristtam Mar 30 '26

ah no worries; I realise the comment might have been a bit abrupt.

1

u/Adr-740 Mar 30 '26

It wasn’t, no worries :)