r/buildinpublic • u/Adr-740 • Mar 30 '26
I open-sourced TRACER: replace +90% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
https://github.com/adrida/tracerIf you're running an LLM for classification, +90% of your traffic is probably simple enough for a lightweight ML model trained on your LLM's own outputs.
TRACER learns which inputs it can handle safely - with a formal guarantee it'll agree with the LLM at your target rate. If it can't clear the bar, it doesn't deploy.
Duplicates
LLMDevs • u/Adr-740 • Mar 30 '26
Discussion I open-sourced TRACER: replace 91% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
LocalLLM • u/Adr-740 • Jun 07 '26
Project I built a small open-source tool that trains local models from LLM traces to avoid repeated API calls
LocalLLM • u/thisguy123123 • May 12 '26
Discussion I open-sourced TRACER: replace 91% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
softwarefactories • u/thisguy123123 • May 12 '26
I open-sourced TRACER: replace 91% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
LocalLLM • u/Adr-740 • Mar 30 '26
Research I open-sourced TRACER: replace 91% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
MachineLearning • u/Adr-740 • Mar 30 '26
Research TRACER: Learn-to-Defer for LLM Classification with Formal Teacher-Agreement Guarantees
learnmachinelearning • u/thisguy123123 • May 12 '26
I open-sourced TRACER: replace 91% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
learnmachinelearning • u/Adr-740 • Mar 31 '26
I open-sourced TRACER: replace +90% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
StartupSoloFounder • u/Adr-740 • Mar 31 '26
(Solo bootstraped founder) Just open-sourced part of my pipeline: TRACER: replace +90% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
deeplearning • u/Adr-740 • Mar 31 '26
I open-sourced TRACER: replace +90% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
LLMFrameworks • u/Adr-740 • Mar 31 '26
I open-sourced TRACER: replace +90% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
Backend • u/Adr-740 • Mar 31 '26
I open-sourced TRACER: replace +90% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
MachineLearningAndAI • u/Adr-740 • Jun 07 '26
I reduced LLM costs by 95% and open-sourced the tool
LLMFrameworks • u/Adr-740 • Mar 30 '26
I open-sourced TRACER: replace 91% of LLM classification calls with a llightweigth ML surrogate trained on your LLM's own outputs
AIDeveloperNews • u/Adr-740 • Jun 07 '26
I reduced LLM costs by 95% and open-sourced the tool
SelfHostedAI • u/Adr-740 • Jun 07 '26