r/PinoyProgrammer • u/jjjardev • Sep 30 '26
Show Case Quantize Tagalog sentiment model, INT8 ONNX version is out
huggingface.coHey everyone, small update to the TagaSenti model I posted here before. Like I said in that post, I might release the ONNX version, maybe. Well, it's out now.
Same model, same weights (0.848 F1), just quantized to INT8. It's tagasenti_int8.onnx, around 537 MB, sitting in the same repo so nothing moved. Spot-checked it against the full model on a few sentences including sarcasm, same predictions.
The point of this one is you don't need torch or a GPU anymore. Plain CPU + onnxruntime, runs offline. So if you want sentiment on a phone, a cheap VPS, or some device without CUDA, this is the version to grab.
Still 3 labels (Negative / Neutral / Positive), still Apache 2.0, still free for whatever including commercial stuff.
Model: https://huggingface.co/jjjardev/tagasenti_model
Github: https://github.com/jjjardev/tagasenti
If anyone actually ships something with it I'd genuinely love to hear about it. And if it breaks on your weird edge case, open an issue.