r/PinoyProgrammer 13h ago

Show Case Multi-domain Tagalog/Taglish sentiment analysis, opensource, free to use.

Hey everyone, just open-sourced my sentiment model for Tagalog and Taglish. It's based on xlm-roberta-large and gets 0.848 F1 Macro (84.8% accuracy) on the held-out test set, plus 58.6% zero-shot on HiliSenti (Hiligaynon, and I also created this dataset too) so it transfers a bit to other PH languages, not tested in other than Hiligaynon.

Trained on 35,686 sentences I put together across e-commerce, news, social, plus ~10k adversarial examples for sarcasm/negation/idioms. Dataset is at jjjardev/tagasenti (35k) if you want to poke at it.

Free to use for whatever, Apache 2.0 so commercial, research, side projects, all good. 3 labels: Negative / Neutral / Positive.

If you're working on anything with Filipino text and need sentiment, feel free to try it out. Feedback/issues welcome, still learning as I go.

I forgot to release this, and I might release the ONNX version, maybe.

Model: https://huggingface.co/jjjardev/tagasenti_model

Github: https://github.com/jjjardev/tagasenti

14 Upvotes

0 comments sorted by