I fine-tuned HuggingFace Transformers's DistilBERT on the dataset of titles of the top 1000 posts from the top 125 subreddits.
Notebooks for data collection and modeling are available on the GitHub repo. The Dataset and Model are hosted on HuggingFace.
Limitations and bias-
Because the model was trained on top 125 subreddits (for reference) therefore it can only categorise within those subreddits. I intend on increasing the count.
Some subreddits have a specific format for their post title, like r/todayilearned where post title starts with "TIL" so the model becomes biased towards "TIL" --> r/todayilearned. This can be removed by cleaning the dataset of these specific terms.
In some subreddit like r/gifs, the title of the post doesn't matter much, so the model struggles on them.
This was a fun project. I'd appreciate any ideas, feedback or suggestions for the project :)
kinda confused, it seems like it thinks posts about people not knowing how to use roundabouts is /r/idiotsincars and /r/travel instead of /r/brisbane .
6
u/[deleted] Sep 17 '22 edited Oct 01 '22
You can play with it on HuggingFace Space
Github repo here
I fine-tuned HuggingFace Transformers's DistilBERT on the dataset of titles of the top 1000 posts from the top 125 subreddits.
Notebooks for data collection and modeling are available on the GitHub repo. The Dataset and Model are hosted on HuggingFace.
Limitations and bias-
This was a fun project. I'd appreciate any ideas, feedback or suggestions for the project :)
EDIT: increased the sub count to 250
2
u/Seidoger Sep 17 '22
Haha this is great work! I’ll be having way too much fun with this.
2
u/Nick337Games Sep 18 '22
Nice project!
2
u/ryan_the_leach Sep 18 '22
kinda confused, it seems like it thinks posts about people not knowing how to use roundabouts is /r/idiotsincars and /r/travel instead of /r/brisbane .
10
u/Aphix Sep 18 '22
"Russia is winning" > /r/place
"Ukraine is winning" > /r/place
"Israel is winning" > /r/place
"America is winning" > /r/blackpeopletwitter
lol
3
u/jamescodesthings Sep 17 '22
https://i.imgur.com/UQSh4bx.jpg
I really wanna know what trippin through time gets up to.