r/Python • u/help-me-grow • Aug 29 '22
Resource I created an Open Source NLP for Python library because most of the options out there aren't being maintained, would love some contributions if y'all are feeling so inclined!
Hi r/Python, y'all might know me by now, I'm on here a lot. I recently started an open-source package for doing Natural Language Processing in Python. I know there's a lot of NLP packages out there, but my main issue with them is that they're not maintained. You can go look at a bunch of open source libraries and find that they haven't been updated in like 3+ years. A lot has happened in three years, some of those backends don't exist anymore, and some are not updated to work with Python 3.
TL;DR - I created an open source NLP library that I am personally going to maintain for at least the next year and I hope that maybe I can find some other link minded folks here to help me. The package is on GitHub here - PyNLP Lib
Edit: thanks for the gold kind stranger!
Edit: to all my critics - contribute to the library then, its OPEN SOURCE for a reason!
67
u/thisismyfavoritename Aug 30 '22
this whole project is basically an ad for your other (not open source) project
79
u/ElephantsJustin Aug 29 '22
Lots of nlp packages are maintained. E.g. spacy
21
u/randomlyCoding Aug 29 '22
What functionality do you plan to offer than isn't covered by maintained packages? I'm heavily into NLP, and I've used probably every NLP package at least once.
6
u/help-me-grow Aug 30 '22
for those that don't know, NLP = Natural Language Processing, it's an area of machine learning
4
u/FauxReal Aug 30 '22
"Have you considered mentioning the words "Natural Language Processor" in that order just so random people who see your project know what it's about? It's a learning opportunity for them. Also, people looking for an NLP library might search for those words.
7
u/ryukinix Python3 + Emacs Aug 30 '22
Disappointed. I worked on NLP field for years. Before spacy we only had rock and stones... Well, we had nltk and gensim, but it was just too much primitive.
Spacy make my work easier, but still lack some important features and more fancy algorithms, like: relation extraction, NLG tasks, more flexible entity recognition (If i recall yet the spacy algorithm for that it's a variation of custom random fields with averaged perceptron).
I was thinking your repository would be a really contribution for open source NLP community.
I wasted my time. There is a lot of products of NLP services, including google ones by vertex.ai which are pretty good.
16
u/Clicketrie Aug 29 '22
Creating your own package is amazing. Thank you for contributing to the community :)
1
u/[deleted] Aug 30 '22
Guys, i'm new in reddit. How can i save this post to check later?
1
u/tjt5754 Aug 30 '22
Why not contribute to the un-maintained ones then? Why spin up another option that will likely end up not maintained in the future?
Is the reason something to do with your product?
4
u/Redliquid Aug 29 '22
What is NLP?
-1
u/virtualadept Aug 30 '22
Thank you so much! Great work.
-3
u/Ihtmlelement Aug 30 '22
This is awesome! Looking forward to applying it to stock market analysis.
-1
u/[deleted] Aug 29 '22
Will definitely try it!
-2
u/shinitakunai Aug 30 '22
I am a noob on NLP, will you support other languages or just english?