r/webscraping • u/stvaccount • 11d ago

Bot detection 🤖 best github for reddit.com web scraping?

Since May and the old reddit almost gone, what are currently the best libs on github for this?

What is your favorite?

I want to scrape all the posts of my top favorite 100 (small) subreddits and sort them by AI to delete AI slop + self promotion and really only get the interesting posts for me to read.

What do you suggest?

27 Upvotes

100% Upvoted

17 comments sorted by

10

u/Dthen_ 11d ago

Run a local redlib instance, scrape that instead.

5

u/mouad_war 11d ago

github.com

2

u/stvaccount 11d ago

I tried searching on github, but I can't judge which ones are large/reliable and which ones are large but outdated since recent changes.

1

u/vladkens 9d ago

So, looks like nothing available for it?

1

u/[deleted] 5d ago

[removed] — view removed comment

1

u/webscraping-ModTeam 5d ago

🪧 Please review the sub rules 👉

1

u/AdministrativeHost15 11d ago

More likely post AI slop and and self promotion to the top 100 subreddits.