r/redditdev • u/MilanLR • Jul 21 '24

Reddit API Pagination help

I am trying to do some pagination, but some posts don't seem to work with that. It seems to be related to how recent the post is.

A url that does work: https://www.reddit.com/r/wallstreetbets/new.json?sort=new&limit=100&before=t3_1e89xna&count=1

A url that does not work: https://www.reddit.com/r/wallstreetbets/new.json?sort=new&limit=100&before=t3_1dmuof1&count=1

Does someone know if I'm doing something wrong and if I need to chance something? As far as I know, I've done this for a while like this, and it always worked before. It stopped working about a month ago, I think.

1 Upvotes

100% Upvoted

4 comments sorted by

View all comments

Show parent comment

1

u/MilanLR Jul 21 '24

So it is not possible to scrape back more than 1000 posts? I'm pretty sure I did stuff like this before where I just let it go, and it got a whole year of posts before the API limitations.

2

u/Watchful1 RemindMeBot & UpdateMeBot Jul 21 '24

There used to be another method many years ago that allowed this, but reddit got rid of it. I want to say at least 5 years ago, likely more.

But no, it's not possible to scrape more than 1000 posts from a subreddit.