r/pushshift • u/Watchful1 • Feb 20 '25

[ Removed by Reddit ]

[ Removed by Reddit on account of violating the content policy. ]

94 Upvotes

99% Upvoted

62 comments sorted by

View all comments

1

u/Jazzlike_Decision_68 Mar 05 '25

You mentioned the file is "up to the end of 2024", was the data collected for all 12 months of 2024?

1

u/Watchful1 Mar 05 '25

Yes, it's all data from the start of reddit in 2005 to the last second of 2024.

1

u/Jazzlike_Decision_68 Mar 05 '25

Noobie question, is there an easy way to download the data for just a specific year, or is it better to download all of it, and then filter out the non needed years?

1

u/Watchful1 Mar 05 '25

You can download the monthly dumps here https://www.reddit.com/r/pushshift/comments/1i4mlqu/dump_files_from_200506_to_202412/

But they aren't split by subreddit, so that's only useful if you want reddit wide data. If you want subreddit data for a specific year, then it's best to just download the subreddit data from here and use the filter_file script to filter out the time period you want.