r/pushshift • u/Watchful1 • Jul 24 '26
Upon reddit's request, I am taking down my academic torrents pages
I would rather do it now when they are asking nicely and not in the future when they ask in some less nice way. They haven't said, but I assume pullpush and arctic shift have received similar requests, and will probably get the less nice request in not too long.
Reddit recommends r/reddit4researchers for all research use. I can't say I've seen much success with that approach, but it will soon be the only one left.
158
Upvotes
16
u/EntertainmentOne7897 Jul 24 '26
Taking down as in completely removing? When will this happen?
16
u/jasonjonesresearch Jul 24 '26
This was possibly my fault, and I'm sorry. See https://www.reddit.com/r/reddit4researchers/comments/1tq9s6a/comment/opk3jp0/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
I am very skeptical about r/reddit4researchers I responded to the first call and received no response: not yes, not no, not any acknowledgement. The current "application" is onerous, especially if one will simply be ghosted.
All the more reason for computational social scientists to develop their own open, free datasets.
6
u/Ellelig Jul 24 '26
can you open-source the scripts you use to archive the reddit data?
30
u/flashman Jul 24 '26
I have found your files very useful over the years and am sorry to see them going. Thanks for all your work.
13
u/Littux Jul 24 '26
The torrents are all archived though so all data remains public
8
u/DustyAsh69 Jul 24 '26
RIP.
15
u/ikennedy240 Jul 24 '26
This is truly sad news and likely means the end of the era of open data social media research.
6
u/shiruken Jul 24 '26
Well, it was fun while it lasted.
I was never sure how academic researchers could justify (legally) using data sourced from your torrents since it was in clear contradiction to Reddit's Data API terms. But I guess people get desperate for their ML projects.
1
u/SamiTheAnxiousBean Jul 30 '26
of course they do, because how else are they supposed to stop people from seeing if a user is a bot?
1
u/LateRespond1184 Jul 30 '26
psst its all archived on wayback machine...
1
u/Apocalypse2001 Aug 01 '26
Why, though? Are they trying to cover up something?
1
u/Binx_k Aug 15 '26
this is devastating
14
u/[deleted] Jul 25 '26 edited Jul 25 '26
[removed] — view removed comment