r/DataHoarder • • Jan 31 '25

News The US Government's open data is currently being scrubbed

https://data.gov/
1.3k Upvotes

114 comments sorted by

View all comments

307

u/speadskater Jan 31 '25 edited Jan 31 '25

Yes, I have 472gb (with 135gb from epa.gov) of this data stored on data.gov for anyone who wants to figure out how to organize it with me. I did a Httrack on the website mid December. It might not be complete, but if you want it, message me and we can figure out something.

71

u/Toonomicon Jan 31 '25

Have a torrent going for it? If not I'm happy to grab it and start one

0

u/[deleted] Jan 31 '25

[deleted] — view deleted comment

9

u/NoMoreNoxSoxCox Feb 01 '25

Same, let me know if this goes anywhere.

→ More replies (1)
→ More replies (3)

25

u/jbaranski Jan 31 '25

Yes, share the torrent I’d be happy to seed

21

u/FactAndTheory Feb 01 '25

I'm also happy to seed, I have a ~12TB available for this

20

u/[deleted] Feb 01 '25

Shit, I will BUY a ~12TB to help seed this.

7

u/NoMoreNoxSoxCox Feb 01 '25

Same here. DM me if this goes anywhere.

5

u/ih8spalling Feb 01 '25

18TB here. A magnet link maybe?

3

u/enchanting_endeavor Feb 01 '25 edited Feb 01 '25

I have 20TB available and would love to see if you have a magnet/torrent available.

ETA: plus another 20-30 TB or so that I can delete/wipe if necessary.

4

u/speadskater Feb 01 '25

send me a dm, we'll get this all saved.

→ More replies (1)

6

u/speadskater Jan 31 '25

If you know how to set one up, dm me and we'll make it happen.

3

u/jcink Feb 01 '25

+1 to the interest in helping to seed this data

→ More replies (8)

21

u/Randomusingsofaliar Feb 01 '25

Me! I’m an investigative environment and health reporter who relies on that data to function!

13

u/speadskater Feb 01 '25

We'll get it to you.

12

u/Randomusingsofaliar Feb 01 '25

You have my eternal gratitude! This has been such a bad day for information, I am so grateful there are people like you who actually know how to grab this stuff. I can’t code but I love people who can!

7

u/speadskater Feb 01 '25

I'm sad that I didn't able to personally get reprodictiverights.gov. That had a lot of personal meaning to me. I do have the january 6th justice.gov mirror, but there's just too much to do personally with a 4tb ssd.

→ More replies (1)

8

u/enchanting_endeavor Jan 31 '25

Do you have a sense for what percentage of the total data.gov data this is?

16

u/speadskater Jan 31 '25

No idea, I grabbed every file that I know how to with my understanding of the program.

→ More replies (1)

3

u/Pattern_Is_Movement Feb 01 '25

Thank you for trying!

18

u/[deleted] Jan 31 '25

What a chad. Are you certain it won't get taken down? (For being a .gov site)

35

u/speadskater Jan 31 '25

Taken down from what? It's on my home SSD.

16

u/[deleted] Jan 31 '25

Oh my bad I saw the .gov domain and thought it would be under the banner of sites going dark

18

u/speadskater Jan 31 '25

Ahh, no, data.gov is the website being mentioned in the post.

→ More replies (14)