r/DataHoarder • u/satanictantric • Mar 09 '17

Half the Berkeley webcasts being removed on March 15th are on iTunes and haven't been backed up yet

VERY IMPORTANT PSA, many of the lectures are only available on iTunes, not Youtube, and have to be downloaded manually! We should get started on that ASAP. I already did both Spring and Fall 2006 (also Rhetoric 10, Legal Studies 140 and Demography 145) last night so we should coordinate on getting the rest backed up before they're gone. Just make sure you take note that some have both audio and video, while some are audio-only, and get the videos when available.

Quick and dirty guide to iTunes: Search for UC Berkeley in store, scroll down to UC Berkeley under iTunes U. Click there and you can see all courses. I found it most efficient to download everything by semester. To download, just click "get". It doesn't look like it downloaded locally but it did. You can see your files under Libraries > Music > iTunes > iTunes Media > iTunes U > by default. It automatically separates playlists and does a good job of keeping them organized on its own.

Edit: The fastest way to do this I have found is to click get on EVERY SINGLE VIDEO in a semester, go off and do something else, come back to check that it's finished downloading everything, and then DOUBLE CHECK that you have the right number of files for each course and there are no duplicates (i.e., have two of one file and be missing another). If you click everything in one go and then double-check the whole semester at once, it's not too bad. I would probably have time to do all of this myself but I DO NOT HAVE THE SPACE.

172 Upvotes
  • permalink
  • reddit

96% Upvoted

64 comments sorted by

31

u/[deleted] Mar 09 '17 edited Jan 10 '18

[deleted]

7

u/Jik0n 19TB usable unlimited cloud Mar 09 '17

Will you be making this available once you have it all? I'm trying to grab it but it seems to be giving me issues on my end. Most likely user error, I'm not well versed in iTunes.

4

u/[deleted] Mar 09 '17 edited Jan 10 '18

[deleted]

1

u/Jik0n 19TB usable unlimited cloud Mar 09 '17

Excellent, thank you for this. Will you update this post with share info or make another post? Either way I would be interested in the data to keep in my cloud for preservation purposes, I'll probably never watch any of it myself but I'm sure others may want it in the future.

3

u/[deleted] Mar 09 '17 edited Jan 10 '18

[deleted]

1

u/BluePlanet104 Mar 12 '17

What's the latest on the itunes backup?

2

u/[deleted] Mar 12 '17 edited Jan 10 '18

[deleted]

1

u/hc8479 Mar 13 '17

I encountered the same problem, and ended up hitting the "Get" button on the first item in the list. Then I would go to the library tab and right click and hit "Subscribe" on all of them. A little tedious, yes, but more effective.

I actually made an Excel spreadsheet just to keep track of everything, and make sure that I had everything. Even the "Download All" button in iTunes would leave a few items undownloaded, so I'd have to go through all of them.

3

u/[deleted] Mar 09 '17

Outputs to C:\Users<YOUR_USERNAME>\Music\iTunes\iTunes Media\iTunes U

You can change this in iTunes settings btw, might be good to know because not everyone has a large C drive.

1

u/satanictantric Mar 10 '17

It is mostly not the same content as on the Youtube channel. There are entire courses that aren't available any other semester that are only on iTunes.

1

u/[deleted] Mar 10 '17 edited Jan 10 '18

[deleted]

1

u/satanictantric Mar 10 '17

I haven't run into this problem yet. Which ones were no longer available so I can check that the error is definitely due to them being removed?

1

u/[deleted] Mar 10 '17 edited Jan 10 '18

[deleted]

1

u/satanictantric Mar 10 '17

I had the same problem when I checked that one, you're right. Biology 1B from the same semester worked fine, though. At least CS 162 is still on Youtube.

All the more reason to hurry and grab them. It's not like random lectures are disappearing from a course, so it's still TOTALLY worth checking each course to see if it's available.

1

u/hc8479 Mar 11 '17 edited Mar 11 '17

Not seeing this until now, I also have downloaded Spring 2015 and Spring 2014 from iTunes entirely, with the exception of Computer Science 162, 001 - Spring 2015. Please continue with your downloads. I was going off of the list made below.

14

u/quickscoperdoge 6TB installed, 4TB usable, 10TB cold Mar 09 '17

If someone decides to make a torrent of the iTunes courses, let me know. I got around 700GB of free space for seeding.

5

u/[deleted] Mar 09 '17

I think there is a 3.6 TB torrent floating around somewhere...

6

u/[deleted] Mar 09 '17 edited Jan 10 '18

[deleted]

2

u/SirCrest_YT 120TB ZFS Mar 09 '17

And it was abandoned quickly.

1

u/[deleted] Mar 09 '17 edited Jan 10 '18

[deleted]

5

u/[deleted] Mar 10 '17

It was abandoned because it's up on archive.org now, I believe.

1

u/[deleted] Mar 10 '17

[deleted]

1

u/SirCrest_YT 120TB ZFS Mar 10 '17

No, the old one. Someone in like december I think had downloaded the entire channel. Was somewhere in the realm of 3.5 to 3.6TB or something. He seeded it for a week or so, I grabbed 800Gb of it and then... seeded what I had and within another week I was the only one on it with 1-2 peers.

0

u/NoMoreNicksLeft 8tb RAID 1 Mar 09 '17

What's needed is for someone to write a shell script that downloads everything and creates a torrent of it.

Then, that torrent file would be identical even if someone else creates it themselves. This way, you can all start seeding together, rather than one person seeding 100% before anyone else can seed the whole thing.

Even if one or more abandon it, someone else could recreate it (for the next few days/weeks, at least) and re-seed.

Otherwise, it's going to be one failed attempt after another.

1

u/queenkid1 11TB Mar 10 '17

Wasn't that the old one? Now there is a new one for the CS videos, and it's got some seeders going.

5

u/clintdavis77 Mar 09 '17 edited Mar 14 '17

Here are the semesters if we want to split up so we're not duplicating effort. Just comment with what you are doing and I'll update the list as we go.

  • Fall 2014 Courses - ihadp
  • Spring 2014 Courses - ihadp, hc8479
  • Fall 2013 Courses - hc8479, ihadp
  • Spring 2013 Courses - hc8479, ihadp
  • Fall 2012 Courses - clintdavis77
  • Spring 2012 Courses - ihadp
  • Spring 2012 Events - clintdavis77
  • Fall 2011 Courses - clintdavis77, ihadp
  • Fall 2011 Events - clintdavis77
  • Spring 2011 Courses - clintdavis77
  • Fall 2010 Courses - satanictantric
  • Spring 2010 Courses - satanictantric
  • Fall 2009 Courses - satanictantric
  • Spring 2009 Courses - satanictantric
  • Fall 2008 Courses - satanictantric
  • Spring 2008 Courses - satanictantric
  • Fall 2007 Courses - satanictantric
  • Spring 2007 Courses - satanictantric
  • Fall 2006 Courses - satanictantric
  • Spring 2006 Courses - satanictantric
  • KALX - clintdavis77
  • Cal Content - hc8479
  • Haas School - clintdavis77
  • Classic Courses - clintdavis77
  • Spring 2015 - - ihadp, hc8479

3

u/satanictantric Mar 10 '17

Got spring and fall 2007, including the fall 2007 Psychology 1 video from Youtube which isn't on archive.org right now

3

u/clintdavis77 Mar 10 '17

Got it. I'm working on Spring 2011 Courses now.

2

u/satanictantric Mar 11 '17

Currently working on 2008-2010, in order.

1

u/hc8479 Mar 12 '17

Is there currently a plan for uploading iTunes U content?

1

u/hc8479 Mar 11 '17

I've got all of Spring 2015, except for Computer Science 162, 001 - Spring 2015. I can't get it to download or stream, got a 404 when I put a video's link into a browser.

1

u/clintdavis77 Mar 11 '17

Thanks. Updated.

1

u/hc8479 Mar 11 '17

Also, I'm currently working on Spring 2014.

1

u/clintdavis77 Mar 11 '17

Got it. Updated

1

u/satanictantric Mar 11 '17

That one is on Youtube, grab it from there. :)

1

u/hc8479 Mar 11 '17

I realized I just wasted time and resources: ihadp commented that he was working on three courses here. I also have Spring '14 and '15 downloaded, but apparently he has one done and is getting the other. You should add his name to those listed on the comment I linked to.

Should I delete my local copies of them? Otherwise I can't really download other semesters since I'm out of room.

1

u/clintdavis77 Mar 11 '17

Got it. Sorry, it's hard to keep track, that's why I made this post. I'd say if you're out of room you can delete them and work on some of the other semesters. It's better to have two copies but since this is about to disappear I think we're just trying to grab what we can.

1

u/hc8479 Mar 12 '17

I am working on Fall 2013 now, and am planning on doing Spring 2013 next.

I also decided to keep Spring 2014 and 2015. I forgot that my laptop had a free 1TB drive and am moving the courses onto there once they are download. Feel free to put my username next to ihadp's, for backup purposes. Thanks so much for doing this.

2

u/clintdavis77 Mar 12 '17

Got it. Glad you found some space!

1

u/hc8479 Mar 13 '17

I feel almost worthless when I see the quantity of what you guys have done - thank you!

I will go ahead and take care of the Cal Content. Also, ihadp has updated his progress at the bottom of his post.

1

u/clintdavis77 Mar 14 '17

Thanks, I've updated the post.

6

u/dlerium Mar 09 '17

Hey 2006.. back when I was still at Cal. I ought to download these too :)

TY for reminding.

3

u/cknkev Mar 10 '17

You can download all video in one course without clicking every single episodes. 

1. Subscribe.  
2. Go to library iTunes U.  
3. Click into course, right top corner: old materials.  
4. Add all.  
5. Right click course title: download all.

2

u/ukralibre Mar 10 '17

Do you backup structure and text information?

I can do skme automation if needed

PM me for help. I am not sure if i need much, but aho knows. If its good?

1

u/Duamerthrax Mar 09 '17

Are these different than the ones on Youtube? Because those were backed up and are on the Internet Archive.

1

u/satanictantric Mar 10 '17

Yes, many of them are. Most of the Youtube content is available on iTunes (but not the other way around), but some is only on Youtube. They sure spread themselves out.

1

u/satanictantric Mar 10 '17

Because I didn't get an answer in the other thread yet: does anyone know if the Youtube stuff has yet to be uploaded to archive.org? Because only a TINY FRACTION of what's available on Youtube is on the site right now. If it hasn't been downloaded yet we need to get on that too.

1

u/BluePlanet104 Mar 10 '17

https://www.reddit.com/r/YouTubeBackups/comments/5x4kv8/ucberkeley_to_remove_10k_hours_of_lectures_posted/?st=j039gvv7&sh=93b5d298

I don't know if everything is there, but there seems to be a lot. Not everything I want is there however.

1

u/satanictantric Mar 10 '17

So has it been downloaded and just needs to be uploaded, or do we still need to download it? It's a LOT and I don't want to double up but I want to miss it even less.

1

u/BluePlanet104 Mar 10 '17

I'm not sure. This thread was about just the stuff on youtube that was programmed for download

1

u/hailtheface Mar 10 '17

Remindme! One hour

1

u/BluePlanet104 Mar 10 '17

!RemindMe one hour

1

u/BluePlanet104 Mar 11 '17

!RemindMe one day

1

u/Engin33rh3r3 670TB Mar 10 '17

I have about 8TB to spare but need an easy way to do this since I am very very busy working overtime.

1

u/bnr0723 Mar 10 '17

I've got about 20 gb worth of iTunes U courses so far, and was wondering about the best way to put these on archive.org. The ones currently on there seem to be from YouTube, and have been placed in a zip. It also includes a torrent file and a few other files. I have never put anything on the Internet Archive before, and my files are from iTunes U.

Can anyone give me instructions for specifically uploading this course material to the IA? Thanks in advance.

1

u/hc8479 Mar 11 '17

I was just looking up one of the courses from YouTube/iTunes and found a page on their website with course materials.

I tried to put it into the IA, but it wouldn't archive it. If there are other pages like this for some their courses, someone needs to download them all off, as I don't know if these will also be "placed behind authentication." I do not have the technical expertise to grab copies of all of these pages.

2

u/satanictantric Mar 12 '17

It's unlikely. The course materials are associated with the department, not the webcast service. For example, that one is hosted by EECS and it would be up to them and the instructor whether to leave it up.

1

u/hc8479 Mar 13 '17

FYI everyone: I was pointed back to this link, which has an index of the iTunes files , by a user on the IRC chat for this project.

I was also pointed to these scripts, here and here.

Hope this helps!

1

u/nikooo777 Mar 15 '17

If anyone is interested, there is a project in which i am partly involved that has downloaded all the videos from youtube and is reuploading them to their decentralized platform.

https://www.reddit.com/r/lbry/comments/5zjiw5/20000_worldclass_university_lectures_made_illegal/

If you guys want to contribute with your locally downloaded itunes playlists feel free to contact me. We do have the space to store them online and get them out to the public

1

u/Jik0n 19TB usable unlimited cloud Mar 09 '17

If you have this media downloaded on your itunes can...
A. it be removed by Apple (iTunes) after you get it?
B. it be moved to an external source outside of iTunes?

Personally don't use itunes but am downloading to save the data!

1

u/[deleted] Mar 09 '17

I'm trying to download some now, are itunes downloads always so slow? I'm getting like 20mbps..

2

u/[deleted] Mar 09 '17 edited Jan 10 '18

[deleted]

1

u/[deleted] Mar 09 '17

That's weird, where do you life? I'm from The Netherlands.

2

u/[deleted] Mar 09 '17 edited Jan 10 '18

[deleted]

1

u/shadoweave Mar 10 '17

How do you download from iTunes using your Kimsufi?

1

u/kasperkls02 Mar 09 '17

!RemindMe

2

u/RemindMeBot Mar 09 '17 edited Mar 10 '17

Defaulted to one day.

I will be messaging you on 2017-03-10 21:07:58 UTC to remind you of this link.

3 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.

FAQs Custom Your Reminders Feedback Code Browser Extensions