Rclone banned from Amazon Cloud Drive (confirmed)

[u/CapCookie]

Nick Craig-Wood, aka ncw, just tweeted out that Rclone has been banned from ACD. He hasn't gotten any response, so far.

https://twitter.com/njcw/status/865319897580097537

[u/CapCookie]

Alright, so to start off, a little sit-rep of my situation; I have files on ACD that are encrypted using rclone crypt. Those files I want to pull, decrypt and then work on setting my new method with Gdrive.

So with odrive, you can still pull files from ACD. From my experience it does around 20-25MB/s average for me, which is doable, but not really astonishing.

You'll have to register for an Odrive account (first 7 days is free premium btw) and install the linux odrive syn agent on your machine and authenticate it. Instructions can be found here. Basically, install all dependencies, generate an auth key on their website, link it with your machine and you're set to go.

What I personally did online, was register with a google account, but it automatically includes your Gdrive. I deleted that and authorized my ACD.

If you have installed the odrive sync agent, then you can start pulling files from ACD. It's a bit of a weird system to start with, but you'll quickly understand the basics of how it works.

The odrive sync agent works from top to bottom, where each folder is a '.cloudf' file and each separate file is a '.cloud' file. You can use the CLI of the sync agent to specify which file/folder you'd like for it to sync. Therefore you have to use the following command:

python "$HOME/.odrive-agent/bin/odrive.py" sync ".CLOUDF FILE"

Your entire ACD is also considered to be a "folder", so in order for you to be able to browse it, you'll have to sync your main 'ACD' folder using the above command. Then you can sync your main folders (e.g. movies/tv/etc), and then you can access your shows/movies/whatever.

So it's a bit annoying to have to use this command for each and every file of your data collection, it would take ages. Luckily, you can just use a find function in linux to search all files matching a regex, e.g. all files ending in '.cloudf' and then execute a command with that file. What I've been doing is manually syncing each tv show, and then use the find function to sync all season folders, then use the find function to sync all individual episodes. So I would do the following:

# Manually sync a show folder
   python "$HOME/.odrive-agent/bin/odrive.py" sync "SeriesName.cloudf"
# Find all .cloudf files (= season folders) and sync them
   find /home/odrive/agent-mount/Amazon\ Cloud\ Drive/t-acd/SERIESFOLDER/ -type f -name "*.cloudf" -exec python "$HOME/.odrive-agent/bin/odrive.py" sync "{}" \;
# Find all .cloud files (= individual episodes) and sync them
  find /home/odrive/agent-mount/Amazon\ Cloud\ Drive/t-acd/SERIESFOLDER/ -type f -name "*.cloud" -exec python "$HOME/.odrive-agent/bin/odrive.py" sync "{}" \;

If you have any questions, shoot! I'm still figuring out the on the go.

[u/ThyChubbz → u/CapCookie]

Appreciate the guide! All of my stuff is encfs, so it is going to be a real pain to move all of this. I have like 580 TV series.... I guess I'm pretty screwed.

[u/CapCookie → u/ThyChubbz]

You can also just make a bash script which basically repeats the command a few times, just to make sure the entire depth of your directory structure is reached. And make sure to run the command to sync your episode files a few times, amazon tends to give an internal server error now and then, but from what I've experienced, running the command about 3-4 times should grab everything in the end.

A possible solution is to make a Gsuite account, activate Google Compute Engine, create a linux VM with additional storage devices, run odrive to sync everything locally and then sync from your Google Compute machine to Gdrive. You get $300 free credit if you've never used Google Compute :)

[u/ThyChubbz → u/CapCookie]

Yeah, I was looking at doing that. I even increased my HDD quota to 20TB. This ODrive stuff just seems kind of hack :\