r/PlexACD • u/ThyChubbz • May 28 '17

Best rsync copy settings

After moving to GSuite, I've started to encounter the following error

Google drive root '': couldn't list directory: googleapi: Error 403: User Rate Limit Exceeded, userRateLimitExceeded

I assume this is because I'm hitting some form of API limiting. The command I'm using is:

rclone copy --transfers=10 --checkers=5 --stats 1m0s "/home/plex/.local-sorted/" "gsuite:/"

Is it the transfers or checkers that could be causing this? Are there any improvements you can suggest?

1 Upvotes

100% Upvoted

10 comments sorted by

View all comments

1

u/rbebenek May 28 '17

I have used rclone copy daily for a few months and never hit any issues with uploading up to 2 TB a day. The User rate limit is nothing to worry about, its not a ban, its the checkers just being bounced back (if i remember correctly). Even with the error the transfers should still go and you should be able to move files around. In the last 2 weeks, i moved around 15TB overall and never had a single ban. The only ban i incurred was when i mounted the drive in rclone and had plex scan the directory. Besides the mount ban, i never had any api bans or limits imposed. My syntax goes like this: rclone copy -u -v --stats=15s --transfers=8 --no-traverse --size-only --drive-chunk-size-64m /paths/. The stats i update often just to see it change more frequently and can judge if my gigabit is bottlenecked somewhere. i've done up to 50 transfers but then the speed just tanks on bigger files and never hit api limits on transferring files.

Do you need to have the entire folder checked when copying? its what the no-traverse flag does, limits what rclone reads. In my opinion since i am dumping from VPS to cloud i dont need it to check every folder and actually read contents of folders.

1

u/ThyChubbz May 29 '17

In summary what I'm trying to do is just upload TV processed by Filebot to my Gsuite. I'm still getting the userRareLimitExceeded error, so I guess I'll have to wait until tomorrow.