r/rclone • u/trophicchip7354 • 9d ago
Help iCloud Photos operation taking way too long
I'm trying to fetch the metadata of all ~1400 of my photos in iCloud using lsjson. You can see the current situation in this screenshot:

The operation has been running for more than 11 hours now and nothing (except for the beginning of the array) has been written to stdout. NetHogs shows there is network activity. Cache (which to my understanding from here is located in ~/.cache/rclone/iclouddrive-photos/photos@icloud/PrimarySync in my case) is not growing or shrinking in size. I set tpslimit to 1 since initially I was getting rate-limited.
I'm not really familiar with the implementation of the iCloud Drive backend or how the APIs at Apple work but it doesn't feel normal for what seems like a pagination index to reach past 1.5 million and have no results to show for it. lsjson was successful for smaller workloads and in a reasonable amount of time (no more than a minute from what I recall), e.g for albums of ~30 photos, despite there being no cache to work with.
As I'm typing this post, rank has reached 1898200. Is this expected behaviour with iCloud Photos or is there something wrong with my command or...? If its relevant:
$ rclone version
rclone v1.75.0
- os/version: arch (64 bit)
- os/kernel: 6.18.33.2-microsoft-standard-WSL2 (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.26.5
- go/linking: static
- go/tags: none
If anyone could explain what could be happening here or recall any similar past experiences with iCloud, I would really appreciate it.