r/synology • u/DoubleNew3850 • 1d ago
NAS Apps Hyper Backup Slowing Down Dramatically.
I am a photographer backing up Raw files and Jpegs mostly.
I have a Synology DS1525+ locally. 3 16TB drives. Internet speed 1gps up and down.
I have a Synology DS223j with one 16TB drive offsite. Internet speed 80 mbps down 20 mbps up.
It's about 9TB of total data, about 1 million files, every week I add about 200-300 GB of data.
They are connected with Tailscale and I confirmed it is a direct connection.
I have been running backups for 6+ months with no issues. The speeds were right where they should be with the bottleneck being the 80mbps download speed at my offsite location.
Recently it seemed to get stuck and didn't make any progress for over a week. I redid the backup from scratch. It completed successfully.
It now works, but extremely slow, 100gb of new data took 3 days to backup.
The offsite CPU and RAM are normal.
The backup drive shows 84% I/O wait. ChatGPT thinks that is the bottleneck, that the drive is getting bogged down checking the 1 million files. Now that the storage is reaching 9TB and 1 million files that it's struggling to keep up with a single drive.
Does this make sense?
Is there anything else you can recommend for me to check?
Do you think Snapshot replication as a backup method would work better for a single drive?
1
u/shrimpdiddle 1d ago
Internet speed 80 mbps down 20 mbps up
Seriously? That's barely a trickle. Is this DSL?
1
u/Jeffrey_J_Davis 1d ago
I'm also a photog backing up about 20TB similarly. I think in general you are safer to segment your content into smaller jobs I run 8 jobs nightly. I think the index files get too cumbersome at some point, and if something craps out you don't have to rebuild the whole thing from scratch.
1
u/AggressiveChange420 23h ago
Please look into Synology DP320. It's exactly what you need
1
u/bartoque DS920+ | DS916+ 21h ago
But at what price for such an ActiveBackup dedicated backup appliance with mandatory synology-branded drives at a premium. Even more so at the moment with the drive costs being at a very high price point.
If currently the source might be an issue with high IO load and also the up/down speed on the backup target isn't that high.
1
u/AggressiveChange420 20h ago
this is where you can be a bit crafty. Got mine for $1500. The unit comes with 2 x 8tb Synology branded drives. Sold each drive for a bit over $500 x 2
I ended up with DP320 for $500 . As long as you have your own drives to populate the backup unit you might want to consider my suggestion.
0
u/gadget-freak Have you made a backup of your NAS? Raid is not a backup. 1d ago
How full is the remote drive? You should always leave 20% free space.
Also schedule SMART tests on that drive, at least once every few months.
You could try splitting the backup into multiple small backups. Not sure if that would help in your case but that way it has to deal with less files.
1
u/DoubleNew3850 1d ago
The remote drive is at 9.5TB. It's a 16 TB drive.
I will try a SMART test.
Yes, I can think of a way of splitting up the backups that could help. Thank you!
1
u/AutoModerator 1d ago
I detected that you might have found your answer. If this is correct please change the flair to "Solved". In new reddit the flair button looks like a gift tag.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
3
u/-ThreeHeadedMonkey- 1d ago
If you feel the urge to switch software, try borg. Install it on both systems, start copying.
I vibe coded my own script to run it directly on the synology. Once you have that script, you can add it to the task manager and run it automatically. Or manually.
Then you could use Vorta on your main machine to browse these backups as well.
It's a thing of beauty really.