I have a network with 80 RHEL 6.5 server. i have a file server in this network and run rsync deamon on it. clients checks file server every 15 minute for updates and if file server files updated or added new file they download it. my problem with rsync raised when my updated files count over 800 file or size of then over 200MB, in this case full syncing client(80 server) take 6, 7 hours, so how can fix this problem?

  • There are plenty of options in rsync, have you explored any of them, e.g. --ignore-existing? Nevertheless, 6 hours for 200MB is quite extreme, do you have a network issue? – eblock Sep 4 '20 at 9:55
  • You may have already checked this, but are you sure your clients are not rolling a bigger and bigger snowball. If the update runs every 15 minutes, will future updates be skipped while the current one continues? If not you may have many times more than 80 rsync clients attached. 200MiBx80 = 15.6 GiB. 15.6GiB in 6 hours is 0.74 MiB per second. That seems slow for a modern network. I've definately had rsync achieve better results than that. – Philip Couling Sep 4 '20 at 11:13
  • I only have desktop & use rsync. but some with servers suggest rdiff. rdiff-backup.net Sample rdiff file by TheFu ubuntuforums.org/showthread.php?t=2447368 Summary report from rdiff & use variables, example ubuntuforums.org/showthread.php?t=2422831 – oldfred Sep 4 '20 at 14:42

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.