I have been backing up a server over rsync (v3.0.6) for a while. I noticed that it takes about 20 minutes just to get the incremental file list (I am using the whole file flag). I am excluding three files, if I take these out it only takes a second to start syncing. There are only 319 files (689 if you count the directories that get skipped). Any thoughts or ideas? Pattern matching shouldn't be this slow?
rsync -vvnWr --exclude='aaa.tar.gz' --exclude='bbb.tar.gz' -exclude='ccc.tar.gz' --include='*.tar.gz' --exclude='*' --delete -e "ssh -p 34577 -i /root/.ssh/backup_rsa" email@example.com:/backup/cpbackup/daily/ /backup/jarvis/cpanel/$((($(date +\%-d)-1)/7+1))/*
[sender] showing file ddd.tar.gz because of pattern *.tar.gz [sender] showing file eee.tar.gz because of pattern *.tar.gz [sender] hiding directory fff.0 because of pattern * [sender] showing file ggg.tar.gz because of pattern *.tar.gz ...
The output is the same with our without exclusions, obviously it skips the ones I list. With exclusions there are long pauses between each of these. I changed the IP and filenames.