rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

4
votes
1answer
280 views

Using inotifywait along with vim

I have simple script that monitors file for changes and rsyncs it with remote copy: #!/bin/bash while inotifywait -e close_write somefile do rsync somefile user@host.domain:./somefile done It ...
2
votes
3answers
205 views

Copy only directories with .mp3 files with rsync

I'm trying to copy only folders with .mp3 files in them to another device. And only the .mp3s in them. The structure looks like this: Band/Year - Album/*.flac Band/Year - Album/*.txt Band/Year - ...
2
votes
3answers
251 views

How to pass argument with char ( in remote path?

I'm trying to move a file with rsync to a remote location, The file has be be named : DRRS_(H264).mp4 but when I try : rsync -azR output.mp4 user@server.com:encoded/somepath/DRRS_(H264).mp4 it ...
3
votes
5answers
4k views

Suppress server message in rsync

When I rsync or scp from a particular server I get a rather long message telling me the rules of the server. However when I setup regular pulls, I'd like to be able to suppress those messages in my ...
1
vote
3answers
140 views

To Rsync files where permission denied

I want to find those files which I cannot copy to another location such that I could do Rsync. I have an external HDD and my system´s HDD. The external HDD has files which my system is missing. I ...
2
votes
1answer
221 views

rsync over SSH sometimes very slow--other times maxes out bandwidth

I have a bash script set up on computer A (Mac OS X) set to run every five minutes via a cronjob. This script checks for new files on remote computer B (Gentoo Linux) then rsyncs any new files to ...
1
vote
3answers
2k views

Save a list of files over SFTP to a text file

I have provided my own answer below. We have a number of bash scripts that work fine using SFTP, what I would like to do is to simply re-direct an ls or dir of a folder to a file on our SFTP Server.. ...
0
votes
1answer
38 views

rsync creates directories that are excluded

I'm confused about how rsync includes/excludes files and directories. I have an exclude file: /home/pi/rsync-exclude.txt with contents: /proc/* /sys/* /dev/* /boot/* /tmp/* /run/* /mnt/* /media/* ...
6
votes
1answer
119 views

Redo rsync to preserve hard links?

I'm copying a Raspbian partition from one SD Card to a stand alone Raspbian install on a new SD Card. Based on a suggestion elsewhere, I ran: rsync -av --exclude=/mnt / /mnt but now I'm concerned ...
2
votes
1answer
47 views

Best way to archive after rsync

We have an rsync job that copies thousands of tiny little files to a server. After the files are on that server, we use retrospect to back them up to tape. Retrospect is starting to choke due to the ...
0
votes
2answers
70 views

Is there a way to rate-limit an rsync user?

I have a user with a Shell account(with jailkit) that insists on rsyncing 500gb of data on a daily basis. Is there a way to limit that rsync to say just 2mbits per sec? If I have to do it by IP, how ...
4
votes
1answer
127 views

Should the key for an automatically running cron job that runs over ssh not have a passphrase?

I'm reading an article in Master Linux Now 2013 called OpenSSH: Easy Logins and it uses ssh-agent to allow you to enter a passphrase for your key once, and then you're able to connect to a remote ...
1
vote
1answer
42 views

How to avoid recursive directory traversal for syncing two directories? [closed]

I see a lot of useless recursive directory traversal in: rsync unison owncloud All above application (and many more) do recursive directory traversal over and over again. Since the application ...
0
votes
1answer
52 views

Want to use find with rsync in script

I'm trying to make a script that will run in cron, that will search a path for specific file name. In the path there might be more folders with that same file name. If found and they are newer than 2 ...
0
votes
1answer
196 views

Use rsync to transfer files from Windows to Ubuntu

I'm having trouble transferring files via ssh from a Windows box to an Ubuntu box using rsync and cygwin on Windows. The file transfer starts, but the newly created directories and files on the ...
12
votes
2answers
26k views

“rsync: failed to set permissions on …” error with rsync -a or -p option

When I use the -a option as is asked and answered in Preserve the permissions with rsync, I got a lot of "rsync: failed to set permissions on" errors. rsync: failed to set permissions on ...
7
votes
2answers
16k views

rsync is very slow (factor 8 to 10) compared to cp on copying files from nfs-share to local dir

I have a freshly installed Ubuntu-server which is ought to be the new backup-server for our VM-storage. The server has 4 nics, 2 of them 10Gbit (in fact an intel x540-T2 with the newest driver ...
-1
votes
1answer
21 views

Copy Month wise folders

Main_Dir | --------------------------------------------------------------------- Subdir1 ...
3
votes
2answers
400 views

rsync --backup-dir creates empty folders in backup dir

I have a folder structure like this: . ├── bkp ├── dst └── src └── folder └── file I run the following command: rsync -t -r -b --backup-dir /tmp/rsyncTest/bkp/ /tmp/rsyncTest/src/ ...
2
votes
1answer
84 views

How can I give a user the CAP_MKNOD capabillity?

Following on from this question: rsync's relationship with special files In order to back up device files, rsync at the destination needs to be able to call mknod. The usual approach would be to ...
2
votes
0answers
76 views

Ecryptfs problem with rsync

I use rsync to sync my files between my home laptop and my office desktop, with the -Cauvb --delete options. Recently, on my laptop, I encrypted my home directory with ecryptfs, which lives on an ...
0
votes
0answers
27 views

After rsync no files exist

From my Ubuntu server I used rsync to copy all my data to my USB drive (FAT). After copying the data (it needed quite a while to copy so I guess the copying did happen) I deleted it from the server. ...
4
votes
1answer
231 views

rsync's relationship with special files

I'm trying to transfer some existing backups from one system to another. The older backup system seems to have managed to back up special files like /dev/hda, /dev/tty0, and /dev/null which look like ...
1
vote
3answers
60 views

Moving a backup directory with hard links

I have a script to create backup that uses rsync. Now I'd like to organize the folder moving the older backups to a empty folder above. And I'd like to keep all hard-links and use that as reference to ...
1
vote
2answers
59 views

How to get rsync to complain if user not found

I'm moving files over from my old server to my new server. By the time I'm doing it for real (as opposed to just testing) I'll have all the "user" users (the non-system users, i.e. >= 1000) created on ...
1
vote
0answers
37 views

keep same inodes metadata with rsync or ignore metadata with du

I'm trying to synchronize two folders from a remote computer. I want to use rsync to send the folder, and du to check if the space used is identical on the remote computer. The problem is even with a ...
4
votes
1answer
1k views

how to get rsync to link identical files with --link-dest option if an old file already exists?

One might think that --link-dest'ing to an identical file would work in all cases. But it does not when the file exists, even if the file is out of date/has different contents. It is because of this, ...
1
vote
1answer
239 views

Lsyncd not working on Mac 10.9

I'm attempting to use lsyncd to automatically move files to my local development server. My host is OSX 10.9. SSH on the server works. I can connect using ssh from the host. I am using an SSH key to ...
1
vote
3answers
2k views

Rsync connection reset by peer

rsync --protocol=29 -rav -e ssh --include '*/' --include='*_en*.xml.gz' --exclude='*' user@server:/path/ Content is downloading from remote server but after while I get this error: Write failed: ...
0
votes
3answers
276 views

Merge (combine) directories using rsync

I need to create deploy script to combine directories ├── LIB_COMMON │ ├── file1.php │ ├── file2.php │ ├── file3.php │ └── file4.php ├── LIB_CZ │ ├── file2.php │ ├── file3.php │ ├── ...
3
votes
2answers
423 views

How to skip special / socket files during rsync transfer?

Using the following command. rsync --archive --delete --partial --progress --recursive --no-links --no-devices --quiet source target Using --no-links and --no-devices already. Getting the error ...
2
votes
1answer
166 views

rsync -vvv gets stuck in OS X with no clear explanation

All of a sudden (not sure when the problem started) my rsync commands against a given machine get stuck: $ (dd bs=1024 count=1024 </dev/urandom >/tmp/temp_file && rsync -arvvv ...
1
vote
0answers
40 views

How can you recover from disk corruption on a backup drive whilst maintaining all hard links?

So, I have a scenario that is similar to How to copy directories with preserving hardlinks? that I wish to use however I have corruption from the backup hardlink source. My Scenario: 1. I backup my ...
1
vote
1answer
2k views

“no matching cipher found” error in `rsync`

I am trying to copy a directory from one system to another with rsync; but it erred. Can you please advise me on what to check? Command: [M root@aMachine ~]# rsync -e "ssh -c blowfish" -v -a ...
1
vote
3answers
59 views

rsync adding extra directory to command

I'm scripting an rsync command, and currently I am trying to do something like... rsync -av -e ssh $DATASTORE/usr/local/somepath $DESTDIR/usr/local/someotherpath/ if I echo $DATASTORE it shows ...
12
votes
3answers
15k views

How to copy directory structure without removing symlinks?

I need to "install" a bunch of files to another directory keeping the directory structure of the source files intact. For example, if I have ./foo/bar/baz.txt going to /var/www/localhost/webroot/ I ...
0
votes
1answer
285 views

Rsync dry-run statistics- Different statistics after executing 'cp' and 'rsync' commands

In order to generate some random files, I have created a script which is as follows: #!/bin/bash for dir in `seq 1 10` do mkdir /root/mandar/RsyncSrc/$dir cd ...
7
votes
4answers
6k views

`cp -al` snapshot whose hard links get directed to a new file when edited

I am trying to take snapshots of a massive folder regularly. I have read here: http://www.mikerubel.org/computers/rsync_snapshots/#Incremental that cp -al takes a snapshot of a folder by simply ...
1
vote
2answers
413 views

Interrupting rsync with ctrl-c, should I use `--partial` or `--append`?

I would like to interrupt rsync with ctrl-c (let's say after half the file has transferred) and resume without having to resend the data that has already been transferred. The stackexchange/google ...
1
vote
2answers
237 views

tunnel rsync:// protocol over ssh

on my LAN (debian server, windows client) I use rsync:// protocol with this code cwRsync\rsync.exe -avLP --force --append-verify rsync://rsync-usb@server/rsync-usb/* usb/ I have read, that rsync in ...
2
votes
1answer
900 views

How can I check if rsync made any changes in bash?

I have a script which uses rsync to sync data in a remote -> local scenario. Immediately after the rsync command is run, a check to see if the error code equals zero or not. If its zero, further ...
5
votes
3answers
529 views

Copy from remote server which doesn't have rsync

I need to recursively copy a folder from a Ubuntu remote server where I have ssh access. I don't want to follow symbolic links, nor to copy permissions/owner/group, because my client system (Ubuntu ...
0
votes
1answer
332 views

Windows to Linux (rsync and ssh) [closed]

I'm trying to backup the folders in Windows Pictures to a remote Linux directory. This is what I have: rsync -av ssh /cygdrive/c/users/Owner/Pictures/ blah@192.168.1.10:/var/files/ImageSync/ I got ...
2
votes
1answer
286 views

how to make rsync to log deleted files

I'm using rsnapshot (which use rsync) to backup files from my web server to local Linux box (Synology) Files, deleted on the web server are deleted on the Linux box, as expected. The problem, that ...
6
votes
2answers
432 views

rsync hangs unless I defrag ext4 filesystem

I have a XBian server (Raspberry Pi version of Debian) running rsync via inetd (not the native dæmon). I am serving a couple of directories on an ext4 filesystem (on a USB disk) as individual modules ...
0
votes
1answer
144 views

rsnapshot backup not working?

I installed rsnapshot and configured it to make backup every hour. But the issue is all backups that are made not working. Let me explain to you, I made 3 backups hourly.0, hourly.1 and hourly.2. ...
0
votes
0answers
46 views

Working with Rsync and changing archives

I'm working with Acronis archives that I want to transfer offsite using rsync (since backing up via FTP or SMB is too troublesome with Acronis via internet). I`m using Acronis to backup Windows ...
2
votes
1answer
91 views

How to rsync only a specific list of files to the same location on another server

I have a list of files: /location/file.txt Content of file: /location1/file2.abc /location2/location3/file1.abc /location4/location5/fileX.cde I'd like to copy files to another sever like this: ...
0
votes
1answer
46 views

Why is rsync truncating this path?

I'm trying to synchronize a set of remote files via an rsync daemon, but the resulting path is missing the initial path element. $ rsync -HRavP ftp.ncbi.nih.gov::refseq/H_sapiens/README 2015-05-11/ ...
1
vote
1answer
49 views

What happens if I move the hard drives used by Rsync to another computer, and keep syncing them with it?

I realise the question is confusing, so allow me to elaborate. I apologise for the phrasing, as I wasn't sure how to put it. Here's the scenario: As my backup, currently my Mac launches Rsync every ...