rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
3answers
2k views

rsync list of files in sub-directories to remote server and delete extraneous

I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory. This is what I'm trying to accomplish: ...
1
vote
2answers
36 views

rsync dir-merge affected by filters on local AND remote

I'm using rsync with --delete to upload files to a webserver. There are files I want to exclude because they're configuration files. I'm using the "dir-merge" filter so I can have .rsync-filter files ...
1
vote
2answers
196 views

Is there a way to prevent emerge --sync from deleting files from the portage tree?

Although PORTAGE_RSYNC_OPTS, a make.conf option, allows one to change the rsync options but removing --delete from it causes emerge to fail. I think with it remarking about missing md5-cache entries ...
0
votes
2answers
226 views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
2
votes
1answer
73 views

rsync specific directories

Below are the directories of my directory structure. I only want to run rsync on the content under the archive directory of any subdirectory and exclude everything else: ./ ap/ ap/aploader/ ...
2
votes
1answer
275 views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
2
votes
1answer
54 views

Is monitoring rsync with a pts device possible?

I have a rsync backup script, and I was wondering about methods of monitoring it as it runs. I could have it save a log and use watch and tail, but I had a more elegant solution in mind that might be ...
2
votes
1answer
40 views

Can I set defaults for rsync in non daemon mode?

Can I set defaults for rsync in non daemon mode? I know the daemon mode has this configuration file: /etc/rsyncd.conf But I typically use the non daemon version in this sort of manner: rsync -avzcO ...
1
vote
1answer
22 views

Wildcards in exclude-filelist for duplicity

I am trying to exclude a "bulk" folder in each home directory from the backup. For this purpose, I have a line - /data/home/*/bulk in my exclude-filelist file. However, this doesn't seem to be ...
1
vote
1answer
38 views

get rsync to dereference symlinked dirs presented on cmdline like find -H

I'd love rsync to copy symlinks to dirs specified on the cmdline as dirs but leave all symlinks in the copied tree as is - like find -H, but the only way is a nasty hack of rsync -aR --rsync-path='cd ...
1
vote
1answer
85 views

rsync only leaves partial files?

I am trying to copy files from my hard drive to a networked external disk (WDMyCloud). I have enabled the FTP access to the hard drive and mounted it to a local directory using curlftpf to a local ...
0
votes
1answer
68 views

Rsync connection reset by peer

rsync --protocol=29 -rav -e ssh --include '*/' --include='*_en*.xml.gz' --exclude='*' user@server:/path/ Content is downloading from remote server but after while I get this error: Write failed: ...
0
votes
1answer
22 views

Backing up post install; rsync breaks

I use the following command for backup, but if I do a clean install of Fedora, copy over all my backed up files, then backup again, it copies them even though they are unchanged. Why? Can I avoid ...
0
votes
1answer
69 views

How use `rsync -R` with multiple subdirs or install -D with multiple files?

Is possible with rsync to copy multiple files from a source directory to a dest directory with multiple subdirectories that don't exist? Or use install -D with multiples files to a directory that ...
0
votes
1answer
57 views

rsync directory and contents to new location and owner

I have access to 2 group accounts: ops_user and test_user. Is it possible to copy a directory and all subdirectory owned by ops_user to a new directory owned by the test_user? I.e I want to copy ...
0
votes
1answer
258 views

rsync vs mtime and ctime

I've been using rsync for Android to backup my phone to a remote NTFS filesystem on a Linux system for a while. Recently, the HDD containing the NTFS filesystem has started to fail (or throw "I/O ...
0
votes
1answer
72 views

Rsync adding a “?” at the beginning of directories

I currently have many of these commands running in a .sh file that looks like this: rsync -avz -e ssh --rsh='ssh -p1337' --bwlimit=10000 root@DestinationIP:/home/backup /home/localbackup rsync -avz ...
0
votes
1answer
318 views

rsync giving “Directory has vanished” when there are multiple (existing) source directories

This is happening to me: $ rsync -av ./foo ./bar $DEST sending incremental file list directory has vanished: "/path/to/foo" foo exists and is regular a regular dir, and rsync -av ./foo $DEST works, ...
-1
votes
1answer
24 views

Can rsync mirror a directory, without following symlinks linking outside the tree?

I want to mirror some home directories to a remote location, but don't want to follow links that point outside the tree. Links pointing with the directories themselves are okay. I also want the links ...
2
votes
0answers
816 views

How to use rsync with GNU parallel?

I am using scp to copy the files in parallel using GNU parallel with my below shell script and it is working fine. I am not sure how can I use rsync in place of scp in my below shell script. I am ...
2
votes
0answers
188 views

easy rsync solution with file manager (thunar or nautilus or…)

A common tasks I teach new users in UNIX is how to make backups. Since most are not comfortable with the command line (CLI) and I want to have them make backups (more than forcing them to use the ...
2
votes
0answers
316 views

How to use rsync to backup large files by either appending or replacing

I am using rsync to backup some large files regularly: rsync --archive --update --append-verify [source] [destination] Most of the times, the files increase in size (like a log file), but sometimes ...
2
votes
0answers
221 views

Cannot get rsync to keep source file ownership, tried many tricks

I'm trying to rsync some directories from a webserver running RHEL5 to a system running Xubuntu. I have rsync, ssh, and keys setup for the machines. I've tried everything so that when i backup from ...
1
vote
0answers
13 views

How can I limit the bandwith to a davfs-mounted cloud storage?

I need to copy approx 400 files of approx. 25 MB each to a davfs-mounted cloud storage. I have tried the following commands to limit the CPU-load and IO-load: nice -n 15 ionice -c 3 rsync -avhW ...
1
vote
0answers
11 views

After restoring a backup my permissions seem to be borked

I made a complete backup of the system with "rsync -aAXv", and set up my encryption. After restoring everything, and booting up and trying to login, openbox didn't want to start, and "startx" didn't ...
1
vote
0answers
57 views

Run multiple rsync's at once?

I'm moving over about a million of files (800GB, containing) multiple system backups. And it's only running at ~9MB at a time, often. Enough bandwidth, since it can run up to about 50MB/s. However, ...
1
vote
0answers
49 views

rsync 3.1.0 is creating empty backup directories

I just noticed that there is a discrepancy between version 3.0.9 and 3.1.0 of rsync. Running the command $ rsync -a --delete --backup --backup-dir=../old source/ dest/ with version 3.1.0 gives the ...
1
vote
0answers
45 views

Rsync - Corrupted MAC on input

Background I have a script on my NAS which is a Synology DS212J which is running on a special distro where uname -a gives me Linux DS212J 2.6.32.12 #4493 Wed Jul 16 11:37:16 CST 2014 armv5tel ...
1
vote
0answers
24 views

Delete files that are not included with `rsync --files-from`

I copy files to another location using rsync with the option --files-from. Sometimes, a file gets deleted and is not included in that list of files any more. I tried to use --delete, but that would ...
1
vote
0answers
796 views

rsync multiple files to multiple directories

I need to move a large number of files that need to go to different directories i.e. file1.mpg to /mnt/s3/directory1/file1.mpg file2.mpg to /mnt/s3/directorya/file2.mpg file3.mpg to ...
1
vote
0answers
29 views

How to efficiently create (read-only) both a snapshot and a diffshot at the same time?

I use rsync to regularly create snapshots of some directories via PAR="-aP --chmod=a-w --no-owner" # Create diffshot rsync $PAR --compare-dest=$CURRENT_SNAPSHOT $SOURCE/ $DEST.changeset.incomplete ...
1
vote
0answers
126 views

Can I install a sync completion hook with rsync daemon?

Like hooks in svn or git, can I install a server-side hook script for rsync daemon? For sync completion event. I am using FreeBSD9/rsyncd.
1
vote
0answers
352 views

Rsync daemon intrepreting parameters as command in rsync.conf

I meshed up with my rsync on linux. When I am restating it, its showing me following error: sudo /etc/init.d/rsync restart /etc/rsyncd.conf: line 13: [ftp]: command not found /etc/rsyncd.conf: line ...
1
vote
0answers
175 views

BackupPC can't finish backup

I'm trying to backup /etc/ directory on CentOS 5.2 using BackupPC. It takes several hours and then aborted by signal ALRM. There is a partial backup created with all data from /etc But BackupPC thinks ...
1
vote
0answers
138 views

Use rsync with closed files only

I am interested in using rsync with the --remove-source-files option. I am planning on pointing it to a directory, with a command like: rsync -avm --remove-source-files --include='*.dat' -f 'hide,! ...
1
vote
0answers
78 views

Is there any rsync parameter for show at the end the changes made?

I have a script that sync (mirror mode) four folders between two disks. While it is running it shows the directory where it is in this very moment, and at the end it shows bytes sent, speed, etc. I'm ...
1
vote
0answers
102 views

Running rsync as a daemon for a local transfer

My coworker is trying to talk me into running rsync as a daemon on my EM server. I'm currently using rsync to copy a NFS share on my storage cluster to USB external drives so the data can be reviewed ...
1
vote
0answers
599 views

ssh: “Error reading response length from authentication socket”

I have a Makefile with some ssh and rsync commands. All of them are executed correctly, but give the following error message: Error reading response length from authentication socket. I don't like ...
0
votes
0answers
55 views

@ERROR: chdir failed but directory exists

I have a D-Link DNS-320 and I've installed FFP and I'm trying to get rsync running on it. So far I've got the daemon up and running and I've defined a module in my rsyncd.conf like so: max ...
0
votes
0answers
39 views

lsyncd and additional parameters for rsync

Currently Im using lsyncd to monitor data and sync them (same machine) settings{ logfile = "/var/log/lsyncd/lsyncd.log", statusFile = "/var/log/lsyncd/lsyncd_status.log", ...
0
votes
0answers
65 views

Script to compare directories and move files (like rsync)

I use rsync to sync data between two servers. If I completely rebuild the directory structure, rsync cannot understand this and will attempt to recopy everything. I am aware that Unison is capable ...
0
votes
0answers
73 views

Use Rsync with HTTP

Is it possible to use rsync with an HTML POST request? If so what would the rsync command look like? For example let's say using HTML5 I have this (bear with me going back to linux stuff): <form ...
0
votes
0answers
219 views

Why I can't pass ip to rsync script?

I am writing script were rsync should be called and ask for password. However I cannot pass IP as argument. I think I am missing something simple. Any ideas? Even trivial script like this just outputs ...
0
votes
0answers
53 views

rsync include-from exlcude-from with including subdir but excluding dirs above

I try to use rsync with --include-from and --exclude-from options. I have a directory structure like: /docs/domain-[a-z]/templates Now I want to sync templates only if something is in there. Further ...
0
votes
0answers
450 views

rsync error: error in rsync protocol data stream (code 12) at token.c(288)

When I attempt rsync from one server to another server, I get this error: [root@192.168.2.22 ~]# rsync -avzp -e ssh root@192.168.2.77:/system/data /system/data/ deflate on token returned 0 (88936 ...
0
votes
0answers
160 views

rsync dry-run not writing all information to log file

I am trying to get a log file for a dry-run of an rsync, but the actual file transfers are not showing up in the log file. My command is rsync -aruzv --delete src/ usr@me.com:dest/ ...
0
votes
0answers
2k views

Occasional rsync error code 12 “Connection reset by peer (104)” from cron task that runs every 20 minutes

I have a script run by cron that rsync's various folders to a server in a different city to publish files to websites. In case it matters, the source server is within the corporate firewall and the ...
0
votes
0answers
148 views

Rsync seems to back up files that haven't been opened or changed

I have started using rsync to back some data on my mac to an external HD. It works really well, but I have noticed something odd. Every time I run the command, I get a list of files that haven't been ...