rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
1answer
28 views

Automatically pauseing rsync if target is full

I need to transfer 80gb's of unsorted text documents from one computer to another and all I have is a 32gb USB. Is there an option to make rsync automatically pause when the USB is full without losing ...
1
vote
0answers
27 views

rsync copy only files facade [duplicate]

Is there a way to mirror a directory structure and files there contained with rsync, giving out facade zero length files? I mean, mirroring dirs (-d flag I think) exactly as they are, while not ...
1
vote
5answers
550 views

Interactive ssh works, but not rsync or scp, on OSX

The motivation is that there's a server that I can ssh into (with or without key pairs set up ... i.e., without or with a password) but that I cannot send files to via rsync, scp, or sftp. Someone ...
1
vote
1answer
224 views

Linux command to copy as hard links, while deleting unwanted files?

I'm looking for a command that behaves both like cp -al in only creating hard links rather than copying file contents, and rsync -a --delete in removing files from the destination that are not ...
1
vote
2answers
59 views

Can rsync be configured to avoid modifying subdirectories not found in the source folder?

I am having a hard time figuring out exactly how to run rsync to get it to do what I need it to do. Basically what I need is as follows given a single source folder with multiple sub-directories: ...
1
vote
0answers
29 views

Using rsync, how can I know what attribute of source file differed from the dest which caused the trasfer

I heavily depend on rsync for remote data transfer and backup purposes, occasionally on different filesystem types. AFAIK rsync by default compares file size and modification timestamps to find out ...
1
vote
1answer
336 views

Wildcards in exclude-filelist for duplicity

I am trying to exclude a "bulk" folder in each home directory from the backup. For this purpose, I have a line - /data/home/*/bulk in my exclude-filelist file. However, this doesn't seem to be ...
1
vote
0answers
3k views

@ERROR: chdir failed but directory exists

I have a D-Link DNS-320 and I've installed FFP and I'm trying to get rsync running on it. So far I've got the daemon up and running and I've defined a module in my rsyncd.conf like so: max ...
1
vote
2answers
233 views

rsync dir-merge affected by filters on local AND remote

I'm using rsync with --delete to upload files to a webserver. There are files I want to exclude because they're configuration files. I'm using the "dir-merge" filter so I can have .rsync-filter files ...
1
vote
0answers
82 views

How can I limit the bandwith to a davfs-mounted cloud storage?

I need to copy approx 400 files of approx. 25 MB each to a davfs-mounted cloud storage. I have tried the following commands to limit the CPU-load and IO-load: nice -n 15 ionice -c 3 rsync -avhW ...
1
vote
0answers
28 views

After restoring a backup my permissions seem to be borked

I made a complete backup of the system with "rsync -aAXv", and set up my encryption. After restoring everything, and booting up and trying to login, openbox didn't want to start, and "startx" didn't ...
1
vote
0answers
596 views

Run multiple rsync's at once?

I'm moving over about a million of files (800GB, containing) multiple system backups. And it's only running at ~9MB at a time, often. Enough bandwidth, since it can run up to about 50MB/s. However, ...
1
vote
1answer
172 views

get rsync to dereference symlinked dirs presented on cmdline like find -H

I'd love rsync to copy symlinks to dirs specified on the cmdline as dirs but leave all symlinks in the copied tree as is - like find -H, but the only way is a nasty hack of rsync -aR --rsync-path='cd ...
1
vote
2answers
268 views

Apply given rsync exclude patterns on given directory

I have a setup where I use rsync to mirror some source directory to a (remote) destination except for some files and locations defined witch rsync exclude patterns: # Useless files - thumbs.db - *.~ ...
1
vote
0answers
100 views

Delete files that are not included with `rsync --files-from`

I copy files to another location using rsync with the option --files-from. Sometimes, a file gets deleted and is not included in that list of files any more. I tried to use --delete, but that would ...
1
vote
1answer
170 views

rsync only leaves partial files?

I am trying to copy files from my hard drive to a networked external disk (WDMyCloud). I have enabled the FTP access to the hard drive and mounted it to a local directory using curlftpf to a local ...
1
vote
0answers
44 views

How to efficiently create (read-only) both a snapshot and a diffshot at the same time?

I use rsync to regularly create snapshots of some directories via PAR="-aP --chmod=a-w --no-owner" # Create diffshot rsync $PAR --compare-dest=$CURRENT_SNAPSHOT $SOURCE/ $DEST.changeset.incomplete ...
1
vote
0answers
337 views

Can I install a sync completion hook with rsync daemon?

Like hooks in svn or git, can I install a server-side hook script for rsync daemon? For sync completion event. I am using FreeBSD9/rsyncd.
1
vote
2answers
253 views

mlbackup / rsync / hard links data size

I am new to mlbackup/rsync and the concept of hard links, so I am a little confused after creating a backup data set via mlbackup. So here's the scenario: I am backing up "folder A" to "folder B". ...
1
vote
2answers
332 views

Is there a way to prevent emerge --sync from deleting files from the portage tree?

Although PORTAGE_RSYNC_OPTS, a make.conf option, allows one to change the rsync options but removing --delete from it causes emerge to fail. I think with it remarking about missing md5-cache entries ...
1
vote
1answer
92 views

Non-persistent differencing file

I have a large file (5-10 GB) and want to access this file in a special file system with the following conditions/features: There is a single process that reads and write on the file. When the ...
1
vote
0answers
574 views

Rsync daemon intrepreting parameters as command in rsync.conf

I meshed up with my rsync on linux. When I am restating it, its showing me following error: sudo /etc/init.d/rsync restart /etc/rsyncd.conf: line 13: [ftp]: command not found /etc/rsyncd.conf: line ...
1
vote
0answers
225 views

Use rsync with closed files only

I am interested in using rsync with the --remove-source-files option. I am planning on pointing it to a directory, with a command like: rsync -avm --remove-source-files --include='*.dat' -f 'hide,! ...
1
vote
0answers
89 views

Is there any rsync parameter for show at the end the changes made?

I have a script that sync (mirror mode) four folders between two disks. While it is running it shows the directory where it is in this very moment, and at the end it shows bytes sent, speed, etc. I'm ...
1
vote
0answers
132 views

Running rsync as a daemon for a local transfer

My coworker is trying to talk me into running rsync as a daemon on my EM server. I'm currently using rsync to copy a NFS share on my storage cluster to USB external drives so the data can be reviewed ...
1
vote
0answers
845 views

ssh: “Error reading response length from authentication socket”

I have a Makefile with some ssh and rsync commands. All of them are executed correctly, but give the following error message: Error reading response length from authentication socket. I don't like ...
1
vote
1answer
91 views

rsync with different user

I'm working with two ubuntu instances on AWS (which I use a pem key to access them). I set up rsync for both instances, and it works if I use the default user which is ubuntu@ipaddress. However if I ...
1
vote
2answers
348 views

Delete files that exist in the source with rsync

I have a folder on server "A" called ./delete. I want to delete everything in the folder ./stuff on server "B" that exists in the ./delete folder on server "A". Its like the reverse of rsync. ...
0
votes
1answer
573 views

How do I escape a dot character for an rsync command? [closed]

I'm trying to do... ssh -av -e deploy@domain.com:/var/www/domain.com /Users/user/workspace/domain But it's outputting this (I presume because of the period character): OpenSSH_5.6p1, OpenSSL ...
0
votes
3answers
50 views

How to remove directory from rsync share completely

Is there any rsync command that can remove some remote directory from rsync share completely? I mean delete not only directory content but the directory itself. And without rsyncing the entire parent ...
0
votes
2answers
3k views

Parallelise rsync using GNU Parallel

I have been using a rsync script to synchronize data at one host with the data at another host. The data has numerous small-sized files that contribute to almost 1.2TB. In order to sync those files, ...
0
votes
2answers
440 views

What root directories should I back up? [duplicate]

I intend to start incremental backups of my Fedora 20 system, and would like to know what root directories I should include, and what directories it is useful to exclude. I know there is a lot of ...
0
votes
2answers
498 views

How to backup /etc/{,g}shadow files with 0000 permission?

I am trying to backup several servers' /etc by using rsync from another server. Here's a relevant snippet: PRIVKEY=/path/to/private.key RSYNC_OPTS="--archive --inplace --no-whole-file --quiet" ssh -n ...
0
votes
3answers
28 views

How to stop rsync from replacing every file whether or not it has been changed?

I want rsync to copy everything from "copy_to_home" directory (which is on a NTFS-formatted hard drive) to the users home directory. I don't want it to delete anying, but it should replace files on ...
0
votes
1answer
90 views

Why does 'rysnc' change file-system permissions?

I am trying to use rsync to sync files from my laptop (Ubuntu 14.04) to an external disk. When connecting the disk I start the sync with the following command: rsync -av --delete ...
0
votes
2answers
67 views

Rsync'ing system, exclude doesn't seem to work

I'm trying to make a full filesystem backup of a server through rsync, following this guide. I'm using the following command: rsync -aAXH --progress --delete --stats --exclude={\ "/dev/*",\ ...
0
votes
2answers
245 views

How to detect particular system call called or not in a whole workflow?

EDIT No. 1 My task is mirroring , i.e., copying updated data from master server to all mirrors, by using rsync and rsh. But during rsync and rsh, I found some delay. My thinking is , the reason for ...
0
votes
1answer
109 views

Creating the first backup

I heard that rsync isn't the best one when creating the first backup in terms of performance. Instead it is the best for the later backups. So I wonder what are some better commands for creating the ...
0
votes
2answers
51 views

rsync question syncing source with destination (archiving surplus files on destination)

rsync is pretty clear to me but I have a specific task I could not figure out yet. I want to sync source with destination 1:1. I believe the --delete option would cover that. So if I add a file on ...
0
votes
1answer
31 views

How to automate (copy) LDAP/Kereberos install

I have several machines running Debian that I'm configuring to work with Kerberos and LDAP. I thought I would automate using rsync. At first I tried a basic rsync clone excluding directories and ...
0
votes
1answer
38 views

rsync creates directories that are excluded

I'm confused about how rsync includes/excludes files and directories. I have an exclude file: /home/pi/rsync-exclude.txt with contents: /proc/* /sys/* /dev/* /boot/* /tmp/* /run/* /mnt/* /media/* ...
0
votes
1answer
46 views

Why is rsync truncating this path?

I'm trying to synchronize a set of remote files via an rsync daemon, but the resulting path is missing the initial path element. $ rsync -HRavP ftp.ncbi.nih.gov::refseq/H_sapiens/README 2015-05-11/ ...
0
votes
3answers
87 views

Backup using rsync

Last time I backed up my data by copying and pasting my home directory into my external hard drive. Since then, I have added and deleted files from my home directory. I want to update that directory ...
0
votes
2answers
455 views

Help with using rsync or cpio to do an incremental backup [duplicate]

I'm trying to do an incremental backup of all files on my NAS box that where modified in the last 24 hours (or so, can be more flexible). I'm using PuTTY to connect through SSH to a ReadyNAS 102 ...
0
votes
1answer
22 views

Can't get rsync options right

I am running this command as bash script: rsync -avz -e ssh -o StrictHostKeyChecking=no /srv/system/scripts/test.txt server@hidden:/home/server/serverscripts/mounts/digitalocean And this is the ...
0
votes
1answer
27 views

how to use 'rsync --files-from' to avoid ssh's password repeatition?

right now i'm using this code to syncronise stuff between my pcs: nexus_ip=$(ip neigh | grep "nexus's mac addr" | grep -Eo '^[^ ]+') function syncit () { # rsync -rLEAXpogtP --delete "$1" "$2" rsync ...
0
votes
2answers
64 views

checking rsync run status

We have a cron job running to rsync files from one server to a different host. The cron runs daily at midnight. The file copy is critical for us so we want to monitor the backup runs. We want to ...
0
votes
1answer
370 views

RSync - Permission denied (13) while executing rsync as a root

I am trying to set up hourly rsync beetwen my local machine and remote server. I have already created a ssh certificate to enable login less connection to remote machine. Now however when I execute ...
0
votes
1answer
227 views

rsync excluding empty files

I recently discovered that a few files on a volume had been mysteriously truncated - or more accurately, replaced with a zero length file. Fortunately, these files were hard-linked from multiple ...
0
votes
2answers
131 views

Rsyncing files from server to local machine automatically

I currently have a crontab job running on my machine every friday at 3 AM as a back up method. The job runs a bash script which runs an rsync command to sync files from the server to my external hard ...