rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

4
votes
1answer
84 views

Edge cases in filesystem operations during backup and file copy

I have a question about file access in Linux that I cannot sum it up completely. Consider that I have a home directory that I backup it using rsync triggered via cron. My home directory is on an EXT4 ...
23
votes
4answers
24k views

Is there ever a reason to use scp instead of rsync?

Is there a reason to use scp instead of rsync? I can see no reason for using scp ever again, rsync does everything that scp does, with more safety (can preserve symlinks etc).
2
votes
2answers
582 views

How do I only copy files to a destination that exist in the folder from the source, everything else should not be copied

How can I copy files from source to destination, where in all the files existing in destination (with directory structure), only should be copied from the source, overwritten in the destination. Rest ...
2
votes
0answers
4k views

Occasional rsync error code 12 “Connection reset by peer (104)” from cron task that runs every 20 minutes

I have a script run by cron that rsync's various folders to a server in a different city to publish files to websites. In case it matters, the source server is within the corporate firewall and the ...
5
votes
1answer
462 views

How to merge multiple WebDAV accounts for backup?

I use davfs, aufs, rsync: sudo mount -t davfs -o uid=wd,gid=wd,dir_mode=777,rw https://wd1.wd.wd/ /mnt/webdav1 sudo mount -t davfs -o uid=wd,gid=wd,dir_mode=777,rw https://wd1.wd.wd/ /mnt/webdav2 ...
1
vote
1answer
834 views

why isn't rsync copying files to the server

I'm following along with a Railscast that teaches how to set up Chef solo. It uses two interesting terminal commands that I had never seen before, only one of which I can get to work. When I do scp ...
1
vote
1answer
1k views

rsync “Permission denied” despite ownership

I just rsync'd a bunch of files, from a Windows box running cygwin sshd, to a CentOS 6.4 box. I ran rsync -e sshd... on CentOS to do this. Then I plugged in a USB drive on the CentOS box, formatted ...
10
votes
2answers
11k views

rsync exclude directory not working

I am running Fedora 17 64-bit and the rsync --exclude=/home/ben/<dir> is not working as expected. I am trying to rsync my home directory to a thumb drive, but I want to exclude certainly ...
1
vote
2answers
254 views

mlbackup / rsync / hard links data size

I am new to mlbackup/rsync and the concept of hard links, so I am a little confused after creating a backup data set via mlbackup. So here's the scenario: I am backing up "folder A" to "folder B". ...
1
vote
1answer
204 views

Rsync is skipping encrypted (but mounted) home directory

I have two user-home-directories in /home/, /home/user1 and /home/user2, whereas user1 is encrypted (using ecryptfs) and user2 is not. If I use rsync like this (invoked as user1 which is a sudo user) ...
1
vote
2answers
333 views

Is there a way to prevent emerge --sync from deleting files from the portage tree?

Although PORTAGE_RSYNC_OPTS, a make.conf option, allows one to change the rsync options but removing --delete from it causes emerge to fail. I think with it remarking about missing md5-cache entries ...
2
votes
1answer
2k views

rsync failing to choose the correct target directory

I'm trying to write a short shell script which also handles copying a file called webcam.jpg into a date coded subdirectory. I'm using rsync for this as it automatically creates a directory if it ...
0
votes
1answer
79 views

Rsync adding a “?” at the beginning of directories

I currently have many of these commands running in a .sh file that looks like this: rsync -avz -e ssh --rsh='ssh -p1337' --bwlimit=10000 root@DestinationIP:/home/backup /home/localbackup rsync -avz ...
0
votes
1answer
1k views

rsync remote to local automatic backup

Because all my work is stored on a remote server I would like to auto backup my server monthly and weekly. My server is running Centos 5.5 and while searching the web I'm found a tool named rsync. I ...
1
vote
1answer
92 views

Non-persistent differencing file

I have a large file (5-10 GB) and want to access this file in a special file system with the following conditions/features: There is a single process that reads and write on the file. When the ...
1
vote
3answers
3k views

rsync only subdirectories and content

I have a directory that contains a number of files and subdirectories. See below: baseDir bad1 bad2 subDir1 file1 subDir2 file1 I would like to rsync the contents of baseDir without ...
1
vote
1answer
2k views

Backing up hard links (rsync)?

My question begins with: Do I actually have hard links on my disk at all (except for "." and ".." of course)? I'm not sure how I would find that out? If no, the question is already answered. If yes, ...
10
votes
1answer
24k views

how to tell rsync to preserve time stamp on files when source tree has a mounted point

Related to this question Short description of the problem: When source tree has a mounted point inside it, then time stamps on files inside that mounted point when copied to target tree are not ...
10
votes
2answers
3k views

Why does my rsync not allow block-size>128K?

Running rsync with a large* --block-size like this: rsync -avvz --rsh 'ssh -c arcfour' --block-size 1048576 --inplace --progress example.com:/big.file /big.file I get the following error: Invalid ...
8
votes
4answers
8k views

cp or rsync, is cp really worth it?

I hope this does not count as a question without a real answer, as I can't seem to find a good reason to use cp(1) over rsync(1) in virtually all circumstances. Should one typically favour rsync over ...
1
vote
1answer
2k views

rsync exclude based on file size?

Is it possible to exclude files in rsync over a certain size (e.g. over 250 MB)? And what if I also want to exclude hidden files? How would I exclude all hidden files or directories (those that ...
2
votes
1answer
376 views

Rsync over Rsync via cronjob

I have a local server which Rsync's from some computers on the LAN. It's a part of a backup solution. This Rsync runs via cronjob twice a day. Occationally people add gigantic amounts of data, like a ...
2
votes
3answers
109 views

Get files on remote copy but not local

I have a folder. I have one copy of this folder locally and one on a server. I edited my local folder as I wanted and then rsync it to the server. Is there any way of comparing those two copies, ...
0
votes
2answers
113 views

Rsync after copy

Does Rsync after copy only send the differences between the folders, or does it copy the entire folder again since Rsync has never been implemented before on that folder?
1
vote
1answer
390 views

Bash scripting rsync puzzler

Frustrating. The script below work for the first two targets, but not the second. #!bin/bash ... backitup () { Todaysdate=`date "+%Y-%m-%dT%H_%M_%S"` Sourcedir=$1 Destination=$2 Username=$(echo ...
3
votes
1answer
693 views

Bash remote autocompletion : change the 'starting' directory

I'm regularly downloading files from a remote server, always from the same directory. So I wrote a custom function that I put in my bashrc: download_from_myserver () { for file in "$@" do ...
6
votes
2answers
10k views

rsync certain files, excluding the rest, ignoring .svn/ directory, recursively

I'm using rsync to copy some files from a share to another. Recursively, I need to: Delete files at destination that were removed from the origin Only sync php and js files Exclude every other file ...
5
votes
2answers
2k views

Can't share an ssh connection with rsync

In my .ssh/config file I have the following: Host xxx User yyy HostName zzzz ControlMaster auto ControlPath ~/.ssh/%r@%h:%p This works great for multiplexing my ssh connections (i.e. login once, ...
3
votes
2answers
189 views

Any ideas to simplify the awkward rsync expression below?

Here is expression: rsync -avz --progress -e "ssh -i /where/is/my/id_dsa" vivek@some.host:`ssh -i /where/is/my/id_dsa vivek@some.host "find /remote/source/dir -type f -name '*.sql' | sort -nr | head ...
2
votes
1answer
481 views

`mv` has failed because of insufficient disk space, what now?

I have tried to move a folder A from partition a to partition b as folder B with mv. Now the target file system was not big enough for all the data (I know I should have checked this first). Anyway, ...
9
votes
3answers
2k views

How can I exclude files by default with rsync?

How can I exclude files by default with rsync? Here is how my normal rsync syntax starts out: rsync --exclude ".ht*" --exclude "error_log" --exclude ".DS*" --exclude "old" ... I've seen a lot of ...
4
votes
2answers
7k views

How do I rsync only some files in some directories

I'm trying to sync all *.jpg files from /var/www/data/models/days/ + some other directories from /var/www/data root. I do: rsync -az --delete --include='/models' --include='*.jpg' --exclude='*' ...
2
votes
2answers
1k views

Cancel and resume a duplicity backup

Is there a way to cancel duplicity (running over rsync and symmetric gpg encryption) without messing up the running backup and resume it later (for example after rebooting the laptop) without ...
2
votes
1answer
440 views

ssh/scp works but rsync just constantly says “no”

Hi I have a windows 2003 server that I need to back up onto a linux client so I install cygwin on the Win2k3. On the Win2k3 I have enabled ssh, scp but (because the Win2k3 server uses an customised ...
8
votes
3answers
4k views

Why does rsync fail to copy files from /sys in Linux?

I have a bash script which uses rsync to backup files in Archlinux. I noticed that rsync failed to copy a file from /sys, while cp worked just fine: # rsync /sys/class/net/enp3s1/address /tmp ...
0
votes
0answers
247 views

Rsync seems to back up files that haven't been opened or changed

I have started using rsync to back some data on my mac to an external HD. It works really well, but I have noticed something odd. Every time I run the command, I get a list of files that haven't been ...
3
votes
1answer
6k views

rsync: failed to set permissions on “/path/to/file.txt”: Operation not permitted (1) [duplicate]

I encountered the error when attempting to transfer source files from a remote Linux web server to a local HP dt1000i Desktop Hard Drive connected to an Ubuntu 12.10 box via USB. A Samba share is ...
1
vote
0answers
575 views

Rsync daemon intrepreting parameters as command in rsync.conf

I meshed up with my rsync on linux. When I am restating it, its showing me following error: sudo /etc/init.d/rsync restart /etc/rsyncd.conf: line 13: [ftp]: command not found /etc/rsyncd.conf: line ...
2
votes
1answer
16k views

rsync: error starting client-server protocol

I have rsyncd running on both the systems . When I am trying to check the connection it giving me following error: From host2: user@host2#rsync username@host1::share password: [password] ...
1
vote
1answer
145 views

backup / on ntfs filesystem encrypted

I was about to backup my archlinux, following this guide to my FritzBox, (which enforces a NTFS system that I mounted via samba) as I remembered, that NTFS is not capable to keep permissions and other ...
2
votes
1answer
1k views

rsync and backup and changing timezone

I back up my pictures from my camera using rsync, using: rsync -vzrtl --progress --stats --timeout=0 host destination Now I was in a different timezone when I did my first backup then I moved to a ...
1
vote
1answer
2k views

IO Error in rsync while doing everyday backup

I have a sample NAS server (QNAP TS-210), with very limited Linux on-board (although a bit reinforced with Optware/IPKG). I'm a Linux newbie. After digging through Internet I was able to write my own ...
14
votes
1answer
4k views

Making a progressbar with “dialog” from rsync output

I'm looking for a way to filter/redirect rsync output in a manner where it can be fed to the "dialog --gauge" command, so I can get a nice looking progressbar during file sync. Currently I have only ...
2
votes
0answers
300 views

BackupPC can't finish backup

I'm trying to backup /etc/ directory on CentOS 5.2 using BackupPC. It takes several hours and then aborted by signal ALRM. There is a partial backup created with all data from /etc But BackupPC thinks ...
6
votes
2answers
270 views

Rsync different behavior when syncing folders HDD-HDD or HDD-Ext HD

When I sync two folders between two HDDs, rsync only lists the changes made at the end. However if I sync a folder between a HDD and an external HD, while the sync is running it is listing each ...
2
votes
1answer
1k views

rsync server and client issue

I am new to rsync server so please bear with me. I just configured an rsync server that is hosting the files I would like to replicate to a remote machine. Here is the rsyncd.conf file: max ...
13
votes
6answers
19k views

tar + rsync + untar. Any speed benefit over just rsync?

I often find myself sending folders with 10K - 100K of files to a remote machine (within the same network on-campus). I was just wondering if there are reasons to believe that, tar + rsync + ...
0
votes
2answers
250 views

How to detect particular system call called or not in a whole workflow?

EDIT No. 1 My task is mirroring , i.e., copying updated data from master server to all mirrors, by using rsync and rsh. But during rsync and rsh, I found some delay. My thinking is , the reason for ...
1
vote
2answers
4k views

Synchronizing same files with different filenames using rsync [duplicate]

I have a directory ~/music that contains all my music files and a directory /media/backup/music that I wish to synchronize with the first one using rsync. Initially, I did a rsync -a ~/music ...
33
votes
1answer
32k views

Delete extraneous files from dest dir via rsync?

Say I have SRC 001.jpg 002.jpg 001.txt a.zip DEST hello.jpg rsync -d --delete SRC:{*.jpg,*.txt} DEST It doesn't remove hello.jpg from DEST, any idea how to archive this?