rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
1answer
540 views

rsync and xfr#1, to-chk=0/1, what do they mean?

I do stuff such as :- $ copy debian-8.2.0-amd64-DVD-1.iso /media/shirish/4719-38E5/ Copy here is an alias for :- $ alias copy alias copy='rsync --progress -ravz' When it does the command it ...
1
vote
0answers
34 views

Exchanging huge file trees between disks

I have two 1TB disks and a huge file tree on each. Each takes up about 85% of their disk. I want to swap/exchange the trees between disks. The only spare (USB) disk that big I have is nearly full. ...
2
votes
2answers
98 views

RSync Error in script

At my job, we have a central Backup server, running Debian Wheezy, and on-site servers at each site, also running Debian Wheezy. A few weeks ago, the central office tech emailed me that the backup ...
2
votes
1answer
229 views

Rsync backup script for multiple servers

I have simple script that backing up data from remote server via ssh using rsync. I have external config file for that. In this config file I have variables: OPTIONS, REMOTE_IP, SOURCE and ...
1
vote
2answers
30 views

I am trying to copy files from a server to my local directory using rsync.I don't want to copy the files which are copied earlier and being removed

I am trying to copy files from a server to my local directory using rsync.But after some times local files are being moved to archive.So, next time when I will copy the contents from the remote ...
2
votes
1answer
192 views

How to backup readable but not writable files using rsync?

I am using rsync to backup some folders in my home directory to a remote server using the following commands: cd rsync -Favz --inplace --delete --delete-excluded folder1 folder2 folder3 ...
2
votes
1answer
523 views

rsync complains about symlinks

I'm using the dry-run (-n) option of rsync to compare directories on two different systems. Everything works fine with standard files and directories. However, when I use a directory that includes ...
0
votes
1answer
124 views

rsync command not preserving permissions

rsync is not preserving permissions/ownesrship after file transfer. Here is the scenario Source host(192.168.2.14 from where files are copied): Source Path # ls -l "/shareddata/tesz/" total 4 ...
2
votes
1answer
14 views

How do I avoid the creation of root folder of the source in the destination when using rsync?

For example, when I copy all *.txt files in /tmp/src and its subfolders to /tmp/dst by rsync -avm --include='*.txt' --include='*/' --exclude='*' "/tmp/src" "/tmp/dst" it makes src under /tmp/dst. ...
1
vote
3answers
609 views

rsync command does incremental copying or overwrites the file?

rsync command is used to sync a folder data to another folder. I want to know if this command overwrites the entire file and sync or copies only the new file or changed file. Does it prompt if similar ...
0
votes
1answer
134 views

ntfs issue with rsync: read errors mapping permission denied (13)

I have an issue when I want to rsync folders from my external backup hard disk to my NAS. I get this error : read errors mapping permission denied (13) I have root rights; if I want to change ...
0
votes
2answers
67 views

Delete destination directories with rsync (contents as well as parent)

I have a versions/ directory on a remote server to which I have only rsync daemon and ftp access. This directory contains a set of subdirectories, each named after the datetime of a deployed codebase ...
0
votes
2answers
55 views

rsync question syncing source with destination (archiving surplus files on destination)

rsync is pretty clear to me but I have a specific task I could not figure out yet. I want to sync source with destination 1:1. I believe the --delete option would cover that. So if I add a file on ...
1
vote
1answer
141 views

rsync --delete did not remove file in destination while with ssh

On my RHEL6 pair of servers, I tested the rsync from server-1 to Server-2 with SSH. Everything was good as expected. However, when I moved a file under A directory, A/x.file to B/ of /home/user on ...
0
votes
1answer
30 views

Cleanup archive and archive files only if sources exist using rsync, scp or sftp

I have to cleanup an archive directory on a remote host only if there are files to be archived; the source files are on the same host. I should run something similar to: cd $source_dir if [ -f ...
0
votes
0answers
219 views

Backup debian folder to qnap nas with rsync repeatly every day

Sorry for this dummy question, but I really stuck here. I have debian web server, which have a backup with usb hdd. I would like to get that backup and send it to my NAS. My NAS is QNAP model TS-231, ...
1
vote
1answer
70 views

Syncing folders where multiple files are partially changed

I have following directory structure on remote machine ALLLibs/LibA/LibA.1 ALLLibs/LibA/LibA.2 ALLLibs/LibB/LibB.1 ALLLibs/LibB/LibB.4 for info LibA.1 and LibA.2 are version of a directory, ...
0
votes
1answer
300 views

why does rsync log-file not contain updates to regular files when dry-run?

In dry-run-mode, the log file does not contain changed/ updated regular files, and no deletions at all. It only contains changed and created directories. Yet, when executed without dry-run, the log ...
2
votes
3answers
163 views

List transient files by numerical value having number greater than a given constantly varying filename

I've a directory having constantly changing filenames (by numerical value) listed as: -rw-rw----. 1 root root 10493952 May 7 10:39 A0000000.LOG -rw-rw----. 1 root root 10493952 May 7 08:38 ...
2
votes
3answers
113 views

Migrate mail from dovecot on centos to dovecot on debian

I am trying to migrate a number of user mail accounts from dovecot 1.0.7 on a centos 5.11 server to dovecot 2.1.7 on a debian 7 server Foolishly I thought I could simply replicate the Maildirs from ...
1
vote
1answer
21 views

Only move folders not existing in target directory

I am looking for a way to move folders that are not already present in the target directory on my linux server. Example: Target directory folder1 folder2 folder3 folder4 Source directory folder1 ...
4
votes
1answer
72 views

Does rsync over any type of checksum? [duplicate]

I need to transfer files from several servers to a single remote host using Rsync over SSH. However, I need to be sure that before the file is deleted on the source using the --remove-from-source ...
0
votes
1answer
97 views

How to pull one day old data from remote server to local server?

From what I have searched till now I only found command to PUSH one day old data from local server to remoteServer but what I want is to PULL one day old data from remoteServer to localServer. I ...
2
votes
1answer
47 views

Is it feasible to update the modified times only without copying files when using rsync?

The modified times of a large amount of local files are incorrect. I want to update the timestamps by syncing the timestamps on the server. It would be time-consuming if the files themselves are ...
2
votes
2answers
266 views

rsync option to exclude partial files

We are using rsync to sync two folders on same machine. Files will be written to a source folder from another application. We have the problem that, even if a file is not completely written/copied to ...
1
vote
0answers
38 views

Using rsync with the verbose option and filtering the information displayed

I am using rsync with the -a -r and -v options to copy files and directories from one server to another. This all works fine. But when I make a change, for example, to a single file on the source ...
0
votes
1answer
33 views

How to automate (copy) LDAP/Kereberos install

I have several machines running Debian that I'm configuring to work with Kerberos and LDAP. I thought I would automate using rsync. At first I tried a basic rsync clone excluding directories and ...
2
votes
1answer
52 views

rsync selected subdirectories only

I want to rsync a part of my music library from external drive to my audio player. Generally speaking, say, there is a $source and $target directories, and a text file $subdirs with a list of ...
2
votes
3answers
259 views

Copy only directories with .mp3 files with rsync

I'm trying to copy only folders with .mp3 files in them to another device. And only the .mp3s in them. The structure looks like this: Band/Year - Album/*.flac Band/Year - Album/*.txt Band/Year - ...
2
votes
3answers
284 views

How to pass argument with char ( in remote path?

I'm trying to move a file with rsync to a remote location, The file has be be named : DRRS_(H264).mp4 but when I try : rsync -azR output.mp4 user@server.com:encoded/somepath/DRRS_(H264).mp4 it ...
1
vote
1answer
36 views

rsync filter based on an intermediate directory name

I want to copy files /SRC/**/OK/**/*OK* to /DEST/**/OK/**/*OK* using rsync. For all the files to copy, there must be a folder named OK in the full path and a OK in the filename. I tried rsync -avP ...
1
vote
3answers
212 views

To Rsync files where permission denied

I want to find those files which I cannot copy to another location such that I could do Rsync. I have an external HDD and my system´s HDD. The external HDD has files which my system is missing. I ...
2
votes
1answer
344 views

rsync over SSH sometimes very slow--other times maxes out bandwidth

I have a bash script set up on computer A (Mac OS X) set to run every five minutes via a cronjob. This script checks for new files on remote computer B (Gentoo Linux) then rsyncs any new files to ...
0
votes
1answer
56 views

rsync creates directories that are excluded

I'm confused about how rsync includes/excludes files and directories. I have an exclude file: /home/pi/rsync-exclude.txt with contents: /proc/* /sys/* /dev/* /boot/* /tmp/* /run/* /mnt/* /media/* ...
6
votes
1answer
127 views

Redo rsync to preserve hard links?

I'm copying a Raspbian partition from one SD Card to a stand alone Raspbian install on a new SD Card. Based on a suggestion elsewhere, I ran: rsync -av --exclude=/mnt / /mnt but now I'm concerned ...
7
votes
1answer
1k views

Understanding the output of --info=progress2 from rsync

If I run rsync with --info=progress2, I get an output like 105.45M 13% 602.83kB/s 0:02:50 (xfr#495, ir-chk=1020/3825) But what do the single numbers mean? I haven't found a matching entry ...
2
votes
1answer
54 views

Best way to archive after rsync

We have an rsync job that copies thousands of tiny little files to a server. After the files are on that server, we use retrospect to back them up to tape. Retrospect is starting to choke due to the ...
1
vote
3answers
3k views

Save a list of files over SFTP to a text file

I have provided my own answer below. We have a number of bash scripts that work fine using SFTP, what I would like to do is to simply re-direct an ls or dir of a folder to a file on our SFTP Server.. ...
0
votes
2answers
82 views

Is there a way to rate-limit an rsync user?

I have a user with a Shell account(with jailkit) that insists on rsyncing 500gb of data on a daily basis. Is there a way to limit that rsync to say just 2mbits per sec? If I have to do it by IP, how ...
4
votes
1answer
177 views

Should the key for an automatically running cron job that runs over ssh not have a passphrase?

I'm reading an article in Master Linux Now 2013 called OpenSSH: Easy Logins and it uses ssh-agent to allow you to enter a passphrase for your key once, and then you're able to connect to a remote ...
1
vote
1answer
45 views

How to avoid recursive directory traversal for syncing two directories? [closed]

I see a lot of useless recursive directory traversal in: rsync unison owncloud All above application (and many more) do recursive directory traversal over and over again. Since the application ...
0
votes
1answer
65 views

Want to use find with rsync in script

I'm trying to make a script that will run in cron, that will search a path for specific file name. In the path there might be more folders with that same file name. If found and they are newer than 2 ...
0
votes
1answer
313 views

Use rsync to transfer files from Windows to Ubuntu

I'm having trouble transferring files via ssh from a Windows box to an Ubuntu box using rsync and cygwin on Windows. The file transfer starts, but the newly created directories and files on the ...
-1
votes
1answer
23 views

Copy Month wise folders

Main_Dir | --------------------------------------------------------------------- Subdir1 ...
1
vote
2answers
49 views

Using rsync to synchronize directories

I have a script that I am using to backup a directory on a CentOS 6 machine. It's very basic but it is executing rsync -a remote:~/original ./backup This works fine: it is copying the contents of ...
2
votes
1answer
120 views

How can I give a user the CAP_MKNOD capabillity?

Following on from this question: rsync's relationship with special files In order to back up device files, rsync at the destination needs to be able to call mknod. The usual approach would be to ...
2
votes
0answers
80 views

Ecryptfs problem with rsync

I use rsync to sync my files between my home laptop and my office desktop, with the -Cauvb --delete options. Recently, on my laptop, I encrypted my home directory with ecryptfs, which lives on an ...
0
votes
0answers
29 views

After rsync no files exist

From my Ubuntu server I used rsync to copy all my data to my USB drive (FAT). After copying the data (it needed quite a while to copy so I guess the copying did happen) I deleted it from the server. ...
1
vote
3answers
70 views

Moving a backup directory with hard links

I have a script to create backup that uses rsync. Now I'd like to organize the folder moving the older backups to a empty folder above. And I'd like to keep all hard-links and use that as reference to ...
4
votes
1answer
436 views

rsync's relationship with special files

I'm trying to transfer some existing backups from one system to another. The older backup system seems to have managed to back up special files like /dev/hda, /dev/tty0, and /dev/null which look like ...