rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
1answer
50 views

configuring rsync for incremental backup and recovery

The setup is a NAS box on a lan mounted as NFS and the source is a laptop running an old kubuntu 10.4. Rsync has to be run as a local file copy, NAS box doesn't support an rsync daemon. How do I ...
1
vote
0answers
24 views

delete .gitignored files with rsync

I often need to use rsync to synchronize a local with a possible remote directory, while ignoring exactly all the files git would ignore because of its .gitignore configuration. To do so, I am ...
3
votes
1answer
70 views

How does rysnc work over ssh?

When the rsync program is invoked over ssh what does the interaction between rsync and ssh look like? What feature of ssh is rsync using? I am interested in the interaction between rsync and ssh.
22
votes
3answers
24k views

How can I pause/resume rsync

How can I pause an rsync that's running? First time I did Ctrl+C to kill it and used the -P flag to run again. Is this prone to corrupt the current file transfer? Second time I simply put MacOS to ...
2
votes
3answers
1k views

rsync a list of directories with absolute path in text file

I have a text file containing a list of directories with its absolute path $ cat DirectoriesToCopy.txt /data/Dir1 /data/Dir2 I want to use rsync to copy all these directories preserving its ...
0
votes
3answers
29 views

How to remove directory from rsync share completely

Is there any rsync command that can remove some remote directory from rsync share completely? I mean delete not only directory content but the directory itself. And without rsyncing the entire parent ...
-2
votes
1answer
104 views

SSH error: WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!

I ran rsync (cygwin) and got this error. I think they changed the Red Hat Linux OS from version 5 to version 6, last night. Would that be the cause of this error message? What do I need to do to fix ...
1
vote
1answer
77 views

Bash script to get the result from rsync transfer and zip it as a directory in the original directory

OK, I guess this is weird. I have a small stage.sh script very simply has a bunch of commands: if [ "$(whoami)" == 'David' ]; then rsync -a --delete-excluded --exclude-from=.rsyncrc $(pwd) ...
0
votes
1answer
43 views

Rsync interrupted by “No space left” message

Say I want to rsync /dir of a remote host to the /dir (same path) of a local host. For that I would do rsync -artz root@remote-host:/dir/* /dir/ from my local host. The /dir on the remote host ...
1
vote
1answer
47 views

File corruption using rsync, multiple rsync processes, moved/renamed source file

I'm encountering some file corruption when using rsync (that is, the file contents do not match the source file). I can understand the file becoming corrupt if it is being written to while being ...
2
votes
2answers
96 views

Make rsync move (not copy) files on local file system

Can I make rsync to move large amount of files instead of copying them when on local filesystem? I would like it to behave like improved mv command. I know about --remove-source-files option but ...
0
votes
2answers
378 views

Parallelise rsync using GNU Parallel

I have been using a rsync script to synchronize data at one host with the data at another host. The data has numerous small-sized files that contribute to almost 1.2TB. In order to sync those files, ...
1
vote
0answers
40 views

Absolute path in rsync dry-run statistics

I have executed following command in order to get the list of files that would be transferred to remote server if rsync is executed: rsync -avzm --stats --safe-links --ignore-existing --dry-run ...
1
vote
1answer
57 views

Rsync Excludes Folders

I am running a rsync script and I want to exclude certain folders. I know with rsync you have to create a .txt file and add all the excludes in there but I am wondering is it possible to just have a ...
0
votes
0answers
12 views

sync source A into destination B

I want to create a perfect copy of A in B. I'm using this command, but is working good only on same existing folders rsync -h --progress --stats -r -tgo -p -l -D --delete /A /B if folder x exists ...
4
votes
4answers
2k views

Is setting a higher nice level for a process an effective way to reduce its impact on system load/CPU time?

I have an rsync cron job which is pushing the server load and triggering monitor alerts. If I set the job to be run with a high nice level, would that effectively reduce the impact it has on system ...
0
votes
1answer
35 views

rsync excluding empty files

I recently discovered that a few files on a volume had been mysteriously truncated - or more accurately, replaced with a zero length file. Fortunately, these files were hard-linked from multiple ...
3
votes
1answer
227 views

rsync's --link-dest option does not link because of file time

Consider this test case: mkdir a echo 'blah' > a/test mkdir b echo 'blah' > b/test rsync -r --link-dest=/tmp/b /tmp/a/ /tmp/c As expected, rsync creates c/test a hardlink of b/test (note the ...
0
votes
2answers
69 views

Rsyncing files from server to local machine automatically

I currently have a crontab job running on my machine every friday at 3 AM as a back up method. The job runs a bash script which runs an rsync command to sync files from the server to my external hard ...
1
vote
1answer
30 views

How can I do an rsync that asks for a confirmation for each individual file?

I have a small number of files to sync from one server to another, however there are some files I want to exclude from being synced. I'd rather not have to add them to a --exclude pattern if I can ...
1
vote
0answers
75 views

How rsync --compare-dest works

I know there's a very similar question here, but the accepted answer has nothing to do with rsync, and the OP's solution doesn't apply in my case. I'm trying to get all the updates from a CentOS ...
1
vote
1answer
69 views

How to keep a redundant home directory for offline use?

Scenario: My home dir is on NFS, identities are in LDAP and authorization is via Kerberos. My NFS, LDAP and Kerberos servers are all VMs -- I'm stretching a little hardware a long way at home. Life ...
5
votes
2answers
90 views

rsync doesn't preserve directory ownership even with -a

I use this rsync invocation to backup my home directory: rsync -aARrx --info= --force --delete --info=progress2 -F "$USER_HOME" "$BACKUP_MNTPOINT" rsync man page says that -a implies -g and -o ...
26
votes
3answers
17k views

Does rsync verify files copied between two local drives?

I want to make a fresh new copy of a large number of files from one local drive to another. I've read that rsync does a checksum comparison of files when sending them to a remote machine over a ...
0
votes
0answers
38 views

rsync question about a directory

I went ahead and used rsync to back up a root directory called /files my exact commands werersync -avzh /files willc66@server.com:/backup, inside my /files directory I had 2 sub directories home and ...
13
votes
1answer
559 views

What happens when you rsync without a destination?

To make the story short, I did an rsync: rsync -avP root@exampleserver.com:/tmp/ And I forgot to put in my source directory... I really meant to run: rsync -avP /tmp/ root@exampleserver.com:/tmp/ ...
10
votes
4answers
29k views

rsync without prompt for password

I need to execute rsync, without it prompting me for password. I've seen in rsync manpage that it doesn't allow specifying the password as command line argument. But I noticed that it allows ...
1
vote
0answers
143 views

Samba File Server Configuration and Sync for Redundancy

I have two boxes which I installed Samba on. For now, I have a single user that access the server, however, I need to expand as to deploy in a production network. Below is what I want to achieve. ...
2
votes
1answer
257 views

Understanding why such a discrepancy in network transfer?

Summary: I can't understand a peculiar discrepancy in network transfer. Why is there such a discrepancy in syncing from one machine to the other and vice versa? Also: Given the maximum network ...
2
votes
1answer
15k views

force rsync to overwrite files at destination even if they're newer

I have an rsync backup script I run, which also restores files back where they came from when I ask. But if the files at the destination are newer than those in the backup when I try to restore, it ...
1
vote
1answer
43 views

rsync with weird files name appended

I'm doing rsync every 10 minutes via cronjob with a 3g Dongle outside on a field. The rsync will send data to my EC2 server and there I can check the files being sent. But I encounter the destination ...
-2
votes
1answer
27 views

An incremental or another full backup? [closed]

After using rsync to backup a file system, if there has been dramatic change in the file system since the last backup, is it still good to do an incremental backup? Is there a rule of thumb about how ...
4
votes
1answer
419 views

easy rsync solution with file manager (thunar or nautilus or…)

A common tasks I teach new users in UNIX is how to make backups. Since most are not comfortable with the command line (CLI) and I want to have them make backups (more than forcing them to use the ...
1
vote
2answers
43 views

Rsync “finds” files that are implicitly excluded

I have a semi-working rsynccommand that I have combined with the find command on a linux box to do a simple file transfer of a specific type and date. Here's the command: rsync -avx --timeout=30 ...
0
votes
1answer
53 views

rsync: delete some files in destination not in source but not delete others

Given two directories /.../src and /.../des, they share some subdirectories share1 and share2 des also has a subdirectory named des1 which doesn't exist in src. How can I perform file transfer ...
38
votes
8answers
38k views

Rsync filter: copying one pattern only

I am trying to create a directory that will house all and only my PDFs compiled from LaTeX. I like keeping each project in a separate folder, all housed in a big folder called LaTeX. So I tried ...
2
votes
2answers
70 views

Rsync: Verify size of incremental backup of a file

I need to test the incremental backup of a file using rsync i.e. whether rsync transfers entire file or just the changes made to it, when an incremental backup is fired. Just for a test, I've created ...
1
vote
2answers
132 views

How do I use my own local text editor to modify system (requires root to save) files on a remote system?

I've recently fallen in love with github's Atom text editor, and I enjoy using it for all my local coding and configuration. I started to maintain a Nagios installation for several dozen servers and ...
0
votes
1answer
48 views

Understand the big difference between real and usr+sys time used by rsync?

I started running rsync in three programs at the same time to transfer data between my external hard drive and my internal one. When they finished, I have their timing results: $ time rsync -a ...
1
vote
1answer
15 views

Both time `rsync` and get its exit value?

If I want to time the running of rsync by time rsync -a /media/t/1/ ./, after it finishes, does $? report the exit value for time not for rsync? How can I both time rsync and get its exit value?
2
votes
1answer
59 views

Using inotifywait along with vim

I have simple script that monitors file for changes and rsyncs it with remote copy: #!/bin/bash while inotifywait -e close_write somefile do rsync somefile user@host.domain:./somefile done It ...
1
vote
1answer
30 views

What is the proper bash method of prompting the user for administrative password before backing up the usb data to the computer?

mate-terminal --window-with-profile=PROFILENAME="Hold the terminal open" -e "sudo rsync -azvu --log-file=/var/log/simplebackup.log --append-verify --exclude '.gvfs' /media/user/usb/ ...
2
votes
3answers
795 views

Does compression option -z with rsync speed up backup

In rsync, -z will compress file data during the transfer. If I understand correctly, -z compress files before transfer and then decompress them after transfer. Does the time reduced during ...
1
vote
1answer
238 views

Why are there multiple rsync threads?

I use a single rsync program to backup a file system. by ps, I find there are four rsync threads or processes, two in R state (running) and two in S state (suspended?): $ ps aux | grep rsync root ...
2
votes
0answers
72 views

Estimate time or work left to finish for rsync?

When running rsync on a directory with lots of files and directories at multiple levels, can we estimate the amount of work or time to finish? the progress option only shows the progress of ...
0
votes
0answers
37 views

rsync unexpected EOF in read_timeout

I'm trying to rsync directories from server A to server B, but i get the following error: permission denied unexpected EOF in read_timeout Command is: rsync -avzn ${LOCAL_DIR} ...
2
votes
1answer
38 views

Make links work in backup?

One file system of mine has many symlinks which link to directories in the file system. Is it possible to create a backup of the file system where the backups of the links work (i.e. still point to ...
0
votes
1answer
18 views

Rsync not overwriting files

I have 2 directories- etc and oldroot/etc I want all the files in etc to match exactly as oldroot/etc If there are any files in etc that are not in oldroot/etc, I want to preserve them as is I have ...
3
votes
4answers
3k views

Suppress server message in rsync

When I rsync or scp from a particular server I get a rather long message telling me the rules of the server. However when I setup regular pulls, I'd like to be able to suppress those messages in my ...
-3
votes
1answer
40 views

How to copy a sub directory of one directory to another?

How can I copy a directory structure named function under Dept2 directory into Dept3 directory in one shot?