rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
0answers
23 views

rsync's --link-dest option does not link identical files if an old file exists

One might think that --link-dest'ing to an identical file would work in all cases. But it does not when the file exists, even if the file is out of date/has different contents. It is because of this, ...
2
votes
1answer
100 views

rsync's --link-dest option does not link because of file time

Consider this test case: mkdir a echo 'blah' > a/test mkdir b echo 'blah' > b/test rsync -r --link-dest=/tmp/b /tmp/a/ /tmp/c As expected, rsync creates c/test a hardlink of b/test (note the ...
0
votes
2answers
24 views

Rsyncing files from server to local machine automatically

I currently have a crontab job running on my machine every friday at 3 AM as a back up method. The job runs a bash script which runs an rsync command to sync files from the server to my external hard ...
1
vote
1answer
13 views

How can I do an rsync that asks for a confirmation for each individual file?

I have a small number of files to sync from one server to another, however there are some files I want to exclude from being synced. I'd rather not have to add them to a --exclude pattern if I can ...
1
vote
0answers
28 views

How rsync --compare-dest works

I know there's a very similar question here, but the accepted answer has nothing to do with rsync, and the OP's solution doesn't apply in my case. I'm trying to get all the updates from a CentOS ...
1
vote
1answer
33 views

How to keep a redundant home directory for offline use?

Scenario: My home dir is on NFS, identities are in LDAP and authorization is via Kerberos. My NFS, LDAP and Kerberos servers are all VMs -- I'm stretching a little hardware a long way at home. Life ...
1
vote
0answers
37 views

Bash script to get the result from rsync transfer and zip it as a directory in the original directory

OK, I guess this is weird. I have a small stage.sh script very simply has a bunch of commands: if [ "$(whoami)" == 'David' ]; then rsync -a --delete-excluded --exclude-from=.stage_rsync_rules ...
5
votes
2answers
67 views

rsync doesn't preserve directory ownership even with -a

I use this rsync invocation to backup my home directory: rsync -aARrx --info= --force --delete --info=progress2 -F "$USER_HOME" "$BACKUP_MNTPOINT" rsync man page says that -a implies -g and -o ...
25
votes
3answers
15k views

Does rsync verify files copied between two local drives?

I want to make a fresh new copy of a large number of files from one local drive to another. I've read that rsync does a checksum comparison of files when sending them to a remote machine over a ...
0
votes
0answers
33 views

rsync question about a directory

I went ahead and used rsync to back up a root directory called /files my exact commands werersync -avzh /files willc66@server.com:/backup, inside my /files directory I had 2 sub directories home and ...
2
votes
1answer
512 views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
13
votes
1answer
486 views

What happens when you rsync without a destination?

To make the story short, I did an rsync: rsync -avP root@exampleserver.com:/tmp/ And I forgot to put in my source directory... I really meant to run: rsync -avP /tmp/ root@exampleserver.com:/tmp/ ...
8
votes
4answers
21k views

rsync without prompt for password

I need to execute rsync, without it prompting me for password. I've seen in rsync manpage that it doesn't allow specifying the password as command line argument. But I noticed that it allows ...
1
vote
0answers
18 views

Samba File Server Configuration and Sync for Redundancy

I have two boxes which I installed Samba on. For now, I have a single user that access the server, however, I need to expand as to deploy in a production network. Below is what I want to achieve. ...
2
votes
1answer
79 views

Understanding why such a discrepancy in network transfer?

Summary: I can't understand a peculiar discrepancy in network transfer. Why is there such a discrepancy in syncing from one machine to the other and vice versa? Also: Given the maximum network ...
2
votes
1answer
12k views

force rsync to overwrite files at destination even if they're newer

I have an rsync backup script I run, which also restores files back where they came from when I ask. But if the files at the destination are newer than those in the backup when I try to restore, it ...
1
vote
1answer
31 views

rsync with weird files name appended

I'm doing rsync every 10 minutes via cronjob with a 3g Dongle outside on a field. The rsync will send data to my EC2 server and there I can check the files being sent. But I encounter the destination ...
0
votes
2answers
378 views

Rsync connection reset by peer

rsync --protocol=29 -rav -e ssh --include '*/' --include='*_en*.xml.gz' --exclude='*' user@server:/path/ Content is downloading from remote server but after while I get this error: Write failed: ...
-2
votes
1answer
21 views

An incremental or another full backup? [closed]

After using rsync to backup a file system, if there has been dramatic change in the file system since the last backup, is it still good to do an incremental backup? Is there a rule of thumb about how ...
0
votes
1answer
38 views

Parallelise rsync using GNU Parallel

I have been using a rsync script to synchronize data at one host with the data at another host. The data has numerous small-sized files that contribute to almost 1.2TB. In order to sync those files, ...
4
votes
1answer
342 views

easy rsync solution with file manager (thunar or nautilus or…)

A common tasks I teach new users in UNIX is how to make backups. Since most are not comfortable with the command line (CLI) and I want to have them make backups (more than forcing them to use the ...
1
vote
2answers
26 views

Rsync “finds” files that are implicitly excluded

I have a semi-working rsynccommand that I have combined with the find command on a linux box to do a simple file transfer of a specific type and date. Here's the command: rsync -avx --timeout=30 ...
0
votes
1answer
26 views

rsync: delete some files in destination not in source but not delete others

Given two directories /.../src and /.../des, they share some subdirectories share1 and share2 des also has a subdirectory named des1 which doesn't exist in src. How can I perform file transfer ...
35
votes
8answers
33k views

Rsync filter: copying one pattern only

I am trying to create a directory that will house all and only my PDFs compiled from LaTeX. I like keeping each project in a separate folder, all housed in a big folder called LaTeX. So I tried ...
2
votes
2answers
38 views

Rsync: Verify size of incremental backup of a file

I need to test the incremental backup of a file using rsync i.e. whether rsync transfers entire file or just the changes made to it, when an incremental backup is fired. Just for a test, I've created ...
1
vote
2answers
50 views

How do I use my own local text editor to modify system (requires root to save) files on a remote system?

I've recently fallen in love with github's Atom text editor, and I enjoy using it for all my local coding and configuration. I started to maintain a Nagios installation for several dozen servers and ...
0
votes
1answer
29 views

Understand the big difference between real and usr+sys time used by rsync?

I started running rsync in three programs at the same time to transfer data between my external hard drive and my internal one. When they finished, I have their timing results: $ time rsync -a ...
1
vote
1answer
14 views

Both time `rsync` and get its exit value?

If I want to time the running of rsync by time rsync -a /media/t/1/ ./, after it finishes, does $? report the exit value for time not for rsync? How can I both time rsync and get its exit value?
2
votes
1answer
31 views

Using inotifywait along with vim

I have simple script that monitors file for changes and rsyncs it with remote copy: #!/bin/bash while inotifywait -e close_write somefile do rsync somefile user@host.domain:./somefile done It ...
1
vote
1answer
26 views

What is the proper bash method of prompting the user for administrative password before backing up the usb data to the computer?

mate-terminal --window-with-profile=PROFILENAME="Hold the terminal open" -e "sudo rsync -azvu --log-file=/var/log/simplebackup.log --append-verify --exclude '.gvfs' /media/user/usb/ ...
2
votes
3answers
84 views

Does compression option -z with rsync speed up backup

In rsync, -z will compress file data during the transfer. If I understand correctly, -z compress files before transfer and then decompress them after transfer. Does the time reduced during ...
1
vote
1answer
34 views

Why are there multiple rsync threads?

I use a single rsync program to backup a file system. by ps, I find there are four rsync threads or processes, two in R state (running) and two in S state (suspended?): $ ps aux | grep rsync root ...
1
vote
0answers
32 views

Estimate time or work left to finish for rsync?

When running rsync on a directory with lots of files and directories at multiple levels, can we estimate the amount of work or time to finish? the progress option only shows the progress of ...
0
votes
0answers
25 views

rsync unexpected EOF in read_timeout

I'm trying to rsync directories from server A to server B, but i get the following error: permission denied unexpected EOF in read_timeout Command is: rsync -avzn ${LOCAL_DIR} ...
2
votes
1answer
32 views

Make links work in backup?

One file system of mine has many symlinks which link to directories in the file system. Is it possible to create a backup of the file system where the backups of the links work (i.e. still point to ...
0
votes
1answer
13 views

Rsync not overwriting files

I have 2 directories- etc and oldroot/etc I want all the files in etc to match exactly as oldroot/etc If there are any files in etc that are not in oldroot/etc, I want to preserve them as is I have ...
2
votes
4answers
2k views

Suppress server message in rsync

When I rsync or scp from a particular server I get a rather long message telling me the rules of the server. However when I setup regular pulls, I'd like to be able to suppress those messages in my ...
-3
votes
1answer
22 views

How to copy a sub directory of one directory to another?

How can I copy a directory structure named function under Dept2 directory into Dept3 directory in one shot?
0
votes
2answers
482 views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
2
votes
1answer
15 views

Efficient way to download binary from server

I am using a remote machine to compile a project. When it finishes building, I use scp to copy the archive to a local machine. This worked fine till I was on broadband. Now I am using a 3G ...
0
votes
1answer
23 views

Snaphot for backup changing files with rsync?

With rsync, is it acceptable to modify some files in a file system, while backing up the file system? If yes, is it necessary to take a snapshot before backup, and do an incremental backup after ...
0
votes
0answers
23 views

Restore from incremental backup?

I read some books which use dump and restore. They said that during restore, first restore the latest full backup, and then restore each incremental backup created after the full backup. But I am ...
0
votes
1answer
62 views

rsync error during incremental backup

I am learning how to use rysnc (version 3.0.9, protocol version 30) to do backup on a toy example, from a dir /tmp/pdf to a backup dir /tmp/backup, following ...
0
votes
0answers
26 views

Rsync Issue (AWS EC2)

I have spent quite a bit of time trying to Rsync from a remote to a local machine but been having issues with finding the synced files apparently. The command I entered is: sync -avzhe ...
1
vote
2answers
49 views

rsync --backup-dir creates empty folders in backup dir

I have a folder structure like this: . ├── bkp ├── dst └── src └── folder └── file I run the following command: rsync -t -r -b --backup-dir /tmp/rsyncTest/bkp/ /tmp/rsyncTest/src/ ...
0
votes
1answer
41 views

Rsync error 23: some files were not transferred, when copying files from Windows drive to external HDD

I wanted to copy files from the Windows drive to external HDD using rsync, with the following command: rsync -azv --progress --exclude-from '/home/mint/exclude.txt' '/media/mint/OS/' ...
1
vote
1answer
54 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
0
votes
2answers
34 views

What is the difference between rdiff and librsync?

In my project, I have to keep some files synchronized between two computers. Both rdiff and librsync seem to do the same thing. Can anyone please point me to some differences so I can choose which ...
1
vote
1answer
27 views

Transfer file from remote computer without console

I need help to transfer file from remote Server A to server B (login to B with Terminal (putty)), but I also need to do that in background (so I can close terminal and move away). What have I tried is ...
2
votes
1answer
42 views

Unable to well understand Rsync with include and exclude patterns

First of all, I really read a lot about this topic (including Rsync filter: copying one pattern only), but I still don't understand, or I have a problem with my installation... My structure "from" is ...