rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
0answers
57 views

Absolute path in rsync dry-run statistics

I have executed following command in order to get the list of files that would be transferred to remote server if rsync is executed: rsync -avzm --stats --safe-links --ignore-existing --dry-run ...
1
vote
1answer
67 views

Rsync Excludes Folders

I am running a rsync script and I want to exclude certain folders. I know with rsync you have to create a .txt file and add all the excludes in there but I am wondering is it possible to just have a ...
0
votes
0answers
13 views

sync source A into destination B

I want to create a perfect copy of A in B. I'm using this command, but is working good only on same existing folders rsync -h --progress --stats -r -tgo -p -l -D --delete /A /B if folder x exists ...
4
votes
4answers
2k views

Is setting a higher nice level for a process an effective way to reduce its impact on system load/CPU time?

I have an rsync cron job which is pushing the server load and triggering monitor alerts. If I set the job to be run with a high nice level, would that effectively reduce the impact it has on system ...
0
votes
1answer
70 views

rsync excluding empty files

I recently discovered that a few files on a volume had been mysteriously truncated - or more accurately, replaced with a zero length file. Fortunately, these files were hard-linked from multiple ...
3
votes
1answer
280 views

rsync's --link-dest option does not link because of file time

Consider this test case: mkdir a echo 'blah' > a/test mkdir b echo 'blah' > b/test rsync -r --link-dest=/tmp/b /tmp/a/ /tmp/c As expected, rsync creates c/test a hardlink of b/test (note the ...
0
votes
2answers
82 views

Rsyncing files from server to local machine automatically

I currently have a crontab job running on my machine every friday at 3 AM as a back up method. The job runs a bash script which runs an rsync command to sync files from the server to my external hard ...
1
vote
1answer
49 views

How can I do an rsync that asks for a confirmation for each individual file?

I have a small number of files to sync from one server to another, however there are some files I want to exclude from being synced. I'd rather not have to add them to a --exclude pattern if I can ...
1
vote
0answers
159 views

How rsync --compare-dest works

I know there's a very similar question here, but the accepted answer has nothing to do with rsync, and the OP's solution doesn't apply in my case. I'm trying to get all the updates from a CentOS ...
1
vote
1answer
85 views

How to keep a redundant home directory for offline use?

Scenario: My home dir is on NFS, identities are in LDAP and authorization is via Kerberos. My NFS, LDAP and Kerberos servers are all VMs -- I'm stretching a little hardware a long way at home. Life ...
5
votes
2answers
113 views

rsync doesn't preserve directory ownership even with -a

I use this rsync invocation to backup my home directory: rsync -aARrx --info= --force --delete --info=progress2 -F "$USER_HOME" "$BACKUP_MNTPOINT" rsync man page says that -a implies -g and -o ...
30
votes
3answers
19k views

Does rsync verify files copied between two local drives?

I want to make a fresh new copy of a large number of files from one local drive to another. I've read that rsync does a checksum comparison of files when sending them to a remote machine over a ...
0
votes
0answers
39 views

rsync question about a directory

I went ahead and used rsync to back up a root directory called /files my exact commands werersync -avzh /files willc66@server.com:/backup, inside my /files directory I had 2 sub directories home and ...
14
votes
1answer
651 views

What happens when you rsync without a destination?

To make the story short, I did an rsync: rsync -avP root@exampleserver.com:/tmp/ And I forgot to put in my source directory... I really meant to run: rsync -avP /tmp/ root@exampleserver.com:/tmp/ ...
10
votes
4answers
34k views

rsync without prompt for password

I need to execute rsync, without it prompting me for password. I've seen in rsync manpage that it doesn't allow specifying the password as command line argument. But I noticed that it allows ...
1
vote
0answers
198 views

Samba File Server Configuration and Sync for Redundancy

I have two boxes which I installed Samba on. For now, I have a single user that access the server, however, I need to expand as to deploy in a production network. Below is what I want to achieve. ...
2
votes
1answer
339 views

Understanding why such a discrepancy in network transfer?

Summary: I can't understand a peculiar discrepancy in network transfer. Why is there such a discrepancy in syncing from one machine to the other and vice versa? Also: Given the maximum network ...
2
votes
1answer
17k views

force rsync to overwrite files at destination even if they're newer

I have an rsync backup script I run, which also restores files back where they came from when I ask. But if the files at the destination are newer than those in the backup when I try to restore, it ...
1
vote
1answer
60 views

rsync with weird files name appended

I'm doing rsync every 10 minutes via cronjob with a 3g Dongle outside on a field. The rsync will send data to my EC2 server and there I can check the files being sent. But I encounter the destination ...
-2
votes
1answer
31 views

An incremental or another full backup? [closed]

After using rsync to backup a file system, if there has been dramatic change in the file system since the last backup, is it still good to do an incremental backup? Is there a rule of thumb about how ...
4
votes
1answer
447 views

easy rsync solution with file manager (thunar or nautilus or…)

A common tasks I teach new users in UNIX is how to make backups. Since most are not comfortable with the command line (CLI) and I want to have them make backups (more than forcing them to use the ...
1
vote
2answers
50 views

Rsync “finds” files that are implicitly excluded

I have a semi-working rsynccommand that I have combined with the find command on a linux box to do a simple file transfer of a specific type and date. Here's the command: rsync -avx --timeout=30 ...
0
votes
1answer
69 views

rsync: delete some files in destination not in source but not delete others

Given two directories /.../src and /.../des, they share some subdirectories share1 and share2 des also has a subdirectory named des1 which doesn't exist in src. How can I perform file transfer ...
39
votes
8answers
41k views

Rsync filter: copying one pattern only

I am trying to create a directory that will house all and only my PDFs compiled from LaTeX. I like keeping each project in a separate folder, all housed in a big folder called LaTeX. So I tried ...
2
votes
2answers
101 views

Rsync: Verify size of incremental backup of a file

I need to test the incremental backup of a file using rsync i.e. whether rsync transfers entire file or just the changes made to it, when an incremental backup is fired. Just for a test, I've created ...
1
vote
2answers
275 views

How do I use my own local text editor to modify system (requires root to save) files on a remote system?

I've recently fallen in love with github's Atom text editor, and I enjoy using it for all my local coding and configuration. I started to maintain a Nagios installation for several dozen servers and ...
0
votes
1answer
65 views

Understand the big difference between real and usr+sys time used by rsync?

I started running rsync in three programs at the same time to transfer data between my external hard drive and my internal one. When they finished, I have their timing results: $ time rsync -a ...
1
vote
1answer
16 views

Both time `rsync` and get its exit value?

If I want to time the running of rsync by time rsync -a /media/t/1/ ./, after it finishes, does $? report the exit value for time not for rsync? How can I both time rsync and get its exit value?
1
vote
1answer
32 views

What is the proper bash method of prompting the user for administrative password before backing up the usb data to the computer?

mate-terminal --window-with-profile=PROFILENAME="Hold the terminal open" -e "sudo rsync -azvu --log-file=/var/log/simplebackup.log --append-verify --exclude '.gvfs' /media/user/usb/ ...
2
votes
3answers
2k views

Does compression option -z with rsync speed up backup

In rsync, -z will compress file data during the transfer. If I understand correctly, -z compress files before transfer and then decompress them after transfer. Does the time reduced during ...
1
vote
1answer
409 views

Why are there multiple rsync threads?

I use a single rsync program to backup a file system. by ps, I find there are four rsync threads or processes, two in R state (running) and two in S state (suspended?): $ ps aux | grep rsync root ...
2
votes
0answers
102 views

Estimate time or work left to finish for rsync?

When running rsync on a directory with lots of files and directories at multiple levels, can we estimate the amount of work or time to finish? the progress option only shows the progress of ...
0
votes
0answers
59 views

rsync unexpected EOF in read_timeout

I'm trying to rsync directories from server A to server B, but i get the following error: permission denied unexpected EOF in read_timeout Command is: rsync -avzn ${LOCAL_DIR} ...
2
votes
1answer
41 views

Make links work in backup?

One file system of mine has many symlinks which link to directories in the file system. Is it possible to create a backup of the file system where the backups of the links work (i.e. still point to ...
0
votes
1answer
20 views

Rsync not overwriting files

I have 2 directories- etc and oldroot/etc I want all the files in etc to match exactly as oldroot/etc If there are any files in etc that are not in oldroot/etc, I want to preserve them as is I have ...
-3
votes
1answer
56 views

How to copy a sub directory of one directory to another?

How can I copy a directory structure named function under Dept2 directory into Dept3 directory in one shot?
2
votes
1answer
68 views

Efficient way to download binary from server

I am using a remote machine to compile a project. When it finishes building, I use scp to copy the archive to a local machine. This worked fine till I was on broadband. Now I am using a 3G ...
0
votes
1answer
75 views

Snaphot for backup changing files with rsync?

With rsync, is it acceptable to modify some files in a file system, while backing up the file system? If yes, is it necessary to take a snapshot before backup, and do an incremental backup after ...
0
votes
0answers
67 views

Restore from incremental backup?

I read some books which use dump and restore. They said that during restore, first restore the latest full backup, and then restore each incremental backup created after the full backup. But I am ...
0
votes
1answer
96 views

rsync error during incremental backup [closed]

I am learning how to use rysnc (version 3.0.9, protocol version 30) to do backup on a toy example, from a dir /tmp/pdf to a backup dir /tmp/backup, following ...
0
votes
0answers
69 views

Rsync Issue (AWS EC2)

I have spent quite a bit of time trying to Rsync from a remote to a local machine but been having issues with finding the synced files apparently. The command I entered is: sync -avzhe ...
0
votes
1answer
1k views

Rsync error 23: some files were not transferred, when copying files from Windows drive to external HDD

I wanted to copy files from the Windows drive to external HDD using rsync, with the following command: rsync -azv --progress --exclude-from '/home/mint/exclude.txt' '/media/mint/OS/' ...
1
vote
1answer
380 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
0
votes
2answers
111 views

What is the difference between rdiff and librsync?

In my project, I have to keep some files synchronized between two computers. Both rdiff and librsync seem to do the same thing. Can anyone please point me to some differences so I can choose which ...
1
vote
1answer
32 views

Transfer file from remote computer without console

I need help to transfer file from remote Server A to server B (login to B with Terminal (putty)), but I also need to do that in background (so I can close terminal and move away). What have I tried is ...
2
votes
1answer
69 views

Unable to well understand Rsync with include and exclude patterns

First of all, I really read a lot about this topic (including Rsync filter: copying one pattern only), but I still don't understand, or I have a problem with my installation... My structure "from" is ...
9
votes
4answers
6k views

How do you compare two folders and copy the difference to a third folder?

You've got three folders: folder current, which contains your current files folder old, which contains an older version of the same files folder difference, which is just an empty folder How do ...
2
votes
0answers
412 views

“ls -lh” directories reported size : Linux vs CIFS mounted drives

From a Linux box, I recently mounted a Windows share using CIFS. The intent was to "locally" use rsync to backup my Windows machine. The command line used to mount the Windows drive is something ...
0
votes
1answer
45 views

Will rsync use delta coding even when I copy between local harddrives?

Is rsync using delta coding to reduce data transfer even when both of the directories I sync are on local harddrives (or just when copying over the network)?
3
votes
1answer
108 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...