rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

2
votes
1answer
311 views

Understanding why such a discrepancy in network transfer?

Summary: I can't understand a peculiar discrepancy in network transfer. Why is there such a discrepancy in syncing from one machine to the other and vice versa? Also: Given the maximum network ...
2
votes
1answer
16k views

force rsync to overwrite files at destination even if they're newer

I have an rsync backup script I run, which also restores files back where they came from when I ask. But if the files at the destination are newer than those in the backup when I try to restore, it ...
1
vote
1answer
54 views

rsync with weird files name appended

I'm doing rsync every 10 minutes via cronjob with a 3g Dongle outside on a field. The rsync will send data to my EC2 server and there I can check the files being sent. But I encounter the destination ...
-2
votes
1answer
30 views

An incremental or another full backup? [closed]

After using rsync to backup a file system, if there has been dramatic change in the file system since the last backup, is it still good to do an incremental backup? Is there a rule of thumb about how ...
4
votes
1answer
436 views

easy rsync solution with file manager (thunar or nautilus or…)

A common tasks I teach new users in UNIX is how to make backups. Since most are not comfortable with the command line (CLI) and I want to have them make backups (more than forcing them to use the ...
1
vote
2answers
48 views

Rsync “finds” files that are implicitly excluded

I have a semi-working rsynccommand that I have combined with the find command on a linux box to do a simple file transfer of a specific type and date. Here's the command: rsync -avx --timeout=30 ...
0
votes
1answer
60 views

rsync: delete some files in destination not in source but not delete others

Given two directories /.../src and /.../des, they share some subdirectories share1 and share2 des also has a subdirectory named des1 which doesn't exist in src. How can I perform file transfer ...
38
votes
8answers
40k views

Rsync filter: copying one pattern only

I am trying to create a directory that will house all and only my PDFs compiled from LaTeX. I like keeping each project in a separate folder, all housed in a big folder called LaTeX. So I tried ...
2
votes
2answers
89 views

Rsync: Verify size of incremental backup of a file

I need to test the incremental backup of a file using rsync i.e. whether rsync transfers entire file or just the changes made to it, when an incremental backup is fired. Just for a test, I've created ...
1
vote
2answers
206 views

How do I use my own local text editor to modify system (requires root to save) files on a remote system?

I've recently fallen in love with github's Atom text editor, and I enjoy using it for all my local coding and configuration. I started to maintain a Nagios installation for several dozen servers and ...
0
votes
1answer
58 views

Understand the big difference between real and usr+sys time used by rsync?

I started running rsync in three programs at the same time to transfer data between my external hard drive and my internal one. When they finished, I have their timing results: $ time rsync -a ...
1
vote
1answer
16 views

Both time `rsync` and get its exit value?

If I want to time the running of rsync by time rsync -a /media/t/1/ ./, after it finishes, does $? report the exit value for time not for rsync? How can I both time rsync and get its exit value?
1
vote
1answer
32 views

What is the proper bash method of prompting the user for administrative password before backing up the usb data to the computer?

mate-terminal --window-with-profile=PROFILENAME="Hold the terminal open" -e "sudo rsync -azvu --log-file=/var/log/simplebackup.log --append-verify --exclude '.gvfs' /media/user/usb/ ...
2
votes
3answers
1k views

Does compression option -z with rsync speed up backup

In rsync, -z will compress file data during the transfer. If I understand correctly, -z compress files before transfer and then decompress them after transfer. Does the time reduced during ...
1
vote
1answer
340 views

Why are there multiple rsync threads?

I use a single rsync program to backup a file system. by ps, I find there are four rsync threads or processes, two in R state (running) and two in S state (suspended?): $ ps aux | grep rsync root ...
2
votes
0answers
86 views

Estimate time or work left to finish for rsync?

When running rsync on a directory with lots of files and directories at multiple levels, can we estimate the amount of work or time to finish? the progress option only shows the progress of ...
0
votes
0answers
48 views

rsync unexpected EOF in read_timeout

I'm trying to rsync directories from server A to server B, but i get the following error: permission denied unexpected EOF in read_timeout Command is: rsync -avzn ${LOCAL_DIR} ...
2
votes
1answer
40 views

Make links work in backup?

One file system of mine has many symlinks which link to directories in the file system. Is it possible to create a backup of the file system where the backups of the links work (i.e. still point to ...
0
votes
1answer
19 views

Rsync not overwriting files

I have 2 directories- etc and oldroot/etc I want all the files in etc to match exactly as oldroot/etc If there are any files in etc that are not in oldroot/etc, I want to preserve them as is I have ...
-3
votes
1answer
48 views

How to copy a sub directory of one directory to another?

How can I copy a directory structure named function under Dept2 directory into Dept3 directory in one shot?
2
votes
1answer
49 views

Efficient way to download binary from server

I am using a remote machine to compile a project. When it finishes building, I use scp to copy the archive to a local machine. This worked fine till I was on broadband. Now I am using a 3G ...
0
votes
1answer
68 views

Snaphot for backup changing files with rsync?

With rsync, is it acceptable to modify some files in a file system, while backing up the file system? If yes, is it necessary to take a snapshot before backup, and do an incremental backup after ...
0
votes
0answers
57 views

Restore from incremental backup?

I read some books which use dump and restore. They said that during restore, first restore the latest full backup, and then restore each incremental backup created after the full backup. But I am ...
0
votes
1answer
93 views

rsync error during incremental backup [closed]

I am learning how to use rysnc (version 3.0.9, protocol version 30) to do backup on a toy example, from a dir /tmp/pdf to a backup dir /tmp/backup, following ...
0
votes
0answers
63 views

Rsync Issue (AWS EC2)

I have spent quite a bit of time trying to Rsync from a remote to a local machine but been having issues with finding the synced files apparently. The command I entered is: sync -avzhe ...
0
votes
1answer
888 views

Rsync error 23: some files were not transferred, when copying files from Windows drive to external HDD

I wanted to copy files from the Windows drive to external HDD using rsync, with the following command: rsync -azv --progress --exclude-from '/home/mint/exclude.txt' '/media/mint/OS/' ...
1
vote
1answer
336 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
0
votes
2answers
96 views

What is the difference between rdiff and librsync?

In my project, I have to keep some files synchronized between two computers. Both rdiff and librsync seem to do the same thing. Can anyone please point me to some differences so I can choose which ...
1
vote
1answer
30 views

Transfer file from remote computer without console

I need help to transfer file from remote Server A to server B (login to B with Terminal (putty)), but I also need to do that in background (so I can close terminal and move away). What have I tried is ...
2
votes
1answer
67 views

Unable to well understand Rsync with include and exclude patterns

First of all, I really read a lot about this topic (including Rsync filter: copying one pattern only), but I still don't understand, or I have a problem with my installation... My structure "from" is ...
9
votes
4answers
6k views

How do you compare two folders and copy the difference to a third folder?

You've got three folders: folder current, which contains your current files folder old, which contains an older version of the same files folder difference, which is just an empty folder How do ...
2
votes
0answers
405 views

“ls -lh” directories reported size : Linux vs CIFS mounted drives

From a Linux box, I recently mounted a Windows share using CIFS. The intent was to "locally" use rsync to backup my Windows machine. The command line used to mount the Windows drive is something ...
0
votes
1answer
43 views

Will rsync use delta coding even when I copy between local harddrives?

Is rsync using delta coding to reduce data transfer even when both of the directories I sync are on local harddrives (or just when copying over the network)?
3
votes
1answer
105 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...
1
vote
1answer
48 views

Prevent empty rsync email on cron

I have a crontab job to sync a folder: 50 5 * * * /home/user/bin/sync-folder This will execute an script: #!/bin/bash sudo rsync -rav --delete --log-file=/tmp/rsync-output /origin /destination ...
4
votes
3answers
906 views

How to rsync files between two remotes?

I would like to transfer files between two remote hosts using on local shell, but it seems rsync doesn't support synchronisation if two remotes are specified as follow: $ rsync -vuar host1:/var/www ...
3
votes
3answers
2k views

rsync list of files in sub-directories to remote server and delete extraneous

I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory. This is what I'm trying to accomplish: ...
1
vote
1answer
717 views

Unexplained rsync disconnect

I'm rsyncing in to a shared web host from a Yosemite client. I've set up my authorized keys and can ssh in just fine, and scp files over no problem. When I rsync with the -n (dry-run) option, it ...
1
vote
1answer
242 views

rysnc files and folders into a location without altering permissions

I'm using rsync to deploy some static HTML that is going to be served by nginx. The user that is running rysnc is "jenkins" nginx is using the www-data group to access the folder. jenkins is member ...
12
votes
3answers
20k views

Using rsync to move (not copy) files between directories?

I have been using rsync to copy files for some time. My understanding is that rsync is faster than cp when some of the files to transfer are already in the destination directory, transferring only the ...
0
votes
3answers
221 views

Smarter filetransfers than rsync? [closed]

I have a large file (2-3 GB, binary, undocumented format) that I use on two different computers (normally I use it on a desktop system but when I travel I put it on my laptop). I use rsync to transfer ...
1
vote
0answers
71 views

Using Rsync to SSH and Find files

Hello I am trying to use Rsync to SSH into a remote server and pull a certain type of file that has been modified within the last 24 hours. Here is what I am trying: rsync -avx --timeout=480 ...
1
vote
1answer
69 views

Using Rsync in conjunction with Find

I'm am attempting to write a script that will copy files created in the last 24 hours AND be of a specific file-type (*.png). The command I have tried is: rsync -avz --ignore-existing ...
1
vote
1answer
318 views

How to remember ssh password with lsyncd?

I' m using lsyncd to sync a folder between local and remote machines with default.rsyncssh config. But it asks for password every time file changes. I found there' s an option password_file, but ...
2
votes
2answers
142 views

How can I invoke a prompt for an ssh key passphrase during the execution of a script?

In my ssh_config file there are multiple entries for sites on the same server such as: Host site1 HostName 123.1.1.1 User myuser Port 13245 GSSAPIAuthentication no ...
1
vote
1answer
112 views

rsync initial sync

I'm new to rsync. I have a Linux machine with an external harddrive (ext3) and a Windows machine with an NTFS external harddrive. I connected the NTFS harddrive to the Linux machine and did a mirror ...
1
vote
1answer
2k views

Trying to create a cron to Rsync then tar the folder

I'm stuck at the first hurdle! I want to run a couple of commands from a bash script. First something like this to rsync some directories: rsync -e ssh -az user-whatever@website.com:/home ...
0
votes
0answers
41 views

Why is the “move” word necessary when using find + xargs + rsync in this example? [duplicate]

I often use this sort of command on my Mac to transfer files remotely: find . -iname '*.txt' -print0 \ | xargs -0 -J % rsync -aP % user@ip:/foo/bar I had to perform this on Linux. Since GNU ...
1
vote
1answer
174 views

rsync with cloudfuse

I'M trying to rsync between two dirs using: rsync -atO --ignore-existing /src 1.1.1.1:/target/ The target dir is mounted via cloudfuse and the source dir is a regular one. I get an error: rsync: ...
1
vote
0answers
52 views

What folders should I exclude / not exclude when migrating a server using rsync

I've got a requirement to migrate a web server onto a fresh server (both 32 bit and Fedora 15). I'm using this guide as I've very little experience with linux, coming from a windows background. So ...