rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

2
votes
1answer
38 views

Make links work in backup?

One file system of mine has many symlinks which link to directories in the file system. Is it possible to create a backup of the file system where the backups of the links work (i.e. still point to ...
0
votes
1answer
18 views

Rsync not overwriting files

I have 2 directories- etc and oldroot/etc I want all the files in etc to match exactly as oldroot/etc If there are any files in etc that are not in oldroot/etc, I want to preserve them as is I have ...
3
votes
4answers
3k views

Suppress server message in rsync

When I rsync or scp from a particular server I get a rather long message telling me the rules of the server. However when I setup regular pulls, I'd like to be able to suppress those messages in my ...
-3
votes
1answer
40 views

How to copy a sub directory of one directory to another?

How can I copy a directory structure named function under Dept2 directory into Dept3 directory in one shot?
2
votes
1answer
37 views

Efficient way to download binary from server

I am using a remote machine to compile a project. When it finishes building, I use scp to copy the archive to a local machine. This worked fine till I was on broadband. Now I am using a 3G ...
0
votes
1answer
58 views

Snaphot for backup changing files with rsync?

With rsync, is it acceptable to modify some files in a file system, while backing up the file system? If yes, is it necessary to take a snapshot before backup, and do an incremental backup after ...
0
votes
0answers
40 views

Restore from incremental backup?

I read some books which use dump and restore. They said that during restore, first restore the latest full backup, and then restore each incremental backup created after the full backup. But I am ...
0
votes
1answer
89 views

rsync error during incremental backup [on hold]

I am learning how to use rysnc (version 3.0.9, protocol version 30) to do backup on a toy example, from a dir /tmp/pdf to a backup dir /tmp/backup, following ...
0
votes
0answers
57 views

Rsync Issue (AWS EC2)

I have spent quite a bit of time trying to Rsync from a remote to a local machine but been having issues with finding the synced files apparently. The command I entered is: sync -avzhe ...
0
votes
1answer
599 views

Rsync error 23: some files were not transferred, when copying files from Windows drive to external HDD

I wanted to copy files from the Windows drive to external HDD using rsync, with the following command: rsync -azv --progress --exclude-from '/home/mint/exclude.txt' '/media/mint/OS/' ...
1
vote
1answer
272 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
0
votes
2answers
82 views

What is the difference between rdiff and librsync?

In my project, I have to keep some files synchronized between two computers. Both rdiff and librsync seem to do the same thing. Can anyone please point me to some differences so I can choose which ...
1
vote
1answer
29 views

Transfer file from remote computer without console

I need help to transfer file from remote Server A to server B (login to B with Terminal (putty)), but I also need to do that in background (so I can close terminal and move away). What have I tried is ...
2
votes
1answer
58 views

Unable to well understand Rsync with include and exclude patterns

First of all, I really read a lot about this topic (including Rsync filter: copying one pattern only), but I still don't understand, or I have a problem with my installation... My structure "from" is ...
9
votes
4answers
5k views

How do you compare two folders and copy the difference to a third folder?

You've got three folders: folder current, which contains your current files folder old, which contains an older version of the same files folder difference, which is just an empty folder How do ...
2
votes
0answers
386 views

“ls -lh” directories reported size : Linux vs CIFS mounted drives

From a Linux box, I recently mounted a Windows share using CIFS. The intent was to "locally" use rsync to backup my Windows machine. The command line used to mount the Windows drive is something ...
0
votes
1answer
39 views

Will rsync use delta coding even when I copy between local harddrives?

Is rsync using delta coding to reduce data transfer even when both of the directories I sync are on local harddrives (or just when copying over the network)?
3
votes
1answer
99 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...
1
vote
1answer
39 views

Prevent empty rsync email on cron

I have a crontab job to sync a folder: 50 5 * * * /home/user/bin/sync-folder This will execute an script: #!/bin/bash sudo rsync -rav --delete --log-file=/tmp/rsync-output /origin /destination ...
0
votes
1answer
483 views

lsyncd and additional parameters for rsync

Currently Im using lsyncd to monitor data and sync them (same machine) settings{ logfile = "/var/log/lsyncd/lsyncd.log", statusFile = "/var/log/lsyncd/lsyncd_status.log", ...
4
votes
3answers
632 views

How to rsync files between two remotes?

I would like to transfer files between two remote hosts using on local shell, but it seems rsync doesn't support synchronisation if two remotes are specified as follow: $ rsync -vuar host1:/var/www ...
3
votes
3answers
2k views

rsync list of files in sub-directories to remote server and delete extraneous

I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory. This is what I'm trying to accomplish: ...
1
vote
1answer
520 views

Unexplained rsync disconnect

I'm rsyncing in to a shared web host from a Yosemite client. I've set up my authorized keys and can ssh in just fine, and scp files over no problem. When I rsync with the -n (dry-run) option, it ...
1
vote
1answer
208 views

rysnc files and folders into a location without altering permissions

I'm using rsync to deploy some static HTML that is going to be served by nginx. The user that is running rysnc is "jenkins" nginx is using the www-data group to access the folder. jenkins is member ...
12
votes
4answers
19k views

Using rsync to move (not copy) files between directories?

I have been using rsync to copy files for some time. My understanding is that rsync is faster than cp when some of the files to transfer are already in the destination directory, transferring only the ...
0
votes
3answers
179 views

Smarter filetransfers than rsync? [closed]

I have a large file (2-3 GB, binary, undocumented format) that I use on two different computers (normally I use it on a desktop system but when I travel I put it on my laptop). I use rsync to transfer ...
1
vote
0answers
58 views

Using Rsync to SSH and Find files

Hello I am trying to use Rsync to SSH into a remote server and pull a certain type of file that has been modified within the last 24 hours. Here is what I am trying: rsync -avx --timeout=480 ...
1
vote
1answer
65 views

Using Rsync in conjunction with Find

I'm am attempting to write a script that will copy files created in the last 24 hours AND be of a specific file-type (*.png). The command I have tried is: rsync -avz --ignore-existing ...
1
vote
1answer
279 views

How to remember ssh password with lsyncd?

I' m using lsyncd to sync a folder between local and remote machines with default.rsyncssh config. But it asks for password every time file changes. I found there' s an option password_file, but ...
2
votes
2answers
110 views

How can I invoke a prompt for an ssh key passphrase during the execution of a script?

In my ssh_config file there are multiple entries for sites on the same server such as: Host site1 HostName 123.1.1.1 User myuser Port 13245 GSSAPIAuthentication no ...
1
vote
1answer
94 views

rsync initial sync

I'm new to rsync. I have a Linux machine with an external harddrive (ext3) and a Windows machine with an NTFS external harddrive. I connected the NTFS harddrive to the Linux machine and did a mirror ...
1
vote
1answer
2k views

Trying to create a cron to Rsync then tar the folder

I'm stuck at the first hurdle! I want to run a couple of commands from a bash script. First something like this to rsync some directories: rsync -e ssh -az user-whatever@website.com:/home ...
0
votes
0answers
41 views

Why is the “move” word necessary when using find + xargs + rsync in this example? [duplicate]

I often use this sort of command on my Mac to transfer files remotely: find . -iname '*.txt' -print0 \ | xargs -0 -J % rsync -aP % user@ip:/foo/bar I had to perform this on Linux. Since GNU ...
1
vote
1answer
131 views

rsync with cloudfuse

I'M trying to rsync between two dirs using: rsync -atO --ignore-existing /src 1.1.1.1:/target/ The target dir is mounted via cloudfuse and the source dir is a regular one. I get an error: rsync: ...
1
vote
0answers
48 views

What folders should I exclude / not exclude when migrating a server using rsync

I've got a requirement to migrate a web server onto a fresh server (both 32 bit and Fedora 15). I'm using this guide as I've very little experience with linux, coming from a windows background. So ...
2
votes
2answers
426 views

rsync to multiple remote servers

I have a file I want to sent to multiple separate servers. Is it possible to name multiple destinations? rsync foo.png server1:foo.png server2:foo.png This gives me a "Unexpected remote ...
5
votes
2answers
13k views

Move files and delete directories with rsync?

Recently I needed to delete a large number of files (over 1 million) and I read that doing: rsync -av --delete `mktemp -d`/ ~/source && rmdir ~/source Was one of the most optimized ways to ...
0
votes
0answers
203 views

rsync does not return on error

I am running a backup script from a udev rule. The script mounts and copies data to a newly connected USB drive, with help of rsync. # Mounting stuff MOUNTPOINT=/media/backup export ...
1
vote
1answer
533 views

rsync recursively with a certain depth of subfolders

I want to rsync a folder recursively but want subfolders included only to a certain depth. For example I would want a depth of 1,2,3 or 4 subfolders like this: source/ ├── subfolder 1 │   ├── ...
2
votes
3answers
51 views

How to rsync a directory to a new directory with different name?

I'm doing a data transfer, the old file system relies deeply on a directory which now is on different path. This is a git directory which stores code online. I have no rights to move it or rename it. ...
5
votes
2answers
3k views

How to examine the fast output of rsync

I am using rsync for backup about 100GB files and directories. My command is sudo rsync -azvv /home/path/folder1/ /home/path/folder2 However, the output for each file goes up so quickly and there ...
8
votes
2answers
13k views

rsync compare directories?

Is it possible to compare two directories with rsync and only print the differences? There's a dry-run option, but when I increase verbosity to a certain level, every file compared is shown. ls -alR ...
7
votes
3answers
14k views

Specify identity file (id_rsa) with rsync

I need to make periodic backups of a directory on a remote server which is a virtual machine hosted by a research organisation. They mandate that access to VMs is through ssh keys, which is all good, ...
2
votes
1answer
69 views

Should I increase inode count for a rsync backup volume?

Considering rsync used for incremental OS backup creates hardlink farms for all non-differing files, if I use it to backup a large, slowly-changing system regularly to a dedicated volume, I'm worried ...
0
votes
2answers
2k views

rsync with 'files from' in wildcards

[I had to change the example to make it clear that there are subdirectories.] Let's say I want to recreate a subset of my hierarchy. for arguments sake, let's say I want to backup files in ...
2
votes
1answer
74 views

Using rsync for incremental backup, what happens when original full backup is due for deletion?

I have started an incremental back up, on an external hard drive, of my Fedora 20 data etc using the scheme from here, which produces a full back up on day 1 followed by incremental backups using hard ...
0
votes
1answer
244 views

ZFS backup advice with another server

I currently have two servers both have the exact same hardware, disks, etc. One server (server1) is going to be the "main" server. It's basically a server with raidz2 that has SMB shares on it that ...
1
vote
0answers
31 views

Can I change the exclude file list while running rsync under a cron job

I am using Fedora 20, MATE desktop, zshell. I have started a cronjob to run, every evening, an incremental backup using rsync, closely following the suggestions here. After the first run yesterday, ...
1
vote
1answer
407 views

Rsync : overwrite log file

In rsync, --log-file creates a log file, however, if i do a daily backup, the log is appended to the previous log file. How can i force rsync to overwrite the log file instead of appending to it?
0
votes
2answers
272 views

What root directories should I back up? [duplicate]

I intend to start incremental backups of my Fedora 20 system, and would like to know what root directories I should include, and what directories it is useful to exclude. I know there is a lot of ...