rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
1answer
325 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
0
votes
2answers
95 views

What is the difference between rdiff and librsync?

In my project, I have to keep some files synchronized between two computers. Both rdiff and librsync seem to do the same thing. Can anyone please point me to some differences so I can choose which ...
1
vote
1answer
30 views

Transfer file from remote computer without console

I need help to transfer file from remote Server A to server B (login to B with Terminal (putty)), but I also need to do that in background (so I can close terminal and move away). What have I tried is ...
2
votes
1answer
66 views

Unable to well understand Rsync with include and exclude patterns

First of all, I really read a lot about this topic (including Rsync filter: copying one pattern only), but I still don't understand, or I have a problem with my installation... My structure "from" is ...
2
votes
0answers
402 views

“ls -lh” directories reported size : Linux vs CIFS mounted drives

From a Linux box, I recently mounted a Windows share using CIFS. The intent was to "locally" use rsync to backup my Windows machine. The command line used to mount the Windows drive is something ...
0
votes
1answer
42 views

Will rsync use delta coding even when I copy between local harddrives?

Is rsync using delta coding to reduce data transfer even when both of the directories I sync are on local harddrives (or just when copying over the network)?
1
vote
1answer
47 views

Prevent empty rsync email on cron

I have a crontab job to sync a folder: 50 5 * * * /home/user/bin/sync-folder This will execute an script: #!/bin/bash sudo rsync -rav --delete --log-file=/tmp/rsync-output /origin /destination ...
4
votes
3answers
860 views

How to rsync files between two remotes?

I would like to transfer files between two remote hosts using on local shell, but it seems rsync doesn't support synchronisation if two remotes are specified as follow: $ rsync -vuar host1:/var/www ...
1
vote
1answer
692 views

Unexplained rsync disconnect

I'm rsyncing in to a shared web host from a Yosemite client. I've set up my authorized keys and can ssh in just fine, and scp files over no problem. When I rsync with the -n (dry-run) option, it ...
1
vote
1answer
241 views

rysnc files and folders into a location without altering permissions

I'm using rsync to deploy some static HTML that is going to be served by nginx. The user that is running rysnc is "jenkins" nginx is using the www-data group to access the folder. jenkins is member ...
1
vote
0answers
71 views

Using Rsync to SSH and Find files

Hello I am trying to use Rsync to SSH into a remote server and pull a certain type of file that has been modified within the last 24 hours. Here is what I am trying: rsync -avx --timeout=480 ...
0
votes
3answers
211 views

Smarter filetransfers than rsync? [closed]

I have a large file (2-3 GB, binary, undocumented format) that I use on two different computers (normally I use it on a desktop system but when I travel I put it on my laptop). I use rsync to transfer ...
1
vote
1answer
69 views

Using Rsync in conjunction with Find

I'm am attempting to write a script that will copy files created in the last 24 hours AND be of a specific file-type (*.png). The command I have tried is: rsync -avz --ignore-existing ...
1
vote
1answer
315 views

How to remember ssh password with lsyncd?

I' m using lsyncd to sync a folder between local and remote machines with default.rsyncssh config. But it asks for password every time file changes. I found there' s an option password_file, but ...
2
votes
2answers
137 views

How can I invoke a prompt for an ssh key passphrase during the execution of a script?

In my ssh_config file there are multiple entries for sites on the same server such as: Host site1 HostName 123.1.1.1 User myuser Port 13245 GSSAPIAuthentication no ...
1
vote
1answer
110 views

rsync initial sync

I'm new to rsync. I have a Linux machine with an external harddrive (ext3) and a Windows machine with an NTFS external harddrive. I connected the NTFS harddrive to the Linux machine and did a mirror ...
0
votes
0answers
41 views

Why is the “move” word necessary when using find + xargs + rsync in this example? [duplicate]

I often use this sort of command on my Mac to transfer files remotely: find . -iname '*.txt' -print0 \ | xargs -0 -J % rsync -aP % user@ip:/foo/bar I had to perform this on Linux. Since GNU ...
1
vote
1answer
164 views

rsync with cloudfuse

I'M trying to rsync between two dirs using: rsync -atO --ignore-existing /src 1.1.1.1:/target/ The target dir is mounted via cloudfuse and the source dir is a regular one. I get an error: rsync: ...
1
vote
0answers
52 views

What folders should I exclude / not exclude when migrating a server using rsync

I've got a requirement to migrate a web server onto a fresh server (both 32 bit and Fedora 15). I'm using this guide as I've very little experience with linux, coming from a windows background. So ...
1
vote
1answer
642 views

rsync recursively with a certain depth of subfolders

I want to rsync a folder recursively but want subfolders included only to a certain depth. For example I would want a depth of 1,2,3 or 4 subfolders like this: source/ ├── subfolder 1 │   ├── ...
0
votes
0answers
223 views

rsync does not return on error

I am running a backup script from a udev rule. The script mounts and copies data to a newly connected USB drive, with help of rsync. # Mounting stuff MOUNTPOINT=/media/backup export ...
2
votes
3answers
57 views

How to rsync a directory to a new directory with different name?

I'm doing a data transfer, the old file system relies deeply on a directory which now is on different path. This is a git directory which stores code online. I have no rights to move it or rename it. ...
3
votes
1answer
254 views

rsync's --link-dest option does not link because of file time

Consider this test case: mkdir a echo 'blah' > a/test mkdir b echo 'blah' > b/test rsync -r --link-dest=/tmp/b /tmp/a/ /tmp/c As expected, rsync creates c/test a hardlink of b/test (note the ...
2
votes
1answer
71 views

Should I increase inode count for a rsync backup volume?

Considering rsync used for incremental OS backup creates hardlink farms for all non-differing files, if I use it to backup a large, slowly-changing system regularly to a dedicated volume, I'm worried ...
0
votes
2answers
2k views

rsync with 'files from' in wildcards

[I had to change the example to make it clear that there are subdirectories.] Let's say I want to recreate a subset of my hierarchy. for arguments sake, let's say I want to backup files in ...
2
votes
1answer
86 views

Using rsync for incremental backup, what happens when original full backup is due for deletion?

I have started an incremental back up, on an external hard drive, of my Fedora 20 data etc using the scheme from here, which produces a full back up on day 1 followed by incremental backups using hard ...
1
vote
0answers
34 views

Can I change the exclude file list while running rsync under a cron job

I am using Fedora 20, MATE desktop, zshell. I have started a cronjob to run, every evening, an incremental backup using rsync, closely following the suggestions here. After the first run yesterday, ...
0
votes
1answer
279 views

ZFS backup advice with another server

I currently have two servers both have the exact same hardware, disks, etc. One server (server1) is going to be the "main" server. It's basically a server with raidz2 that has SMB shares on it that ...
2
votes
2answers
522 views

rsync to multiple remote servers

I have a file I want to sent to multiple separate servers. Is it possible to name multiple destinations? rsync foo.png server1:foo.png server2:foo.png This gives me a "Unexpected remote ...
1
vote
1answer
471 views

Rsync : overwrite log file

In rsync, --log-file creates a log file, however, if i do a daily backup, the log is appended to the previous log file. How can i force rsync to overwrite the log file instead of appending to it?
0
votes
2answers
292 views

What root directories should I back up? [duplicate]

I intend to start incremental backups of my Fedora 20 system, and would like to know what root directories I should include, and what directories it is useful to exclude. I know there is a lot of ...
6
votes
2answers
315 views

rsync hangs unless I defrag ext4 filesystem

I have a XBian server (Raspberry Pi version of Debian) running rsync via inetd (not the native dæmon). I am serving a couple of directories on an ext4 filesystem (on a USB disk) as individual modules ...
2
votes
1answer
75 views

Exclude directories with 'rsync' and ssh with pull request

I am trying to pull from a remote server and exclude a directory on the remote server. For some reason it keeps pulling that directory I have excluded. Here is the command I am running: rsync -azP ...
0
votes
1answer
79 views

Backing up Linux server to Windows domain

I'm maintaining a small Linux workstation/server in a Windows-domain-based environment. Apart from being in the same network, the Linux computer is not connected to the domain. Until now, I'm using a ...
2
votes
3answers
1k views

rsync a list of directories with absolute path in text file

I have a text file containing a list of directories with its absolute path $ cat DirectoriesToCopy.txt /data/Dir1 /data/Dir2 I want to use rsync to copy all these directories preserving its ...
1
vote
1answer
82 views

rsync: mix exclude and include filters

The following pattern copies the .pdf files from source to destination, working fine. rsync -rv --include="*.pdf" --include="*/" --exclude="*" --prune-empty-dirs /source/ ~/destination/ but I want ...
0
votes
1answer
267 views

Backup to flash drive using rsync

I've decided to make a full backup from my SSD disk to flash drive. According to archwiki general backup is done with following command: rsync -aAXv ...
1
vote
0answers
47 views

rsync daemon max connections unlimited

I'm creating a gui app to upload files to a particular place on a server. the user is able to drop files and these files are 'moved' to the server, if the file already exists, then it is only updated ...
2
votes
1answer
65 views

Repetition of password while rsync-ing files?

I'm using a script to download files in two steps: First, I'm downloading a file containing a list of files from a server to my host machine using rsync. Then, I'm using rsync to download the ...
2
votes
0answers
50 views

How to output rsync sent data in realtime using standard tools

I'm developing a small tool for some people who need to send files over to a server. I'd like to use rsync to a rsync deamon to do so. Is it possible to have rsync to output how much data it has ...
2
votes
1answer
127 views

rsync exclude-from directory with space

I am trying to exclude "Mendeley Desktop" directory for rsync. The exclude-from= is as: Downloads *.o *.iso Dropbox Documents/Mendeley\ Desktop but rsync is still backing up the Mendeley Desktop. ...
0
votes
0answers
63 views

rsync --delete doesn't delete all files

This is the script I have so far rsync -avz -e ssh --delete /tftp/ username@192.168.1.51:/tftp/ I want it to completely copy every directory/file in /tftp/ and overwrite everything in the ...
2
votes
1answer
83 views

How to interpret rsync console output?

I use the following rsync command to backup my files: rsync -avHc Pictures /backup/ Isn't -v supposed to only display files and directories that were transferred? If I change a file and run the ...
3
votes
1answer
527 views

Rsync folder while --exclude-from'ing .gitignore files at different depths

So I'm trying to work on a command to rsync a source folder with a structure like so: - app.js - .gitignore - src/ - src/logs/ - src/logs/.gitignore The first .gitignore would have a series of ...
1
vote
1answer
243 views

RYSNC over SSH not working for restricted shell

I need to give access to some Mr X in my production server so that he can push files to my server. Since there is no necessity to give him shell access , I decided to use restricted shell (rssh) so ...
0
votes
1answer
64 views

rsync rules to only sync specific sub-dirs in long paths

I'm trying to perform complex rsync include/excludes to backup only the following within the /home/x dir: Recursively all files/dirs in Documents Recursively all files/dirs in ...
1
vote
1answer
26 views

Automatically pauseing rsync if target is full

I need to transfer 80gb's of unsorted text documents from one computer to another and all I have is a 32gb USB. Is there an option to make rsync automatically pause when the USB is full without losing ...
1
vote
0answers
26 views

rsync copy only files facade [duplicate]

Is there a way to mirror a directory structure and files there contained with rsync, giving out facade zero length files? I mean, mirroring dirs (-d flag I think) exactly as they are, while not ...
1
vote
1answer
177 views

I can't get rsync --exclude-from to work with a file

Here's the command : rsync -avAX --exclude-from=/home/vco/bin/wip-files-learning/backup_tests/rsyncexclude.txt ./some_tests/ ./back_to_me/ Here's the contents of the exclude file : ...
1
vote
5answers
379 views

Interactive ssh works, but not rsync or scp, on OSX

The motivation is that there's a server that I can ssh into (with or without key pairs set up ... i.e., without or with a password) but that I cannot send files to via rsync, scp, or sftp. Someone ...