rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

0
votes
2answers
17 views

Executable file isn't “really there” after rsync [duplicate]

I am issuing the following rsync command (obfuscating the exact path & host), which should copy two binaries: rsync -e "ssh -p 443" -a --info=progress2 -z user@remote:/srv/cgi-bin/ . ...
3
votes
2answers
5k views

suppress rsync warning: some files vanished before they could be transferred

I get loads of warnings when backing up my running Postfix and Courier server files like: file has vanished: /var/kunden/mail/username/name@mymail.de/tmp/courier.lock How do I suppress those ...
3
votes
2answers
935 views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
0
votes
1answer
20 views

Comparing 2 directories and copying the different sub-directories to a 3rd directory

I have 2 directories DIR1 and DIR2 DIR1 is base directory, where new changes come often, sometimes new sub-directories as well. DIR2 has older version of files. I want to compare these 2 ...
7
votes
1answer
763 views

Understanding the output of --info=progress2 from rsync

If I run rsync with --info=progress2, I get an output like 105.45M 13% 602.83kB/s 0:02:50 (xfr#495, ir-chk=1020/3825) But what do the single numbers mean? I haven't found a matching entry ...
0
votes
3answers
29 views

Backup script fails with the rsync command's options in a quoted variable

Using: rsync version 3.1.0 protocol version 31; Linux Mint 17 (based on: Ubuntu 14.04.3) In one of my backup Bash scripts, which uses rsync, I put the rsync options in a variable like this: # Set ...
4
votes
1answer
34 views

Reuse rsync --dry-run output

I usually do rsync -n before doing an actual rsync. The thing is, how could I automate the second run to reuse exactly the list generated with --dry-run? I mean, if I run rsync -n then I get a ...
1
vote
1answer
30 views

Comparing original & backup folder, then deleting non-existing files

I'm using Raspbian jessie (ubuntu). I made a .sh that makes a backup .img of everything (excluding mnt, tmp, run, dev, boot, etc.) and let this run once a week with crontab. It checks for modified ...
29
votes
6answers
33k views

rsync all files of remote machine over SSH without root user?

I have this command to backup a remote machine. The problem is that I need root rights to read and copy all files. I have no root user enabled for security reasons and use sudo the Ubuntu way. Would I ...
2
votes
1answer
72 views

RSYNC periodically fails via SSH, broken pipe

A post-commit script calls a rsync command to update files from the SVN system to a production web server, both running Ubuntu 10.04.3, rsync 3.1.1. The issue had been occuring with rsync 3.0.7 as ...
3
votes
1answer
37 views

How do I mount an external SD card without using sudo?

I wrote a bash-script with the intention to back up a specific (truecrypt-)file onto a SD-card (and a folder shared over the cloud) using the rsync command. The problem was that the SD-card usually ...
1
vote
2answers
56 views

Is it possible to synchronization real time date from source to destination?

We want to copy ~800GB of data from a source server to destination server using rsync. I was wondering if its safe to use rsync without shutting down source server application? Can rsync handle real ...
1
vote
1answer
10 views

rsync generating a destination directory of bigger size than source?

We are copying our data from source server to destination server using rsync : rsync -av --progress --sparse user@destination server After rsync, we observed that destination directory is bigger in ...
0
votes
1answer
28 views

How to “Find” then “Rsync” then “Tar/gz” on destination host?

I have a Cassandra node with snapshots broken up into 64 directories with over 350 files per directory. I want to "find" all snapshot files, preserve their location, rsync them across to a host with ...
0
votes
1answer
22 views

ersync --compare-dest arg does not exist no matter what

I have these folders: . ├── result ├── test │   ├── file1 │   ├── file2 │   ├── file3 │   └── file4 └── test2 ├── file1 ├── file2 ├── file3 └── file5 test is the original folder. ...
2
votes
1answer
1k views

rsync specific directories

Below are the directories of my directory structure. I only want to run rsync on the content under the archive directory of any subdirectory and exclude everything else: ./ ap/ ap/aploader/ ...
0
votes
0answers
29 views

rsync can't update a folder that has no x permissions

I have an rsync job running in one server that keeps folders in sync. The job is running as root in one server and transferred to a backup server as normal user. In the origin server one folder ...
4
votes
2answers
62 views

rsync delete only excluded files

rsync option --delete-excluded implies --delete as well. From man page: --delete-excluded In addition to deleting the files on the receiving side that are not on the sending side, this tells ...
0
votes
0answers
18 views

lftp — continue behavior?

I have a straight forward use case that I thougth lftp could do with the --continue flag - alas it didnt work. Is it doable? - Am I missing some flags, and are there any easier way to do this with ...
55
votes
5answers
56k views

scp without replacing existing files in the destination

How do I copy an entire directory into a directory of the same name without replacing the content in the destination directory? (instead, I would like to add to the contents of the destination folder) ...
2
votes
1answer
17 views

rsync and watch partial transfered video file

I try to copy a large video from my server to my local device with rsync -aP remotefile.mov localfile.mov But the local file does not show up unless I stop the rsync process. I can then watch the ...
0
votes
0answers
18 views

rsync : fixing Permission denied error with no rwx permission

We can see that one of our rsync jobs is failing with the following error rsync: opendir "/share/resources/0731402367/docs/quick-check/answers" failed: Permission denied (13) rsync: opendir ...
0
votes
1answer
34 views

rsync failing to exclude directory [duplicate]

We are using rsync to copy files from one location to another location on a different host. We want to exclude a directory from the source location so that files from this directory are not copied . ...
1
vote
1answer
25 views

Ways to consolidate music folder

Having used iTunes for a long time, my iPod Classic finally started showing signs of dying. I bought a FiiO X5II and put all my music onto it's microSD XC card(s) using rsync to ensure the same folder ...
1
vote
1answer
46 views

Fastest file copying within sshfs directory (rsync?)

I have a directory on a remote server remote1, mounted via sshfs. I am installing new versions of some of the files in the remote directory, which are quite large (~50M). I am currently using ...
1
vote
2answers
46 views

bi-directional sync with rsync

I am trying to setup bi-direction or two way sync with rsync. In my case I only need to delete the files when syncing from B to A. So, I was thinking of running rsync twice as follow : rsync -rtuv ...
1
vote
0answers
34 views

Why is my rsync slow?

I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built ...
3
votes
1answer
20 views

Rsync unable to remove remote file not exist in local

Consider my local folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/3.txt and my remote folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/4.txt and in my local side, I run the ...
8
votes
6answers
5k views

How to rsync files between two remotes?

I would like to transfer files between two remote hosts using on local shell, but it seems rsync doesn't support synchronisation if two remotes are specified as follow: $ rsync -vuar host1:/var/www ...
0
votes
0answers
15 views

How to exclude .htaccess from rsync? [duplicate]

So I've been trying to use rsync and came up with problem. When using: rsync -avzhP --update --delete --include ".*" --exclude-from ./exclude /data/.. user@server:/dir If there is no .htaccess on ...
1
vote
1answer
53 views

Rsync folder time and date

I'm using rsync to copy and noticed that the destination folders have the current time and date. Not the time and date of the source. Did I miss a switch in my command? nohup rsync -avhP ...
0
votes
1answer
82 views

ntfs issue with rsync: read errors mapping permission denied (13)

I have an issue when I want to rsync folders from my external backup hard disk to my NAS. I get this error : read errors mapping permission denied (13) I have root rights; if I want to change ...
0
votes
1answer
27 views

deleting directory with large amount of files with rsync -a delete

I have a directory called crmlogs, how do I use rsync -a --delete to delete it? mkdir emptydir rsync - a --delete \emptydir \crmlogs ?
1
vote
1answer
723 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
39
votes
4answers
35k views

Can rsync resume after being interrupted?

I used rsync to copy a large number of files, but my OS (Ubuntu) restarted unexpectedly. After reboot, I ran rsync again, but from the output on the terminal, I found that rsync still copied those ...
1
vote
1answer
14 views

Rsyncing files without taking into account change in timestamps

Consider the following structure: I develop using SVN. Once I am done I export the revision \qa\project Once QAing is complete, I rsync the files to staging area. I am using the following rsync ...
0
votes
1answer
21 views

rsync backup not creating any files

I am trying to run rsync to back up my file system to an external flash drive. It finishes almost immediately, and no files are present on the flash drive when I view it. What am I doing wrong? ...
4
votes
2answers
132 views

How do I sync files between two drives?

What command can check that a directory contains the same files as another directory, all the files are up to date and copy any updated files or new files to the first directory. It should not care ...
2
votes
2answers
68 views

Is it possible to show rsync output on a single line?

I have a bash script that is rsyncing a large directory and the --progress function is great, but is it possible to show all this output on a single line? ie. as the files transfer, just spit it the ...
0
votes
0answers
26 views

What is the effect of rsync with -E and --chmod?

Reading through a script I came across an rsync command with the following flags: -rtlDE -c --delete-after --chmod=u+rwX,go-rwx /path/to/dir1/ /path/to/dir2/ Background: I am refactoring the ...
0
votes
2answers
3k views

Parallelise rsync using GNU Parallel

I have been using a rsync script to synchronize data at one host with the data at another host. The data has numerous small-sized files that contribute to almost 1.2TB. In order to sync those files, ...
0
votes
3answers
30 views

How to stop rsync from replacing every file whether or not it has been changed?

I want rsync to copy everything from "copy_to_home" directory (which is on a NTFS-formatted hard drive) to the users home directory. I don't want it to delete anying, but it should replace files on ...
9
votes
5answers
1k views

Rsync that handles moves sensibly

I've been successfully using rsync to synchronize my home directories between my laptop and my netbook (both using ext4 with Linux). My only problem with it is that every now and then I like to ...
1
vote
1answer
25 views

rsync exclude directory not working, when also scanning for only *.php files

Im trying to rsync all the .PHP and .HTML files from any directory inside of /home/ . However in /home/site2/public_html/cache_old/ there are .html files that i do not want to include in the sync ...
1
vote
2answers
41 views

Rsync deletes files in old directory?

I'm really stuck on an rsync problem and I haven't been able to crack it by reading the documentation. I want to make 7 directories, one for each day of the week, for back-ups of some folders and ...
1
vote
0answers
15 views

Does rsync\duplicity real write files on mounted storage?

I've got an external storage, which is mounted as cifs: $: mount ... //somespace/backup on /mnt/backup type cifs (rw) ... And I have write some file: $: rsync /home/user/files /mnt/backup or $: ...
4
votes
2answers
89 views

synchronize only the newest files and folders, limit by size

I would like to sync Folder A to Folder B with the following restrictions Folder A contains thousands of files in hundreds of folders and many hundreds of GBs of files. Folder B will contain the ...
5
votes
3answers
8k views

rsync mkstemp failed Invalid argument (22) with davfs mount of Box.com cloud

I mounted Box.com cloud storage using davfs according to these instructions. I mounted my Box.com account under /home/me/Cloud/Box I can access the mounted filesystem via Dolphin as well as via the ...
8
votes
1answer
232 views

Does rsync delete files on the destination that were deleted from the sending side?

Does rsync delete files from the destination if they were deleted from the source? For example, say in the source /home/me I have three files: a.txt b.txt c.txt Now, I run the command rsync -v ...
0
votes
3answers
231 views

rsync partial LVM volume to Remote Directory

Can I rsync a full hdd partition (which is inaccessible) to a remote directory? Inaccessible means it cannot be mounted, it was part of LV volume merged with other HDD which is faulty and removed ...