rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
1answer
1k views

rsync and backup and changing timezone

I back up my pictures from my camera using rsync, using: rsync -vzrtl --progress --stats --timeout=0 host destination Now I was in a different timezone when I did my first backup then I moved to a ...
3
votes
3answers
621 views

How to diff two folders by inodes

I'm currently using a script to backup files on my computer. In a nutshell, it works like this: rsync --link-dest=$FOLDER/current $SOURCE $DESTINATION However, I think that my script may be ...
3
votes
1answer
22 views

how do I exclude a specific folder on the destination when using rsync?

consider the following example: /source /source/folder1 /source/folder2 /source/folder3 /destination /destination/folder2 /destination/folder3 /destination/folder3/mytestfolder1 /...
3
votes
4answers
74 views

du --exclude directories - is this possible?

How to calculate disk usage of a file tree but excluding directories. I'd like to have something like: du --exclude type d I use rsync to mirror/backup part of my home dir and I want to double ...
3
votes
1answer
64 views

Stopping rsync without leaving temporary files behind

When copying files from directory A to B with rsync using $ rsync -a --backup --suffix=.$(date +"%Y%m%d%H%M%S") A/ B/ a file called filename in A will temporarily be called something on the form ....
3
votes
2answers
736 views

How to skip special / socket files during rsync transfer?

Using the following command. rsync --archive --delete --partial --progress --recursive --no-links --no-devices --quiet source target Using --no-links and --no-devices already. Getting the error ...
3
votes
3answers
604 views

How to rsync a directory to a new directory with different name?

I'm doing a data transfer, the old file system relies deeply on a directory which now is on different path. This is a git directory which stores code online. I have no rights to move it or rename it. ...
3
votes
2answers
3k views

rsync to multiple remote servers

I have a file I want to sent to multiple separate servers. Is it possible to name multiple destinations? rsync foo.png server1:foo.png server2:foo.png This gives me a "Unexpected remote arg:server1:...
3
votes
1answer
141 views

rsync causing errors after sync

When I run the rsync command to push my files to production, sometimes - not always, and it's very rare - after the sync has completed, we are getting errors within our production environment. The ...
3
votes
2answers
118 views

Delete the files on the destination which are found in the source using rsync

I was wondering is there any way to delete all the files in the destination using rsync which are found in source. I have 30+ dir in source and 100+ files on the destination I want only the 30+ in ...
3
votes
1answer
867 views

rsync archive mode

I have been reading plenty of articles regarding rsync and its -a switch. As per theory, I have understood that it preserves a lot of properties like permission, time, group, owner, etc., but why ...
3
votes
2answers
299 views

How to configure Unison for real peer-to-peer?

I have a handful of devices, and am considering keeping them in sync with Unison. The devices are not running all the time, they are switched off a few hours per day, not necessarily at the same time....
3
votes
1answer
744 views

Bash remote autocompletion : change the 'starting' directory

I'm regularly downloading files from a remote server, always from the same directory. So I wrote a custom function that I put in my bashrc: download_from_myserver () { for file in "$@" do ...
3
votes
1answer
6k views

rsync: failed to set permissions on “/path/to/file.txt”: Operation not permitted (1) [duplicate]

I encountered the error when attempting to transfer source files from a remote Linux web server to a local HP dt1000i Desktop Hard Drive connected to an Ubuntu 12.10 box via USB. A Samba share is ...
3
votes
2answers
191 views

Any ideas to simplify the awkward rsync expression below?

Here is expression: rsync -avz --progress -e "ssh -i /where/is/my/id_dsa" vivek@some.host:`ssh -i /where/is/my/id_dsa vivek@some.host "find /remote/source/dir -type f -name '*.sql' | sort -nr | head ...
3
votes
2answers
961 views

How to implement a rotation scheme with rsync

I have an ever growing remote directory of files that I'd like to sort and filter before I rsync them, with the goal of always keeping only the latest N files in my destination directory (i.e. a ...
3
votes
1answer
551 views

rsync an mpd playlist

An mpd playlist looks like this: syncrel.m3u Bob Dylan - The Times They Are A-Changin' [V0]/04. One Too Many Mornings.mp3 Bob Dylan - The Times They Are A-Changin' [V0]/01. The Times They Are A-...
3
votes
2answers
58 views

How to make ssh account capabele to only sshfs and rsync?

I'd like to make ssh account that is capable of doing two things: mounting (can be one) directory via sshfs performing backup&recovery of his/her desired directories using rsync I would love ...
3
votes
1answer
577 views

rsync's --link-dest option does not link because of file time

Consider this test case: mkdir a echo 'blah' > a/test mkdir b echo 'blah' > b/test rsync -r --link-dest=/tmp/b /tmp/a/ /tmp/c As expected, rsync creates c/test a hardlink of b/test (note the ...
3
votes
1answer
5k views

Configuring anonymous rsync daemon

EDIT: I have since found that by using a folder in the root directory, things get a bit further - I can list the subfiles. So it really looks like permissions on the folder are the issue. I'm not ...
3
votes
3answers
3k views

Rsync over SSH with authorized keys..but run 2 rsync commands

I just figured out how to automate my rsync backups using authorized_keys and the command= parameter so that my rsync script can't be modified by the user. So my authorized key file looks like this: ...
3
votes
4answers
1k views

How to prepare files for rsync on a case insensitive filesystem?

I am transferring a large number of files on a HFS+ filesystem. The files are currently on ext2 partitions. I have conflicts due to case insensitivity of the target partition (HFS+). I want to ...
3
votes
1answer
766 views

Rsync over ssh tunnel - using gateway server

Environment: ---------- ---------- /| ------------ | Work | | Gateway| | | | cluster | |Station |--------------------------------| |...
3
votes
1answer
101 views

start rsync download before upload completes

I'm uploading a file via rsync from my local machine to a server so that a colleague can download it to his machine. Normally I would notify him to start downloading when the upload is complete, but ...
3
votes
2answers
3k views

Setting nice and ionice for rsync via xinetd

I am attempting to set nice and ionice for rsync via xinetd. I am running Fedora 16. The reason I would like to use these values is to reduce the rsync process to an idle state so other processes run ...
3
votes
1answer
1k views

Export a m3u playlist to a directory in order they appear in the playlist

There is a way to rsync a m3u playlist into a destination directory. How can I process the list and number the output so it orders the files to match the playlist order? For example the m3u: /music/...
3
votes
1answer
680 views

Rsync ssh include & exclude

Here is my current rsync shell script upload.sh SOURCEDIR=/Users/thomas/sites/dreamhost/ DESTDIR=******@reggi.com:/home/thomasreggi/sites/ ##rsync -avzL --delete --include '*/' --include-from=list....
3
votes
2answers
1k views

rsync pattern copy: dotfiles

I followed the advice given in the question Rsync filter: copying one pattern only to setup a command line I need to backup only the dotfiles .inF* Yet with the command: rsync -av --include='.inF*' -...
3
votes
1answer
312 views

Why does this exclude pattern for rsync give different results when the source directory has a trailing slash?

When I do something like rsync -a --exclude=/e/garbage /e /dest the exclusion works, but with rsync -a --exclude=/e/garbage /e/ /dest/e it doesn't. I'm using version 3.0.7 protocol version 30 ...
3
votes
2answers
611 views

rsync --backup-dir creates empty folders in backup dir

I have a folder structure like this: . ├── bkp ├── dst └── src └── folder └── file I run the following command: rsync -t -r -b --backup-dir /tmp/rsyncTest/bkp/ /tmp/rsyncTest/src/ /tmp/...
3
votes
2answers
1k views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
3
votes
1answer
622 views

Permission issues when doing system backup using rsync [duplicate]

I'm trying to backup my linux system (arch linux on a laptop) to a remote computer on the same network using ssh (or NFS). I use rsync extensively to backup my /home directory to the remote computer ...
3
votes
1answer
363 views

Snapshot large changing files

At home I have the following backup scheme: All machines daily rsync to the servers $FULL_COPY directory. The server takes snapshots of that directory daily (also weekly/monthly), keeping at most X ...
3
votes
2answers
1k views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use rsync....
3
votes
4answers
1k views

Most Efficient way to back up/sync large directories over SSH

I'm looking to back up some large directories on a Dedicated Server to another Server on a daily basis using minimal bandwidth RSync looks like its up to the task but I'm unsure of the best command ...
3
votes
1answer
401 views

Pausing rsync via bash script?

Is there a way to pause rsync via command line, if it transfers data for over X minutes? I'm working on using it as a backup and would like it to pause every once in a while to prevent the hard disks ...
3
votes
3answers
3k views

rsync list of files in sub-directories to remote server and delete extraneous

I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory. This is what I'm trying to accomplish: ...
3
votes
1answer
2k views

What do you filter / exclude list when doing backup with rsync? [closed]

I'm trying to build a comprehensive filter / exclude file, to prevent backuping stuff that doesn't make sense do backup, such as temporary / cache data or easily recreatable files. I would appreciate ...
3
votes
1answer
4k views

Logging only transferred files with rsync

I've created a backup script with rsync and I have it running every 10 minutes. I am copying files from HFS to Fat32. I have it logging using --progress but to make reading the log easier I only want ...
3
votes
0answers
61 views

Sync with Onedrive

I would like to sync (and backup) my /home directory with OneDrive. I found some great terminal clients, where you can even mount your directory, but nowhere did I found an option to this with some ...
3
votes
0answers
55 views

Speed up / avoid calculation of rsync file lists

I use rsync 3.1.1 to keep in sync two discs, one of which is on the network and mounted as a samba share on /mnt/ROUTER_WD_2TB/. This is the source, with a speed of 30-40MB/s maximum due to network ...
3
votes
1answer
69 views

Rsync contents of tar with remote server

I've got a number of backups as tar archives, and to do checking/testing of them I restore to some test machines using: cat archive.tar.gz | ssh server2 "cd /path/to/dir; tar zxvf -" Most of the ...
3
votes
0answers
301 views

sync two zip archives (with minimal I/O)?

zip itself can freshen an archive to reflect the current filesystem (e.g. -FS). It only updates zip entries with outdated timestamps. Is there a tool that updates a 2.zip file so that it becomes ...
3
votes
1answer
195 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...
3
votes
0answers
398 views

Rsync - Corrupted MAC on input

Background I have a script on my NAS which is a Synology DS212J which is running on a special distro where uname -a gives me Linux DS212J 2.6.32.12 #4493 Wed Jul 16 11:37:16 CST 2014 armv5tel GNU/...
3
votes
2answers
2k views

transfer a file to remote dir only if doesn't exist without replacing

I'm using CentOS linux. In one line cmd, that returns 0 if success, non-0 if failure, I need: Transfer a file to a remote server. Don't transfer the file if filename exists in remote server (...
3
votes
0answers
785 views

How to use rsync to backup large files by either appending or replacing

I am using rsync to backup some large files regularly: rsync --archive --update --append-verify [source] [destination] Most of the times, the files increase in size (like a log file), but sometimes ...
2
votes
3answers
811 views

How do you fire a sequence of commands at the command tool?

I had a previous question (deleted it) and I still don't understand why it is so hard to understand what I'm trying to ask, but I'll try once again and more clearly. So I'm copying over several ...
2
votes
3answers
290 views

How to pass argument with char ( in remote path?

I'm trying to move a file with rsync to a remote location, The file has be be named : DRRS_(H264).mp4 but when I try : rsync -azR output.mp4 user@server.com:encoded/somepath/DRRS_(H264).mp4 it ...
2
votes
2answers
250 views

rsync: does it uses invisible configuration files?

I've a question about rsync command in unix. Does it save some configuration invisible files into the directories ? How does it know which files need to be added or not ? Or is just checking file by ...