rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
1answer
1k views

Export a m3u playlist to a directory in order they appear in the playlist

There is a way to rsync a m3u playlist into a destination directory. How can I process the list and number the output so it orders the files to match the playlist order? For example the m3u: ...
3
votes
1answer
646 views

Rsync ssh include & exclude

Here is my current rsync shell script upload.sh SOURCEDIR=/Users/thomas/sites/dreamhost/ DESTDIR=******@reggi.com:/home/thomasreggi/sites/ ##rsync -avzL --delete --include '*/' ...
3
votes
2answers
1k views

rsync pattern copy: dotfiles

I followed the advice given in the question Rsync filter: copying one pattern only to setup a command line I need to backup only the dotfiles .inF* Yet with the command: rsync -av --include='.inF*' ...
3
votes
1answer
311 views

Why does this exclude pattern for rsync give different results when the source directory has a trailing slash?

When I do something like rsync -a --exclude=/e/garbage /e /dest the exclusion works, but with rsync -a --exclude=/e/garbage /e/ /dest/e it doesn't. I'm using version 3.0.7 protocol version 30 ...
3
votes
2answers
390 views

rsync --backup-dir creates empty folders in backup dir

I have a folder structure like this: . ├── bkp ├── dst └── src └── folder └── file I run the following command: rsync -t -r -b --backup-dir /tmp/rsyncTest/bkp/ /tmp/rsyncTest/src/ ...
3
votes
2answers
863 views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
3
votes
1answer
542 views

Permission issues when doing system backup using rsync [duplicate]

I'm trying to backup my linux system (arch linux on a laptop) to a remote computer on the same network using ssh (or NFS). I use rsync extensively to backup my /home directory to the remote computer ...
3
votes
1answer
301 views

Snapshot large changing files

At home I have the following backup scheme: All machines daily rsync to the servers $FULL_COPY directory. The server takes snapshots of that directory daily (also weekly/monthly), keeping at most X ...
3
votes
4answers
1k views

Most Efficient way to back up/sync large directories over SSH

I'm looking to back up some large directories on a Dedicated Server to another Server on a daily basis using minimal bandwidth RSync looks like its up to the task but I'm unsure of the best command ...
3
votes
1answer
377 views

Pausing rsync via bash script?

Is there a way to pause rsync via command line, if it transfers data for over X minutes? I'm working on using it as a backup and would like it to pause every once in a while to prevent the hard disks ...
3
votes
3answers
3k views

rsync list of files in sub-directories to remote server and delete extraneous

I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory. This is what I'm trying to accomplish: ...
3
votes
1answer
2k views

What do you filter / exclude list when doing backup with rsync? [closed]

I'm trying to build a comprehensive filter / exclude file, to prevent backuping stuff that doesn't make sense do backup, such as temporary / cache data or easily recreatable files. I would appreciate ...
3
votes
1answer
3k views

Logging only transferred files with rsync

I've created a backup script with rsync and I have it running every 10 minutes. I have it logging using --progress but to make reading the log easier I only want to include files that are transferred. ...
3
votes
1answer
1k views

How to recursively synchronize file timestamps across servers?

Suppose I run an rsync command to mirror a server, but forget to supply the -t option. The mirror will now have different timestamps to the original. What is the easiest way to fix this, without ...
3
votes
1answer
29 views

How do I mount an external SD card without using sudo?

I wrote a bash-script with the intention to back up a specific (truecrypt-)file onto a SD-card (and a folder shared over the cloud) using the rsync command. The problem was that the SD-card usually ...
3
votes
1answer
37 views

Rsync contents of tar with remote server

I've got a number of backups as tar archives, and to do checking/testing of them I restore to some test machines using: cat archive.tar.gz | ssh server2 "cd /path/to/dir; tar zxvf -" Most of the ...
3
votes
0answers
186 views

sync two zip archives (with minimal I/O)?

zip itself can freshen an archive to reflect the current filesystem (e.g. -FS). It only updates zip entries with outdated timestamps. Is there a tool that updates a 2.zip file so that it becomes ...
3
votes
1answer
157 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...
3
votes
0answers
315 views

rsync 3.1.0 is creating empty backup directories

I just noticed that there is a discrepancy between version 3.0.9 and 3.1.0 of rsync. Running the command $ rsync -a --delete --backup --backup-dir=../old source/ dest/ with version 3.1.0 gives the ...
3
votes
2answers
1k views

transfer a file to remote dir only if doesn't exist without replacing

I'm using CentOS linux. In one line cmd, that returns 0 if success, non-0 if failure, I need: Transfer a file to a remote server. Don't transfer the file if filename exists in remote server ...
3
votes
0answers
705 views

How to use rsync to backup large files by either appending or replacing

I am using rsync to backup some large files regularly: rsync --archive --update --append-verify [source] [destination] Most of the times, the files increase in size (like a log file), but sometimes ...
3
votes
2answers
921 views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
2
votes
3answers
752 views

How do you fire a sequence of commands at the command tool?

I had a previous question (deleted it) and I still don't understand why it is so hard to understand what I'm trying to ask, but I'll try once again and more clearly. So I'm copying over several ...
2
votes
3answers
250 views

How to pass argument with char ( in remote path?

I'm trying to move a file with rsync to a remote location, The file has be be named : DRRS_(H264).mp4 but when I try : rsync -azR output.mp4 user@server.com:encoded/somepath/DRRS_(H264).mp4 it ...
2
votes
1answer
3k views

Why is rsync not found?

rsync -avP /home/user/.profile hpux3:/home/user/.profile bash: rsync: command not found If I did ssh to hpux3 machine rsync version 3.1.1 protocol version 31 Copyright (C) 1996-2014 by Andrew ...
2
votes
2answers
248 views

rsync: does it uses invisible configuration files?

I've a question about rsync command in unix. Does it save some configuration invisible files into the directories ? How does it know which files need to be added or not ? Or is just checking file by ...
2
votes
2answers
69 views

How to get information about files being copied to my machine by remote rsync command?

I am rsyncing a directory from machine B to machine A. rsync command is run on machine B. On machine A, what kind of information can I get about this rsync process (progress/amount of data downloaded ...
2
votes
3answers
64 views

How can I keep rsync from using encryption and compression for the file transfers after the connection is authorized?

I understand that a secure connection (i.e. ssh) is needed to authorize a connection to the remote server. But after that is authorized can the data be transmitted without encryption and compression ...
2
votes
2answers
3k views

How to copy large files over the network

I need to copy large files over the network, but I am not sure about the command line to use for it. I have been using rsync, but I feel maybe I could zip the files first? I am a Unix beginner, so ...
2
votes
2answers
2k views

Using rsync to sync two directories on server and localhost, but size is different

I'm using rsync to sync a directory from server to localhost: rsync -avz --delete ./Stuff user@host:/Stuff This all works fine, but how come when I type 'du -s' in both the server and the localhost ...
2
votes
3answers
980 views

Filtering paths to a specific depth

I'm using rsync and the flags -nPaAXz ~/ to check which files are going to be copied. This is far too verbose to make any sense of. How could I filter the output so I view the list of files/folders ...
2
votes
1answer
367 views

No password prompt when using rsync remotely?

I have a bash script that executes rsync transfers to a remote location, and every time I execute the script I get asked for a password. Is there a way to avoid this? This is the command I use: ...
2
votes
2answers
950 views

Basic rsync command for bit-identical copies

As far as I undstand, the following command: sudo rsync --delete -azvr /home/oshiro/Desktop/source/ /home/oshiro/Desktop/destination Is this all I need to create a simple synchronisation of files ...
2
votes
4answers
160 views

Why would I use a rsync mirror?

Most Linux distributions offer mirrors that use rsync. I know that rsync is best used on mirrors because it only copies the delta between the local file and the remote one. What benefits do I get as ...
2
votes
2answers
2k views

Meaning of Crossing filesystem boundaries, --one-file-system, etc

I'm planning to use rsnapshot to backup my whole Linux system, though I'm confused by -x option (same of one_fs in rsnapshot.conf). The man page says: -x one filesystem, don't cross partitions ...
2
votes
1answer
434 views

ssh/scp works but rsync just constantly says “no”

Hi I have a windows 2003 server that I need to back up onto a linux client so I install cygwin on the Win2k3. On the Win2k3 I have enabled ssh, scp but (because the Win2k3 server uses an customised ...
2
votes
3answers
109 views

Get files on remote copy but not local

I have a folder. I have one copy of this folder locally and one on a server. I edited my local folder as I wanted and then rsync it to the server. Is there any way of comparing those two copies, ...
2
votes
2answers
1k views

Cancel and resume a duplicity backup

Is there a way to cancel duplicity (running over rsync and symmetric gpg encryption) without messing up the running backup and resume it later (for example after rebooting the laptop) without ...
2
votes
4answers
5k views

rsync timed out

I need to sync a directory to a directory on a remote server. at the moment i use rsync -ca to do this but the directory is quite large and the whole process fails with a timeout error. Now i'm ...
2
votes
1answer
286 views

Backing Up to a Compressed Archive on Linux

How would you go about backing up just some files and subdirectories of a given directory to a compressed archive so that the tree structure could then easily be recreated from that archive. ...
2
votes
1answer
16 views

rsync and watch partial transfered video file

I try to copy a large video from my server to my local device with rsync -aP remotefile.mov localfile.mov But the local file does not show up unless I stop the rsync process. I can then watch the ...
2
votes
3answers
76 views

Migrate mail from dovecot on centos to dovecot on debian

I am trying to migrate a number of user mail accounts from dovecot 1.0.7 on a centos 5.11 server to dovecot 2.1.7 on a debian 7 server Foolishly I thought I could simply replicate the Maildirs from ...
2
votes
1answer
42 views

Is it feasible to update the modified times only without copying files when using rsync?

The modified times of a large amount of local files are incorrect. I want to update the timestamps by syncing the timestamps on the server. It would be time-consuming if the files themselves are ...
2
votes
1answer
279 views

Using rsync to copy from local to remote server with cronjob, asking for password

I want to copy files from a local machine to a remote machine. I have the command all set up and it looks like this: rsync -a project root@123.456.789.0:~ However, when running this command, I'm ...
2
votes
2answers
147 views

Do files not copied matter when using rsync?

I have used rsync to back up my / directory to an external hard drive, using this command in user (not su) mode (about 200,000 files copied in one hour and forty minutes) and it seemed to finish ...
2
votes
1answer
4k views

Adjusting rsync TCP timeout

I'm using rsync in my own C++ program by issueing the command system("rsync -rauzvq root@host:/folder"); I use this for keeping multiple systems in sync. Now I have the problem that when a remote ...
2
votes
2answers
2k views

Sync local files to remote git repository

I have my git repository on a linux located on the company server. I ssh into my linux machine and edit files there. Problem This method is great until I have a good connection to the server. in ...
2
votes
3answers
2k views

Decreasing hard drive sync time with Unison

I'm using Unison to synchronize my music collection to a few different sources, namely a couple computers over SSH and a hard drive. One thing I've noticed is that SSH updates are incredibly fast in ...
2
votes
2answers
61 views

Is it possible to show rsync output on a single line?

I have a bash script that is rsyncing a large directory and the --progress function is great, but is it possible to show all this output on a single line? ie. as the files transfer, just spit it the ...
2
votes
1answer
68 views

How to backup readable but not writable files using rsync?

I am using rsync to backup some folders in my home directory to a remote server using the following commands: cd rsync -Favz --inplace --delete --delete-excluded folder1 folder2 folder3 ...