rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

2
votes
1answer
13 views

Using rsync for incremental backup, what happens when original full backup is due for deletion?

I have started an incremental back up, on an external hard drive, of my Fedora 20 data etc using the scheme from here, which produces a full back up on day 1 followed by incremental backups using hard ...
0
votes
2answers
354 views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
0
votes
1answer
18 views

ZFS backup advice with another server

I currently have two servers both have the exact same hardware, disks, etc. One server (server1) is going to be the "main" server. It's basically a server with raidz2 that has SMB shares on it that ...
1
vote
0answers
13 views

Can I change the exclude file list while running rsync under a cron job

I am using Fedora 20, MATE desktop, zshell. I have started a cronjob to run, every evening, an incremental backup using rsync, closely following the suggestions here. After the first run yesterday, ...
3
votes
3answers
14k views

rsync without prompt for password

I need to execute rsync, without it prompting me for password. I've seen in rsync manpage that it doesn't allow specifying the password as command line argument. But I noticed that it allows ...
2
votes
1answer
17 views

rsync to multiple remote servers

I have a file I want to sent to multiple separate servers. Is it possible to name multiple destinations? rsync foo.png server1:foo.png server2:foo.png This gives me a "Unexpected remote ...
1
vote
1answer
22 views

Rsync : overwrite log file

In rsync, --log-file creates a log file, however, if i do a daily backup, the log is appended to the previous log file. How can i force rsync to overwrite the log file instead of appending to it?
0
votes
2answers
76 views

What root directories should I back up? [duplicate]

I intend to start incremental backups of my Fedora 20 system, and would like to know what root directories I should include, and what directories it is useful to exclude. I know there is a lot of ...
2
votes
1answer
24 views

Exclude directories with 'rsync' and ssh with pull request

I am trying to pull from a remote server and exclude a directory on the remote server. For some reason it keeps pulling that directory I have excluded. Here is the command I am running: rsync -azP ...
5
votes
0answers
42 views

rsync hangs unless I defrag ext4 filesystem

I have a XBian server (Raspberry Pi version of Debian) running rsync via inetd (not the native dæmon). I am serving a couple of directories on an ext4 filesystem (on a USB disk) as individual modules ...
1
vote
2answers
25 views

rsync a list of directories with absolute path in text file

I have a text file containing a list of directories with its absolute path $ cat DirectoriesToCopy.txt /data/Dir1 /data/Dir2 I want to use rsync to copy all these directories preserving its ...
0
votes
1answer
29 views

Backing up Linux server to Windows domain

I'm maintaining a small Linux workstation/server in a Windows-domain-based environment. Apart from being in the same network, the Linux computer is not connected to the domain. Until now, I'm using a ...
-1
votes
0answers
27 views

rsync ssh - huge files

I am about to do some shuffling around linux servers with some bigger files. Firstly I need to download cca 40Gb file. I will try to do this with "wget". I says wget know how to resume if some ...
1
vote
0answers
25 views

rsync copy only files facade [duplicate]

Is there a way to mirror a directory structure and files there contained with rsync, giving out facade zero length files? I mean, mirroring dirs (-d flag I think) exactly as they are, while not ...
1
vote
1answer
22 views

rsync: mix exclude and include filters

The following pattern copies the .pdf files from source to destination, working fine. rsync -rv --include="*.pdf" --include="*/" --exclude="*" --prune-empty-dirs /source/ ~/destination/ but I want ...
0
votes
1answer
32 views

Backup to flash drive using rsync

I've decided to make a full backup from my SSD disk to flash drive. According to archwiki general backup is done with following command: rsync -aAXv ...
3
votes
4answers
2k views

How to rsync over ssh when directory names have spaces

I am new to Linux and am trying to rsync from one server to another. The servers have the same directory structure but I am having trouble getting the remotes server to properly recognize the path ...
2
votes
1answer
380 views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
1
vote
0answers
5 views

rsync daemon max connections unlimited

I'm creating a gui app to upload files to a particular place on a server. the user is able to drop files and these files are 'moved' to the server, if the file already exists, then it is only updated ...
2
votes
1answer
24 views

Repetition of password while rsync-ing files?

I'm using a script to download files in two steps: First, I'm downloading a file containing a list of files from a server to my host machine using rsync. Then, I'm using rsync to download the ...
2
votes
0answers
22 views

How to output rsync sent data in realtime using standard tools

I'm developing a small tool for some people who need to send files over to a server. I'd like to use rsync to a rsync deamon to do so. Is it possible to have rsync to output how much data it has ...
2
votes
1answer
21 views

rsync exclude-from directory with space

I am trying to exclude "Mendeley Desktop" directory for rsync. The exclude-from= is as: Downloads *.o *.iso Dropbox Documents/Mendeley\ Desktop but rsync is still backing up the Mendeley Desktop. ...
1
vote
5answers
148 views

Interactive ssh works, but not rsync or scp, on OSX

The motivation is that there's a server that I can ssh into (with or without key pairs set up ... i.e., without or with a password) but that I cannot send files to via rsync, scp, or sftp. Someone ...
6
votes
2answers
10k views

rsync gives “chown <…> failed: Invalid argument (22)” with nfs share

I'm trying to back up my entire system to an external disk using rsync, via a shell script which is run as root: #!/bin/bash rsync -vSHPhhaX --numeric-ids --delete ...
0
votes
0answers
32 views

rsync --delete doesn't delete all files

This is the script I have so far rsync -avz -e ssh --delete /tftp/ username@192.168.1.51:/tftp/ I want it to completely copy every directory/file in /tftp/ and overwrite everything in the ...
3
votes
3answers
2k views

rsync list of files in sub-directories to remote server and delete extraneous

I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory. This is what I'm trying to accomplish: ...
4
votes
1answer
44 views

rsync doesn't preserve directory ownership even with -a

I use this rsync invocation to backup my home directory: rsync -aARrx --info= --force --delete --info=progress2 -F "$USER_HOME" "$BACKUP_MNTPOINT" rsync man page says that -a implies -g and -o ...
2
votes
1answer
30 views

How to interpret rsync console output?

I use the following rsync command to backup my files: rsync -avHc Pictures /backup/ Isn't -v supposed to only display files and directories that were transferred? If I change a file and run the ...
2
votes
1answer
50 views

Rsync folder while --exclude-from'ing .gitignore files at different depths

So I'm trying to work on a command to rsync a source folder with a structure like so: - app.js - .gitignore - src/ - src/logs/ - src/logs/.gitignore The first .gitignore would have a series of ...
5
votes
2answers
4k views

Having an rsync job complete after closing SSH connection

I am transferring a large amount of files from one computer to another using rsync. I am doing this by SSHing into the source computer and executing a command like this: sudo rsync ssh ...
1
vote
1answer
26 views

RYSNC over SSH not working for restricted shell

I need to give access to some Mr X in my production server so that he can push files to my server. Since there is no necessity to give him shell access , I decided to use restricted shell (rssh) so ...
0
votes
0answers
25 views

rsync rules to only sync specific sub-dirs in long paths

I'm trying to perform complex rsync include/excludes to backup only the following within the /home/x dir: Recursively all files/dirs in Documents Recursively all files/dirs in ...
1
vote
1answer
22 views

Automatically pauseing rsync if target is full

I need to transfer 80gb's of unsorted text documents from one computer to another and all I have is a 32gb USB. Is there an option to make rsync automatically pause when the USB is full without losing ...
0
votes
0answers
71 views

rsync include-from exlcude-from with including subdir but excluding dirs above

I try to use rsync with --include-from and --exclude-from options. I have a directory structure like: /docs/domain-[a-z]/templates Now I want to sync templates only if something is in there. Further ...
2
votes
1answer
461 views

Incremental file back up by date

Is there any backup tool that supports partial back up by date? What I mean is that I have some small drives such as on a laptop that can't hold a full copy of all the files on an external 2TB drive. ...
1
vote
1answer
16 views

I can't get rsync --exclude-from to work with a file

Here's the command : rsync -avAX --exclude-from=/home/vco/bin/wip-files-learning/backup_tests/rsyncexclude.txt ./some_tests/ ./back_to_me/ Here's the contents of the exclude file : ...
0
votes
1answer
59 views

rsync: Copy speed decreases while syncing two directories

I am using rsync on fedora 20 to sync my directories. I am using the command below:- $ rsync --progress -a srcDir DestDir But, as rsync copies files, copy speed decreases significantly. Here is my ...
1
vote
1answer
23 views

Chunked transfer contents of block device over bad network

/dev/sda is the only disk on system. I want to save it to a raw image on another server. I can't do it in one shot, because network disconnects often. Is it possible with e.g. torrent?
0
votes
1answer
31 views

Rsync doesn't skip existing files

I use rsync to backup all the files from a specific folder in a USB drive connected to my Mac (Osx 10.9) to a folder of my home network NAS. The problem is that rsync replace all files and it does not ...
3
votes
1answer
49 views

rsync causing errors after sync

When I run the rsync command to push my files to production, sometimes - not always, and it's very rare - after the sync has completed, we are getting errors within our production environment. The ...
6
votes
3answers
1k views

Transfering millions of files from one server to another

I have two servers. One of them has 15 million text files (about 40 GB). I am trying to transfer them to another server. I considered zipping them and transferring the archive. But I realized that ...
4
votes
1answer
200 views

What does all this extra data from rsync mean?

When I move directories with rsync, I get some extra data to the right of the progress bar right after each file has been copied: $ rsync -aP assembly /media/andreas/backup sending incremental file ...
6
votes
3answers
9k views

Can rsync resume after being interrupted?

I used rsync to copy a large number of files, but my OS (Ubuntu) restarted unexpectedly. After reboot, I ran rsync again, but from the output on the terminal, I found that rsync still copied those ...
1
vote
1answer
54 views

Linux command to copy as hard links, while deleting unwanted files?

I'm looking for a command that behaves both like cp -al in only creating hard links rather than copying file contents, and rsync -a --delete in removing files from the destination that are not ...
1
vote
2answers
43 views

Can rsync be configured to avoid modifying subdirectories not found in the source folder?

I am having a hard time figuring out exactly how to run rsync to get it to do what I need it to do. Basically what I need is as follows given a single source folder with multiple sub-directories: ...
9
votes
2answers
13k views

“rsync: failed to set permissions on …” error with rsync -a or -p option

When I use the -a option as is asked and answered in Preserve the permissions with rsync, I got a lot of "rsync: failed to set permissions on" errors. rsync: failed to set permissions on ...
1
vote
1answer
34 views

communicate with rsync daemon without sockets

According to the manpage, rsync --daemon will either: try to communicate using the rsync protocol using stdin/out, if it detects that the stdin/out are a socket, open a TCP socket for listening and ...
7
votes
3answers
14k views

Using rsync to move (not copy) files between directories?

I have been using rsync to copy files for some time. My understanding is that rsync is faster than cp when some of the files to transfer are already in the destination directory, transferring only the ...
0
votes
2answers
30 views

How to Copy Only the Directories with a specific File in that directory

Main_Directory | Event_Subdirectories | *.mcp .otherfiles I want to copy all Event_Subdirectories to another Main_Directory that have the *.mcp file within the Event_subdirectory, but I'm ...
1
vote
0answers
11 views

Using rsync, how can I know what attribute of source file differed from the dest which caused the trasfer

I heavily depend on rsync for remote data transfer and backup purposes, occasionally on different filesystem types. AFAIK rsync by default compares file size and modification timestamps to find out ...