rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
1answer
70 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...
2
votes
1answer
14 views

Efficient way to download binary from server

I am using a remote machine to compile a project. When it finishes building, I use scp to copy the archive to a local machine. This worked fine till I was on broadband. Now I am using a 3G ...
2
votes
1answer
127 views

rsync specific directories

Below are the directories of my directory structure. I only want to run rsync on the content under the archive directory of any subdirectory and exclude everything else: ./ ap/ ap/aploader/ ...
2
votes
1answer
510 views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
2
votes
1answer
71 views

Is monitoring rsync with a pts device possible?

I have a rsync backup script, and I was wondering about methods of monitoring it as it runs. I could have it save a log and use watch and tail, but I had a more elegant solution in mind that might be ...
2
votes
1answer
45 views

Can I set defaults for rsync in non daemon mode?

Can I set defaults for rsync in non daemon mode? I know the daemon mode has this configuration file: /etc/rsyncd.conf But I typically use the non daemon version in this sort of manner: rsync -avzcO ...
1
vote
1answer
33 views

How to keep a redundant home directory for offline use?

Scenario: My home dir is on NFS, identities are in LDAP and authorization is via Kerberos. My NFS, LDAP and Kerberos servers are all VMs -- I'm stretching a little hardware a long way at home. Life ...
1
vote
1answer
26 views

What is the proper bash method of prompting the user for administrative password before backing up the usb data to the computer?

mate-terminal --window-with-profile=PROFILENAME="Hold the terminal open" -e "sudo rsync -azvu --log-file=/var/log/simplebackup.log --append-verify --exclude '.gvfs' /media/user/usb/ ...
2
votes
0answers
116 views

“ls -lh” directories reported size : Linux vs CIFS mounted drives

From a Linux box, I recently mounted a Windows share using CIFS. The intent was to "locally" use rsync to backup my Windows machine. The command line used to mount the Windows drive is something ...
2
votes
0answers
33 views

How to output rsync sent data in realtime using standard tools

I'm developing a small tool for some people who need to send files over to a server. I'd like to use rsync to a rsync deamon to do so. Is it possible to have rsync to output how much data it has ...
2
votes
0answers
1k views

rsync multiple files to multiple directories

I need to move a large number of files that need to go to different directories i.e. file1.mpg to /mnt/s3/directory1/file1.mpg file2.mpg to /mnt/s3/directorya/file2.mpg file3.mpg to ...
2
votes
0answers
526 views

How to use rsync to backup large files by either appending or replacing

I am using rsync to backup some large files regularly: rsync --archive --update --append-verify [source] [destination] Most of the times, the files increase in size (like a log file), but sometimes ...
2
votes
0answers
3k views

Occasional rsync error code 12 “Connection reset by peer (104)” from cron task that runs every 20 minutes

I have a script run by cron that rsync's various folders to a server in a different city to publish files to websites. In case it matters, the source server is within the corporate firewall and the ...
2
votes
0answers
251 views

Cannot get rsync to keep source file ownership, tried many tricks

I'm trying to rsync some directories from a webserver running RHEL5 to a system running Xubuntu. I have rsync, ssh, and keys setup for the machines. I've tried everything so that when i backup from ...
1
vote
0answers
27 views

How rsync --compare-dest works

I know there's a very similar question here, but the accepted answer has nothing to do with rsync, and the OP's solution doesn't apply in my case. I'm trying to get all the updates from a CentOS ...
1
vote
0answers
34 views

Bash script to get the result from rsync transfer and zip it as a directory in the original directory

OK, I guess this is weird. I have a small stage.sh script very simply has a bunch of commands: if [ "$(whoami)" == 'David' ]; then rsync -a --delete-excluded --exclude-from=.stage_rsync_rules ...
1
vote
0answers
16 views

Samba File Server Configuration and Sync for Redundancy

I have two boxes which I installed Samba on. For now, I have a single user that access the server, however, I need to expand as to deploy in a production network. Below is what I want to achieve. ...
1
vote
0answers
30 views

Estimate time or work left to finish for rsync?

When running rsync on a directory with lots of files and directories at multiple levels, can we estimate the amount of work or time to finish? the progress option only shows the progress of ...
1
vote
0answers
40 views

Using Rsync to SSH and Find files

Hello I am trying to use Rsync to SSH into a remote server and pull a certain type of file that has been modified within the last 24 hours. Here is what I am trying: rsync -avx --timeout=480 ...
1
vote
0answers
33 views

What folders should I exclude / not exclude when migrating a server using rsync

I've got a requirement to migrate a web server onto a fresh server (both 32 bit and Fedora 15). I'm using this guide as I've very little experience with linux, coming from a windows background. So ...
1
vote
0answers
25 views

Can I change the exclude file list while running rsync under a cron job

I am using Fedora 20, MATE desktop, zshell. I have started a cronjob to run, every evening, an incremental backup using rsync, closely following the suggestions here. After the first run yesterday, ...
1
vote
0answers
18 views

rsync daemon max connections unlimited

I'm creating a gui app to upload files to a particular place on a server. the user is able to drop files and these files are 'moved' to the server, if the file already exists, then it is only updated ...
1
vote
0answers
13 views

Using rsync, how can I know what attribute of source file differed from the dest which caused the trasfer

I heavily depend on rsync for remote data transfer and backup purposes, occasionally on different filesystem types. AFAIK rsync by default compares file size and modification timestamps to find out ...
1
vote
0answers
38 views

How can I limit the bandwith to a davfs-mounted cloud storage?

I need to copy approx 400 files of approx. 25 MB each to a davfs-mounted cloud storage. I have tried the following commands to limit the CPU-load and IO-load: nice -n 15 ionice -c 3 rsync -avhW ...
1
vote
0answers
21 views

After restoring a backup my permissions seem to be borked

I made a complete backup of the system with "rsync -aAXv", and set up my encryption. After restoring everything, and booting up and trying to login, openbox didn't want to start, and "startx" didn't ...
1
vote
0answers
155 views

Run multiple rsync's at once?

I'm moving over about a million of files (800GB, containing) multiple system backups. And it's only running at ~9MB at a time, often. Enough bandwidth, since it can run up to about 50MB/s. However, ...
1
vote
0answers
148 views

rsync 3.1.0 is creating empty backup directories

I just noticed that there is a discrepancy between version 3.0.9 and 3.1.0 of rsync. Running the command $ rsync -a --delete --backup --backup-dir=../old source/ dest/ with version 3.1.0 gives the ...
1
vote
0answers
123 views

Rsync - Corrupted MAC on input

Background I have a script on my NAS which is a Synology DS212J which is running on a special distro where uname -a gives me Linux DS212J 2.6.32.12 #4493 Wed Jul 16 11:37:16 CST 2014 armv5tel ...
1
vote
0answers
40 views

Delete files that are not included with `rsync --files-from`

I copy files to another location using rsync with the option --files-from. Sometimes, a file gets deleted and is not included in that list of files any more. I tried to use --delete, but that would ...
1
vote
0answers
32 views

How to efficiently create (read-only) both a snapshot and a diffshot at the same time?

I use rsync to regularly create snapshots of some directories via PAR="-aP --chmod=a-w --no-owner" # Create diffshot rsync $PAR --compare-dest=$CURRENT_SNAPSHOT $SOURCE/ $DEST.changeset.incomplete ...
1
vote
0answers
207 views

Can I install a sync completion hook with rsync daemon?

Like hooks in svn or git, can I install a server-side hook script for rsync daemon? For sync completion event. I am using FreeBSD9/rsyncd.
1
vote
0answers
457 views

Rsync daemon intrepreting parameters as command in rsync.conf

I meshed up with my rsync on linux. When I am restating it, its showing me following error: sudo /etc/init.d/rsync restart /etc/rsyncd.conf: line 13: [ftp]: command not found /etc/rsyncd.conf: line ...
1
vote
0answers
215 views

BackupPC can't finish backup

I'm trying to backup /etc/ directory on CentOS 5.2 using BackupPC. It takes several hours and then aborted by signal ALRM. There is a partial backup created with all data from /etc But BackupPC thinks ...
1
vote
0answers
163 views

Use rsync with closed files only

I am interested in using rsync with the --remove-source-files option. I am planning on pointing it to a directory, with a command like: rsync -avm --remove-source-files --include='*.dat' -f 'hide,! ...
1
vote
0answers
83 views

Is there any rsync parameter for show at the end the changes made?

I have a script that sync (mirror mode) four folders between two disks. While it is running it shows the directory where it is in this very moment, and at the end it shows bytes sent, speed, etc. I'm ...
1
vote
0answers
108 views

Running rsync as a daemon for a local transfer

My coworker is trying to talk me into running rsync as a daemon on my EM server. I'm currently using rsync to copy a NFS share on my storage cluster to USB external drives so the data can be reviewed ...
1
vote
0answers
660 views

ssh: “Error reading response length from authentication socket”

I have a Makefile with some ssh and rsync commands. All of them are executed correctly, but give the following error message: Error reading response length from authentication socket. I don't like ...
0
votes
0answers
32 views

rsync question about a directory

I went ahead and used rsync to back up a root directory called /files my exact commands werersync -avzh /files willc66@server.com:/backup, inside my /files directory I had 2 sub directories home and ...
0
votes
0answers
23 views

rsync unexpected EOF in read_timeout

I'm trying to rsync directories from server A to server B, but i get the following error: permission denied unexpected EOF in read_timeout Command is: rsync -avzn ${LOCAL_DIR} ...
0
votes
0answers
22 views

Restore from incremental backup?

I read some books which use dump and restore. They said that during restore, first restore the latest full backup, and then restore each incremental backup created after the full backup. But I am ...
0
votes
0answers
26 views

Rsync Issue (AWS EC2)

I have spent quite a bit of time trying to Rsync from a remote to a local machine but been having issues with finding the synced files apparently. The command I entered is: sync -avzhe ...
0
votes
0answers
103 views

rsync does not return on error

I am running a backup script from a udev rule. The script mounts and copies data to a newly connected USB drive, with help of rsync. # Mounting stuff MOUNTPOINT=/media/backup export ...
0
votes
0answers
49 views

rsync --delete doesn't delete all files

This is the script I have so far rsync -avz -e ssh --delete /tftp/ username@192.168.1.51:/tftp/ I want it to completely copy every directory/file in /tftp/ and overwrite everything in the ...
0
votes
0answers
44 views

rsync rules to only sync specific sub-dirs in long paths

I'm trying to perform complex rsync include/excludes to backup only the following within the /home/x dir: Recursively all files/dirs in Documents Recursively all files/dirs in ...
0
votes
0answers
1k views

@ERROR: chdir failed but directory exists

I have a D-Link DNS-320 and I've installed FFP and I'm trying to get rsync running on it. So far I've got the daemon up and running and I've defined a module in my rsyncd.conf like so: max ...
0
votes
0answers
149 views

Script to compare directories and move files (like rsync)

I use rsync to sync data between two servers. If I completely rebuild the directory structure, rsync cannot understand this and will attempt to recopy everything. I am aware that Unison is capable ...
0
votes
0answers
139 views

Use Rsync with HTTP

Is it possible to use rsync with an HTML POST request? If so what would the rsync command look like? For example let's say using HTML5 I have this (bear with me going back to linux stuff): <form ...
0
votes
0answers
276 views

Why I can't pass ip to rsync script?

I am writing script were rsync should be called and ask for password. However I cannot pass IP as argument. I think I am missing something simple. Any ideas? Even trivial script like this just outputs ...
0
votes
0answers
82 views

rsync include-from exlcude-from with including subdir but excluding dirs above

I try to use rsync with --include-from and --exclude-from options. I have a directory structure like: /docs/domain-[a-z]/templates Now I want to sync templates only if something is in there. Further ...
0
votes
0answers
176 views

Rsync seems to back up files that haven't been opened or changed

I have started using rsync to back some data on my mac to an external HD. It works really well, but I have noticed something odd. Every time I run the command, I get a list of files that haven't been ...