rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
0answers
189 views

sync two zip archives (with minimal I/O)?

zip itself can freshen an archive to reflect the current filesystem (e.g. -FS). It only updates zip entries with outdated timestamps. Is there a tool that updates a 2.zip file so that it becomes ...
3
votes
0answers
317 views

rsync 3.1.0 is creating empty backup directories

I just noticed that there is a discrepancy between version 3.0.9 and 3.1.0 of rsync. Running the command $ rsync -a --delete --backup --backup-dir=../old source/ dest/ with version 3.1.0 gives the ...
3
votes
0answers
709 views

How to use rsync to backup large files by either appending or replacing

I am using rsync to backup some large files regularly: rsync --archive --update --append-verify [source] [destination] Most of the times, the files increase in size (like a log file), but sometimes ...
2
votes
0answers
31 views

How to keep remote directory up-to-date with local directory automatically?

Say, I have a directory A on my local machine and B on remote machine(Both are CentOS 7). I am using rsync to sync between them. But I want to track my changes on local directory and automatically ...
2
votes
0answers
23 views

Certain folders are always missing using Rsync to server

I have tried several different ways using rsync modules and ssh trying to pull my linux desktop from my freenas server and no matter how I do it, certain folders are always missing. I am trying to ...
2
votes
0answers
64 views

How to convert existing gz (gzip) files to rsyncable

I am using rsync to back up a repository that contains many gz files including many new ones each day. The rsync backup proceeds more slowly than it should because these gz files are not built with ...
2
votes
0answers
76 views

Ecryptfs problem with rsync

I use rsync to sync my files between my home laptop and my office desktop, with the -Cauvb --delete options. Recently, on my laptop, I encrypted my home directory with ecryptfs, which lives on an ...
2
votes
0answers
246 views

Estimate time or work left to finish for rsync?

When running rsync on a directory with lots of files and directories at multiple levels, can we estimate the amount of work or time to finish? the progress option only shows the progress of ...
2
votes
0answers
492 views

“ls -lh” directories reported size : Linux vs CIFS mounted drives

From a Linux box, I recently mounted a Windows share using CIFS. The intent was to "locally" use rsync to backup my Windows machine. The command line used to mount the Windows drive is something ...
2
votes
0answers
73 views

How to output rsync sent data in realtime using standard tools

I'm developing a small tool for some people who need to send files over to a server. I'd like to use rsync to a rsync deamon to do so. Is it possible to have rsync to output how much data it has ...
2
votes
0answers
298 views

Rsync - Corrupted MAC on input

Background I have a script on my NAS which is a Synology DS212J which is running on a special distro where uname -a gives me Linux DS212J 2.6.32.12 #4493 Wed Jul 16 11:37:16 CST 2014 armv5tel ...
2
votes
0answers
2k views

rsync multiple files to multiple directories

I need to move a large number of files that need to go to different directories i.e. file1.mpg to /mnt/s3/directory1/file1.mpg file2.mpg to /mnt/s3/directorya/file2.mpg file3.mpg to ...
2
votes
0answers
4k views

Occasional rsync error code 12 “Connection reset by peer (104)” from cron task that runs every 20 minutes

I have a script run by cron that rsync's various folders to a server in a different city to publish files to websites. In case it matters, the source server is within the corporate firewall and the ...
2
votes
0answers
300 views

BackupPC can't finish backup

I'm trying to backup /etc/ directory on CentOS 5.2 using BackupPC. It takes several hours and then aborted by signal ALRM. There is a partial backup created with all data from /etc But BackupPC thinks ...
2
votes
0answers
291 views

Cannot get rsync to keep source file ownership, tried many tricks

I'm trying to rsync some directories from a webserver running RHEL5 to a system running Xubuntu. I have rsync, ssh, and keys setup for the machines. I've tried everything so that when i backup from ...
1
vote
0answers
34 views

Why is my rsync slow?

I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built ...
1
vote
0answers
15 views

Does rsync\duplicity real write files on mounted storage?

I've got an external storage, which is mounted as cifs: $: mount ... //somespace/backup on /mnt/backup type cifs (rw) ... And I have write some file: $: rsync /home/user/files /mnt/backup or $: ...
1
vote
0answers
59 views

Can rsync command run using multiple cpu?

I executed this command but it took long time when checking checksum. Load average was 1.00 at all times. Can rsync command run using multiple cpu? $ rsync --checksum -av -e ssh /usr/local/xxx/* ...
1
vote
0answers
40 views

Live OS freezes while copying files

I was trying to backup many files (~10,000) from a hard drive on an OS-less notebook to an external 500 GB HDD, so I booted up the Fedora 22 Live XFCE spin using a USB, started the copy and after 5 ...
1
vote
0answers
117 views

rsync + renaming the copied files

Is it possible to change the name of the destination file (add some timestamp as a prefix) when copy is done by rsync ? For example, I can use the following command to change the name of the ...
1
vote
0answers
34 views

Exchanging huge file trees between disks

I have two 1TB disks and a huge file tree on each. Each takes up about 85% of their disk. I want to swap/exchange the trees between disks. The only spare (USB) disk that big I have is nearly full. ...
1
vote
0answers
31 views

Using rsync with the verbose option and filtering the information displayed

I am using rsync with the -a -r and -v options to copy files and directories from one server to another. This all works fine. But when I make a change, for example, to a single file on the source ...
1
vote
0answers
37 views

keep same inodes metadata with rsync or ignore metadata with du

I'm trying to synchronize two folders from a remote computer. I want to use rsync to send the folder, and du to check if the space used is identical on the remote computer. The problem is even with a ...
1
vote
0answers
40 views

How can you recover from disk corruption on a backup drive whilst maintaining all hard links?

So, I have a scenario that is similar to How to copy directories with preserving hardlinks? that I wish to use however I have corruption from the backup hardlink source. My Scenario: 1. I backup my ...
1
vote
0answers
85 views

delete .gitignored files with rsync

I often need to use rsync to synchronize a local with a possible remote directory, while ignoring exactly all the files git would ignore because of its .gitignore configuration. To do so, I am ...
1
vote
0answers
114 views

Absolute path in rsync dry-run statistics

I have executed following command in order to get the list of files that would be transferred to remote server if rsync is executed: rsync -avzm --stats --safe-links --ignore-existing --dry-run ...
1
vote
0answers
463 views

How rsync --compare-dest works

I know there's a very similar question here, but the accepted answer has nothing to do with rsync, and the OP's solution doesn't apply in my case. I'm trying to get all the updates from a CentOS ...
1
vote
0answers
252 views

Samba File Server Configuration and Sync for Redundancy

I have two boxes which I installed Samba on. For now, I have a single user that access the server, however, I need to expand as to deploy in a production network. Below is what I want to achieve. ...
1
vote
0answers
168 views

Restore from incremental backup?

I read some books which use dump and restore. They said that during restore, first restore the latest full backup, and then restore each incremental backup created after the full backup. But I am ...
1
vote
0answers
156 views

Using Rsync to SSH and Find files

Hello I am trying to use Rsync to SSH into a remote server and pull a certain type of file that has been modified within the last 24 hours. Here is what I am trying: rsync -avx --timeout=480 ...
1
vote
0answers
79 views

What folders should I exclude / not exclude when migrating a server using rsync

I've got a requirement to migrate a web server onto a fresh server (both 32 bit and Fedora 15). I'm using this guide as I've very little experience with linux, coming from a windows background. So ...
1
vote
0answers
46 views

Can I change the exclude file list while running rsync under a cron job

I am using Fedora 20, MATE desktop, zshell. I have started a cronjob to run, every evening, an incremental backup using rsync, closely following the suggestions here. After the first run yesterday, ...
1
vote
0answers
90 views

rsync daemon max connections unlimited

I'm creating a gui app to upload files to a particular place on a server. the user is able to drop files and these files are 'moved' to the server, if the file already exists, then it is only updated ...
1
vote
0answers
29 views

Using rsync, how can I know what attribute of source file differed from the dest which caused the trasfer

I heavily depend on rsync for remote data transfer and backup purposes, occasionally on different filesystem types. AFAIK rsync by default compares file size and modification timestamps to find out ...
1
vote
0answers
3k views

@ERROR: chdir failed but directory exists

I have a D-Link DNS-320 and I've installed FFP and I'm trying to get rsync running on it. So far I've got the daemon up and running and I've defined a module in my rsyncd.conf like so: max ...
1
vote
0answers
84 views

How can I limit the bandwith to a davfs-mounted cloud storage?

I need to copy approx 400 files of approx. 25 MB each to a davfs-mounted cloud storage. I have tried the following commands to limit the CPU-load and IO-load: nice -n 15 ionice -c 3 rsync -avhW ...
1
vote
0answers
28 views

After restoring a backup my permissions seem to be borked

I made a complete backup of the system with "rsync -aAXv", and set up my encryption. After restoring everything, and booting up and trying to login, openbox didn't want to start, and "startx" didn't ...
1
vote
0answers
602 views

Run multiple rsync's at once?

I'm moving over about a million of files (800GB, containing) multiple system backups. And it's only running at ~9MB at a time, often. Enough bandwidth, since it can run up to about 50MB/s. However, ...
1
vote
0answers
100 views

Delete files that are not included with `rsync --files-from`

I copy files to another location using rsync with the option --files-from. Sometimes, a file gets deleted and is not included in that list of files any more. I tried to use --delete, but that would ...
1
vote
0answers
44 views

How to efficiently create (read-only) both a snapshot and a diffshot at the same time?

I use rsync to regularly create snapshots of some directories via PAR="-aP --chmod=a-w --no-owner" # Create diffshot rsync $PAR --compare-dest=$CURRENT_SNAPSHOT $SOURCE/ $DEST.changeset.incomplete ...
1
vote
0answers
341 views

Can I install a sync completion hook with rsync daemon?

Like hooks in svn or git, can I install a server-side hook script for rsync daemon? For sync completion event. I am using FreeBSD9/rsyncd.
1
vote
0answers
575 views

Rsync daemon intrepreting parameters as command in rsync.conf

I meshed up with my rsync on linux. When I am restating it, its showing me following error: sudo /etc/init.d/rsync restart /etc/rsyncd.conf: line 13: [ftp]: command not found /etc/rsyncd.conf: line ...
1
vote
0answers
226 views

Use rsync with closed files only

I am interested in using rsync with the --remove-source-files option. I am planning on pointing it to a directory, with a command like: rsync -avm --remove-source-files --include='*.dat' -f 'hide,! ...
1
vote
0answers
89 views

Is there any rsync parameter for show at the end the changes made?

I have a script that sync (mirror mode) four folders between two disks. While it is running it shows the directory where it is in this very moment, and at the end it shows bytes sent, speed, etc. I'm ...
1
vote
0answers
133 views

Running rsync as a daemon for a local transfer

My coworker is trying to talk me into running rsync as a daemon on my EM server. I'm currently using rsync to copy a NFS share on my storage cluster to USB external drives so the data can be reviewed ...
1
vote
0answers
848 views

ssh: “Error reading response length from authentication socket”

I have a Makefile with some ssh and rsync commands. All of them are executed correctly, but give the following error message: Error reading response length from authentication socket. I don't like ...
0
votes
0answers
29 views

rsync can't update a folder that has no x permissions

I have an rsync job running in one server that keeps folders in sync. The job is running as root in one server and transferred to a backup server as normal user. In the origin server one folder ...
0
votes
0answers
18 views

lftp — continue behavior?

I have a straight forward use case that I thougth lftp could do with the --continue flag - alas it didnt work. Is it doable? - Am I missing some flags, and are there any easier way to do this with ...
0
votes
0answers
18 views

rsync : fixing Permission denied error with no rwx permission

We can see that one of our rsync jobs is failing with the following error rsync: opendir "/share/resources/0731402367/docs/quick-check/answers" failed: Permission denied (13) rsync: opendir ...
0
votes
0answers
26 views

What is the effect of rsync with -E and --chmod?

Reading through a script I came across an rsync command with the following flags: -rtlDE -c --delete-after --chmod=u+rwX,go-rwx /path/to/dir1/ /path/to/dir2/ Background: I am refactoring the ...