rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

6
votes
2answers
20k views

How to force overwrite non-empty directories using `mv`

I am wanting to move (not just copy) a group of files/directories to a different directory some of which have name clashes with files/directories in the target directory. My main objective is to move ...
6
votes
2answers
32k views

Why do I get an “rsync: failed to set times on … : Operation not permitted (1)” error on Ubuntu 10.10 with SME Server 7.4? [duplicate]

I am trying to cron an rsync via ssh between two fileservers that are running SME Server 7.4 and Ubuntu 10.10, respectively. The first rsync worked just fine (for reasons that I do not know), but now, ...
5
votes
3answers
2k views

Performing accurate snapshot and incremental backups to a remote server

I have a few Ubuntu (and potentially RHEL) servers I'd like to back up to a central backup server (via rsh/SSH). I'd like to do both snapshot and incremental backups. The goal is that if one of the ...
4
votes
4answers
2k views

The most *robust* remote file copy?

How would I go about to copy files over a very unstable internet connection? Sometimes, the connection is lost, other times the IP of one machine or the other machine is changed, sometimes both, ...
4
votes
1answer
225 views

Should the key for an automatically running cron job that runs over ssh not have a passphrase?

I'm reading an article in Master Linux Now 2013 called OpenSSH: Easy Logins and it uses ssh-agent to allow you to enter a passphrase for your key once, and then you're able to connect to a remote ...
2
votes
1answer
2k views

rsync is deleting excluded file

I'm having trouble excluding a file from rsync. The file in question is a configuration file that is specific to the machine it's on, so I have one version on my dev machine, and another on the ...
2
votes
1answer
94 views

why rsync does not do delta transfer

I have binary file which has approx 77MB: nupic@nupic-virtualbox:~/VboxSharedFolder/experiments/sync/exp2$ ls -lah src/ total 77M drwxrwx--- 1 root vboxsf 0 Jun 21 13:31 . drwxrwx--- 1 root vboxsf ...
2
votes
2answers
4k views

How to copy large files over the network

I need to copy large files over the network, but I am not sure about the command line to use for it. I have been using rsync, but I feel maybe I could zip the files first? I am a Unix beginner, so ...
1
vote
1answer
643 views

rsync and xfr#1, to-chk=0/1, what do they mean?

I do stuff such as :- $ copy debian-8.2.0-amd64-DVD-1.iso /media/shirish/4719-38E5/ Copy here is an alias for :- $ alias copy alias copy='rsync --progress -ravz' When it does the command it ...
1
vote
2answers
1k views

How do I use my own local text editor to modify system (requires root to save) files on a remote system?

I've recently fallen in love with github's Atom text editor, and I enjoy using it for all my local coding and configuration. I started to maintain a Nagios installation for several dozen servers and ...
1
vote
1answer
2k views

rsync command to backup home tree to another disk

I want to make sure I am using the correct rsync command on Linux. I do not want to run an rsync and end up losing data as I am new to Linux and I have no backup now. On Linux Mint, I want to backup /...
4
votes
2answers
3k views

Rsyncing files with special characters to USB FAT32

I want to copy a large number of files to a USB drive that is formatted FAT32 (and cannot be formatted anything else, unfortunately). Many of these files have names with characters such as : and ? ...
4
votes
1answer
565 views

rsync's relationship with special files

I'm trying to transfer some existing backups from one system to another. The older backup system seems to have managed to back up special files like /dev/hda, /dev/tty0, and /dev/null which look like ...
4
votes
1answer
1k views

How to recursively synchronize file timestamps across servers?

Suppose I run an rsync command to mirror a server, but forget to supply the -t option. The mirror will now have different timestamps to the original. What is the easiest way to fix this, without ...
4
votes
3answers
1k views

from a sparse file to a block device over the network

If I have a sparse file representing a block device, then how can I efficiently restore the file over a network? Ideally, I'd use rsync -S host:file /dev/sdb, but rsync won't write to block devices. ...
3
votes
4answers
1k views

Most Efficient way to back up/sync large directories over SSH

I'm looking to back up some large directories on a Dedicated Server to another Server on a daily basis using minimal bandwidth RSync looks like its up to the task but I'm unsure of the best command ...
3
votes
1answer
59 views

rsync selected subdirectories only

I want to rsync a part of my music library from external drive to my audio player. Generally speaking, say, there is a $source and $target directories, and a text file $subdirs with a list of sub-...
3
votes
1answer
5k views

Configuring anonymous rsync daemon

EDIT: I have since found that by using a folder in the root directory, things get a bit further - I can list the subfiles. So it really looks like permissions on the folder are the issue. I'm not ...
3
votes
2answers
71 views

How to make ssh account capabele to only sshfs and rsync?

I'd like to make ssh account that is capable of doing two things: mounting (can be one) directory via sshfs performing backup&recovery of his/her desired directories using rsync I would love ...
2
votes
2answers
158 views

pipe ls and awk to rsync

Trying to complete a script with the following steps: (1) select 1gig of most recently changed files across a number of subdirectories (2) preferably uses rsync to copy the files to local directory -- ...
2
votes
1answer
121 views

Unable to well understand Rsync with include and exclude patterns

First of all, I really read a lot about this topic (including Rsync filter: copying one pattern only), but I still don't understand, or I have a problem with my installation... My structure "from" is ...
2
votes
3answers
912 views

Smarter filetransfers than rsync? [closed]

I have a large file (2-3 GB, binary, undocumented format) that I use on two different computers (normally I use it on a desktop system but when I travel I put it on my laptop). I use rsync to transfer ...
1
vote
1answer
1k views

RYSNC over SSH not working for restricted shell

I need to give access to some Mr X in my production server so that he can push files to my server. Since there is no necessity to give him shell access , I decided to use restricted shell (rssh) so ...
1
vote
1answer
733 views

How to let rsync additionally store an differential changelog in another directory?

I'm using rsync --link-dir to obtain daily snapshots with little space usage due to the hardlinking. It would however be nice to also have a directory that, while mirroring the original structure, ...
1
vote
1answer
2k views

Why are there multiple rsync threads?

I use a single rsync program to backup a file system. by ps, I find there are four rsync threads or processes, two in R state (running) and two in S state (suspended?): $ ps aux | grep rsync root ...
1
vote
0answers
160 views

Absolute path in rsync dry-run statistics

I have executed following command in order to get the list of files that would be transferred to remote server if rsync is executed: rsync -avzm --stats --safe-links --ignore-existing --dry-run --...
1
vote
1answer
121 views

rsync: show when newer file on destination is to be overwritten

I'm running a command that updates some files to a centralized server. The command does first a --dry-run to show which files will be transferred. It may happen that a newer file on server may have to ...
1
vote
1answer
157 views

configuring rsync for incremental backup and recovery

The setup is a NAS box on a lan mounted as NFS and the source is a laptop running an old kubuntu 10.4. Rsync has to be run as a local file copy, NAS box doesn't support an rsync daemon. How do I ...
1
vote
1answer
685 views

Caching write changes on SSD to avoid HDD spin-up? ZFS, but (probably) not L2ARC

I have a home server, which - between other things - stores my documents, mail archives etc.. It uses a ZFS RAIDZ, based on spinning hdds. The server also runs an off-line IMAP service, synchronizing ...
0
votes
2answers
275 views

How to detect particular system call called or not in a whole workflow?

EDIT No. 1 My task is mirroring , i.e., copying updated data from master server to all mirrors, by using rsync and rsh. But during rsync and rsh, I found some delay. My thinking is , the reason for ...
0
votes
1answer
798 views

ZFS backup advice with another server

I currently have two servers both have the exact same hardware, disks, etc. One server (server1) is going to be the "main" server. It's basically a server with raidz2 that has SMB shares on it that ...
0
votes
2answers
585 views

How to backup /etc/{,g}shadow files with 0000 permission?

I am trying to backup several servers' /etc by using rsync from another server. Here's a relevant snippet: PRIVKEY=/path/to/private.key RSYNC_OPTS="--archive --inplace --no-whole-file --quiet" ssh -n ...
0
votes
1answer
1k views

rsync with absolute paths and excluding subpaths

Say I have the following structure on path origin_path origin_path/X=1/A/... origin_path/X=1/B/... origin_path/X=1/C/... ... origin_path/X=2/A/... origin_path/X=2/B/... origin_path/X=2/C/... ... ... ...