rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

5
votes
3answers
2k views

Performing accurate snapshot and incremental backups to a remote server

I have a few Ubuntu (and potentially RHEL) servers I'd like to back up to a central backup server (via rsh/SSH). I'd like to do both snapshot and incremental backups. The goal is that if one of the ...
4
votes
4answers
2k views

The most *robust* remote file copy?

How would I go about to copy files over a very unstable internet connection? Sometimes, the connection is lost, other times the IP of one machine or the other machine is changed, sometimes both, ...
4
votes
1answer
202 views

Should the key for an automatically running cron job that runs over ssh not have a passphrase?

I'm reading an article in Master Linux Now 2013 called OpenSSH: Easy Logins and it uses ssh-agent to allow you to enter a passphrase for your key once, and then you're able to connect to a remote ...
2
votes
1answer
55 views

why rsync does not do delta transfer

I have binary file which has approx 77MB: nupic@nupic-virtualbox:~/VboxSharedFolder/experiments/sync/exp2$ ls -lah src/ total 77M drwxrwx--- 1 root vboxsf 0 Jun 21 13:31 . drwxrwx--- 1 root vboxsf ...
2
votes
1answer
2k views

rsync is deleting excluded file

I'm having trouble excluding a file from rsync. The file in question is a configuration file that is specific to the machine it's on, so I have one version on my dev machine, and another on the ...
2
votes
2answers
3k views

How to copy large files over the network

I need to copy large files over the network, but I am not sure about the command line to use for it. I have been using rsync, but I feel maybe I could zip the files first? I am a Unix beginner, so ...
1
vote
2answers
1k views

How do I use my own local text editor to modify system (requires root to save) files on a remote system?

I've recently fallen in love with github's Atom text editor, and I enjoy using it for all my local coding and configuration. I started to maintain a Nagios installation for several dozen servers and ...
1
vote
2answers
625 views

How can i keep the mtime of files and directories when I use rsync or cp? For use in Backup/Incremental Backup

I have a new NAS box and after looking through numerous backup solutions I've found doing it manually through PuTTy to work the best. After logging in to the box through PuTTy as root, I first need ...
1
vote
1answer
1k views

rsync command to backup home tree to another disk

I want to make sure I am using the correct rsync command on Linux. I do not want to run an rsync and end up losing data as I am new to Linux and I have no backup now. On Linux Mint, I want to backup /...
1
vote
1answer
593 views

rsync and xfr#1, to-chk=0/1, what do they mean?

I do stuff such as :- $ copy debian-8.2.0-amd64-DVD-1.iso /media/shirish/4719-38E5/ Copy here is an alias for :- $ alias copy alias copy='rsync --progress -ravz' When it does the command it ...
7
votes
1answer
2k views

Understanding the output of --info=progress2 from rsync

If I run rsync with --info=progress2, I get an output like 105.45M 13% 602.83kB/s 0:02:50 (xfr#495, ir-chk=1020/3825) But what do the single numbers mean? I haven't found a matching entry ...
4
votes
1answer
1k views

How to recursively synchronize file timestamps across servers?

Suppose I run an rsync command to mirror a server, but forget to supply the -t option. The mirror will now have different timestamps to the original. What is the easiest way to fix this, without ...
4
votes
3answers
1k views

from a sparse file to a block device over the network

If I have a sparse file representing a block device, then how can I efficiently restore the file over a network? Ideally, I'd use rsync -S host:file /dev/sdb, but rsync won't write to block devices. ...
4
votes
1answer
502 views

rsync's relationship with special files

I'm trying to transfer some existing backups from one system to another. The older backup system seems to have managed to back up special files like /dev/hda, /dev/tty0, and /dev/null which look like ...
3
votes
4answers
1k views

Most Efficient way to back up/sync large directories over SSH

I'm looking to back up some large directories on a Dedicated Server to another Server on a daily basis using minimal bandwidth RSync looks like its up to the task but I'm unsure of the best command ...
3
votes
2answers
58 views

How to make ssh account capabele to only sshfs and rsync?

I'd like to make ssh account that is capable of doing two things: mounting (can be one) directory via sshfs performing backup&recovery of his/her desired directories using rsync I would love ...
3
votes
1answer
58 views

rsync selected subdirectories only

I want to rsync a part of my music library from external drive to my audio player. Generally speaking, say, there is a $source and $target directories, and a text file $subdirs with a list of sub-...
3
votes
2answers
2k views

Rsyncing files with special characters to USB FAT32

I want to copy a large number of files to a USB drive that is formatted FAT32 (and cannot be formatted anything else, unfortunately). Many of these files have names with characters such as : and ? ...
3
votes
1answer
5k views

Configuring anonymous rsync daemon

EDIT: I have since found that by using a folder in the root directory, things get a bit further - I can list the subfiles. So it really looks like permissions on the folder are the issue. I'm not ...
2
votes
1answer
121 views

Unable to well understand Rsync with include and exclude patterns

First of all, I really read a lot about this topic (including Rsync filter: copying one pattern only), but I still don't understand, or I have a problem with my installation... My structure "from" is ...
2
votes
2answers
153 views

pipe ls and awk to rsync

Trying to complete a script with the following steps: (1) select 1gig of most recently changed files across a number of subdirectories (2) preferably uses rsync to copy the files to local directory -- ...
1
vote
1answer
2k views

Why are there multiple rsync threads?

I use a single rsync program to backup a file system. by ps, I find there are four rsync threads or processes, two in R state (running) and two in S state (suspended?): $ ps aux | grep rsync root ...
1
vote
0answers
153 views

Absolute path in rsync dry-run statistics

I have executed following command in order to get the list of files that would be transferred to remote server if rsync is executed: rsync -avzm --stats --safe-links --ignore-existing --dry-run --...
1
vote
1answer
994 views

RYSNC over SSH not working for restricted shell

I need to give access to some Mr X in my production server so that he can push files to my server. Since there is no necessity to give him shell access , I decided to use restricted shell (rssh) so ...
1
vote
1answer
97 views

rsync: show when newer file on destination is to be overwritten

I'm running a command that updates some files to a centralized server. The command does first a --dry-run to show which files will be transferred. It may happen that a newer file on server may have to ...
1
vote
1answer
152 views

configuring rsync for incremental backup and recovery

The setup is a NAS box on a lan mounted as NFS and the source is a laptop running an old kubuntu 10.4. Rsync has to be run as a local file copy, NAS box doesn't support an rsync daemon. How do I ...
1
vote
3answers
809 views

Smarter filetransfers than rsync? [closed]

I have a large file (2-3 GB, binary, undocumented format) that I use on two different computers (normally I use it on a desktop system but when I travel I put it on my laptop). I use rsync to transfer ...
1
vote
1answer
676 views

Caching write changes on SSD to avoid HDD spin-up? ZFS, but (probably) not L2ARC

I have a home server, which - between other things - stores my documents, mail archives etc.. It uses a ZFS RAIDZ, based on spinning hdds. The server also runs an off-line IMAP service, synchronizing ...
1
vote
1answer
726 views

How to let rsync additionally store an differential changelog in another directory?

I'm using rsync --link-dir to obtain daily snapshots with little space usage due to the hardlinking. It would however be nice to also have a directory that, while mirroring the original structure, ...
0
votes
1answer
762 views

ZFS backup advice with another server

I currently have two servers both have the exact same hardware, disks, etc. One server (server1) is going to be the "main" server. It's basically a server with raidz2 that has SMB shares on it that ...
0
votes
2answers
269 views

How to detect particular system call called or not in a whole workflow?

EDIT No. 1 My task is mirroring , i.e., copying updated data from master server to all mirrors, by using rsync and rsh. But during rsync and rsh, I found some delay. My thinking is , the reason for ...
0
votes
2answers
582 views

How to backup /etc/{,g}shadow files with 0000 permission?

I am trying to backup several servers' /etc by using rsync from another server. Here's a relevant snippet: PRIVKEY=/path/to/private.key RSYNC_OPTS="--archive --inplace --no-whole-file --quiet" ssh -n ...
0
votes
1answer
1k views

rsync with absolute paths and excluding subpaths

Say I have the following structure on path origin_path origin_path/X=1/A/... origin_path/X=1/B/... origin_path/X=1/C/... ... origin_path/X=2/A/... origin_path/X=2/B/... origin_path/X=2/C/... ... ... ...