rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

2
votes
3answers
5k views

Parallelise rsync using GNU Parallel

I have been using a rsync script to synchronize data at one host with the data at another host. The data has numerous small-sized files that contribute to almost 1.2TB. In order to sync those files, ...
0
votes
1answer
6 views

rsync fails/hangs when copying from a Linux ext4 to a FreeBSD ZFS (via SSH)

When I try to copy directories from an ext4 on Linux to a ZFS on FreeBSD (via SSH), rsync immediately fails without copying anything: # rsync -haxHAX /mnt/source/ root@lethe:/mnt/dest/ -vvv opening ...
3
votes
2answers
34 views

How to copy just timestamps, or “I should have used cp -p”

I foolishly copied a very large amount of data using cp -r. Looking at it now, I've realized that this means I lost my file modification times. I should have used cp -rp. My directory structure and ...
2
votes
1answer
35 views

Transfer Size limit for SCP, SFTP, RSYNC?

Is there a maximum size limit to the size of collective size of the files that are to be transferred in one go for the above protocol. My intent is to know if for example after 1 GB any of these ...
2
votes
0answers
20 views

Sync with Onedrive

I would like to sync (and backup) my /home directory with OneDrive. I found some great terminal clients, where you can even mount your directory, but nowhere did I found an option to this with some ...
2
votes
2answers
18k views

rsync: error starting client-server protocol

I have rsyncd running on both the systems . When I am trying to check the connection it giving me following error: From host2: user@host2#rsync username@host1::share password: [password] ...
0
votes
1answer
18 views

help with rsync (with samba) and ignoring perm/time/group/owner

so this is what I'm trying to use: rsync -DHilrv --delete --progress /my-local-drive/ /my-network-share/ I've run the command above. After the operation was complete, I ran it again but this time I ...
7
votes
1answer
1k views

Understanding the output of --info=progress2 from rsync

If I run rsync with --info=progress2, I get an output like 105.45M 13% 602.83kB/s 0:02:50 (xfr#495, ir-chk=1020/3825) But what do the single numbers mean? I haven't found a matching entry ...
1
vote
2answers
284 views

lsyncd: Is it possible to sync individual files from a list?

I want to sync certain files from one linux system to another using lsyncd. The files are not confined to one directory, neither do I want all files from a directory. Specifically I'm trying to make ...
1
vote
1answer
35 views

How to rsync files between two remotes with an explicit port and different usernames?

I want to rsync files between two remote servers. I tried to follow the next solution of @roaima: http://unix.stackexchange.com/a/183516/137526, but I need a more delicate solution, for two reasons: ...
1
vote
2answers
25 views

Differences between rsync on remote and rsync local on mounted sshfs?

Is there any difference if I run rsync with remote host (ssh://) as source/destination or use local path to share mounted directory via sshfs? Could there be differences be with regards to security ...
0
votes
1answer
9 views

Rsync --dry-run not showing correct sent bytes

I'm trying to use rsyn with the --dry-run option to see if there is enough space for the real synchronization. For test purposes I'm trying to synchronize one directory Documents. The size of the ...
4
votes
1answer
220 views

How do you give a developer group access to apache, MySQL, php and the webroot?

We have 3 web designers that are currently logging in to our server via root to configure apache and setup websites. I have very basic linux knowledge (I'm a web designer) and have created users and ...
0
votes
1answer
26 views

rsync options to transfer big tgz files to zfs filesystem and snapshot later

I need transfer everyday a lot of compressed tar files from a hosting server to a zfs data storage server. The standard way to rsync transfer seems to not zfs snapshot friendly. Each snapshot keep ...
1
vote
1answer
25 views

rsync on AIX gives popt The module has an invalid magic number error

[SERVER:root:/home/user:] rsync -avz --delete ... Could not load program rsync: Dependent module /opt/freeware/lib/libpopt.a(libpopt.so.0) could not be loaded. The module has an invalid magic ...
0
votes
2answers
39 views

One shell script to perform commands locally and remotely

So, here's the problem. I have a file on a remote machine available only to root, and a private-key-only no-root SSH access(I do have sudo though). I need to copy that file to the local machine, and ...
1
vote
2answers
61 views

rsync transfers unmodified files, why? [closed]

I have three servers A,B,C. A and B share a drive via nfs on A, and C is the UAT server where all changes have been made. After a successful change it transferred to server A via rsync. Earlier it was ...
3
votes
1answer
20 views

how do I exclude a specific folder on the destination when using rsync?

consider the following example: /source /source/folder1 /source/folder2 /source/folder3 /destination /destination/folder2 /destination/folder3 /destination/folder3/mytestfolder1 ...
1
vote
1answer
40 views

Migrating mounts with identical permissions not working

I have two mounts /mount1 and /mount2. I ran the command: rsync -azrt /mount1/* /mount2/ to clone everything from /mount1 to /mount2. I then altered the /etc/fstab (see below) to remove /mount1 ...
0
votes
2answers
30 views

NTFS compression and RSync

I currently have a hard drive that I backup using RSync. I do weekly; monthly snapshots. I would like to compress some of my hard drive using NTFS compression. How would that affect my future ...
5
votes
2answers
809 views

Is there a way to put comments in an rsync --files-from file?

I have a file that rsync uses as --files-from: dir1 dir2 dir3 I want to be able to put comments above each dir entry like that: # my dir1 comment dir1 #dir2 comment dir2 #yet another comment ...
31
votes
4answers
43k views

Specify identity file (id_rsa) with rsync

I need to make periodic backups of a directory on a remote server which is a virtual machine hosted by a research organisation. They mandate that access to VMs is through ssh keys, which is all good, ...
3
votes
4answers
67 views

du --exclude directories - is this possible?

How to calculate disk usage of a file tree but excluding directories. I'd like to have something like: du --exclude type d I use rsync to mirror/backup part of my home dir and I want to double ...
11
votes
5answers
9k views

How do you compare two folders and copy the difference to a third folder?

You've got three folders: folder current, which contains your current files folder old, which contains an older version of the same files folder difference, which is just an empty folder How do ...
0
votes
1answer
25 views

rsync wants to resend files after a recent run

I am using rsync to keep two directories in sync. Specifically I ran: rsync -avz /path/to/src /path/to/dest After this command finished, I ran: rsync --dry-run -avz /path/to/src /path/to/dest ...
0
votes
1answer
22 views

How shall I rsync changes in directory structure without actually recopying

I had the folder structure as below ./a/b/c_file synced to the destination ./a/b/c_file Now I changed the structure in source as ./a/d/e/c_file. But rsync seems to be delete the old directory ...
1
vote
0answers
15 views

How to reconfigure grub on a backed up arch linux on a USB flash disk

i managed to back up my arch linux suing rsync : # rsync -aAXv --exclude={"/dev/*","/proc/*","/sys/*","/tmp/*","/run/*","/mnt/*","/media/*","/lost+found"} / /run/media/username/archlinux edited ...
1
vote
1answer
1k views

rsync “Permission denied” despite ownership

I just rsync'd a bunch of files, from a Windows box running cygwin sshd, to a CentOS 6.4 box. I ran rsync -e sshd... on CentOS to do this. Then I plugged in a USB drive on the CentOS box, formatted ...
5
votes
2answers
5k views

How to examine the fast output of rsync

I am using rsync for backup about 100GB files and directories. My command is sudo rsync -azvv /home/path/folder1/ /home/path/folder2 However, the output for each file goes up so quickly and there ...
1
vote
1answer
2k views

rsync error: Time value of file truncated on receiver

I run the following rsync command to back up my data. I am on Ubuntu 12.04. rsync -rt --delete --links --exclude-from '/home/john/rsync-exclude.txt' /media/data/ server:/backup/data The data ...
0
votes
1answer
627 views

rsync “unknown module” error [duplicate]

I use rsync for backing up the data from servers to a backup machine. For that purpose I start bash scripts via cronjobs but one of them is not working. I searched through the web to see if there is a ...
37
votes
4answers
26k views

Does rsync verify files copied between two local drives?

I want to make a fresh new copy of a large number of files from one local drive to another. I've read that rsync does a checksum comparison of files when sending them to a remote machine over a ...
0
votes
1answer
34 views

rsync files that are in remote directory's subfolder

I have an old copy of the remote folder (FD) user@IP:/folder1/folder2/folder3/FD/ which has subfolders fol1, fol2, ..., user@IP:/folder1/folder2/folder3/FD/ |__fol1 ...
1
vote
2answers
30 views

How to tell rsync not to delete some folders at destination?

So I use pelican for writing my blog and I upload the whole thing using rsync. OK. But I use also Let's Encrypt and therefor need the repository .well-known preserved at the root of my website. So ...
3
votes
2answers
50 views

How to make ssh account capabele to only sshfs and rsync?

I'd like to make ssh account that is capable of doing two things: mounting (can be one) directory via sshfs performing backup&recovery of his/her desired directories using rsync I would love ...
0
votes
1answer
28 views

Automating Backup and Shutdown

I want to backup my entire internal hard drive files into an external hardrive and execute system shutdown once the backup is finished. The reason why I want to do that is to execute the backup during ...
0
votes
1answer
42 views

rsync over ssh without typing the password each time [duplicate]

I got a bash script to synchronize data between two computers. It works fine but I have to type my password every time the rsync command is called. #!/bin/bash sourceIP="192.168.178.128" ...
63
votes
6answers
65k views

scp without replacing existing files in the destination

How do I copy an entire directory into a directory of the same name without replacing the content in the destination directory? (instead, I would like to add to the contents of the destination folder) ...
11
votes
1answer
27k views

how to tell rsync to preserve time stamp on files when source tree has a mounted point

Related to this question Short description of the problem: When source tree has a mounted point inside it, then time stamps on files inside that mounted point when copied to target tree are not ...
3
votes
2answers
1k views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
2
votes
2answers
29 views

RAID1 vs rsync - security?

I'm setting up a NAS-Server using an Odroid XU4 and two 2TB HDDs. Which setup would be more secure (lower risk of losing data / easier recovery): setup a RAID1 with mdadm have two separate devices, ...
1
vote
2answers
118 views

Looking for rsync+ssh-based method as alternative to Dropbox

I want to set up a personal (i.e. one user) Dropbox alternative using rsync, to keep some directories synchronized over several Unix hosts. Since only one user (namely, me) will be changing the ...
2
votes
1answer
2k views

rsync specific directories

Below are the directories of my directory structure. I only want to run rsync on the content under the archive directory of any subdirectory and exclude everything else: ./ ap/ ap/aploader/ ...
3
votes
1answer
46 views

Stopping rsync without leaving temporary files behind

When copying files from directory A to B with rsync using $ rsync -a --backup --suffix=.$(date +"%Y%m%d%H%M%S") A/ B/ a file called filename in A will temporarily be called something on the form ...
1
vote
1answer
42 views

Allow the restricted rsync (rrsync) script for arbitrary directories with authorized_keys

Automating Backups I would like to implement a backup solution with copies data from various directories from a Web server (WebServer) to a local backup server (BackupServer). The backup should run ...
1
vote
2answers
46 views

Backup with rsnapshot only if there are changes

I use rsnapshot to make regular backups of my systems' filesystems to a remote server. (For those familiar with rsync but less used to rsnapshot here is a brief introduction to its workings. A backup ...
1
vote
4answers
229 views

Bash command help to “search and replace” file in changing directory tree

The Scenario: I've built a collection of files for research in a central repository on my server. I'm continually curating the repo changing the directory's tree structure by renaming and moving ...
19
votes
5answers
18k views

view stdout for another pts [duplicate]

Here is the situation. I left my pc at home doing an rsync from a 2TB hard drive to another 2TB hard drive (it's going to take a while since they are both USB 2.0). I am now at work and I have ssh-ed ...
1
vote
0answers
48 views

Does a file move operation over SAMBA preserve the inode number?

If I have a directory exposed over a SAMBA share and a user, from either a Linux or Windows system, moves a file from one place to another on that share, does SAMBA know to ask the operating system ...
0
votes
1answer
34 views

Invoke rsync with specific defaults for current folder?

I have a local folder which I want to synchronize with a remote folder through SSH, and I'd like to do it through rsync. I would always call rsync with the same arguments, and same source and ...