rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

0
votes
1answer
34 views

Rsync to copy specific subfolders and files to new directory

Original path, RootFolderI: RootFolderI/FolderA/Subfolder1/Subsub1/JPG1.jpg -> want this jpg RootFolderI/FolderA/Subfolder2/Subsub1/JPG2.jpg -> want this jpg RootFolderI/FolderA/Subfolder2/...
0
votes
1answer
28 views

Rsync with destination owner and permission possible?

Source server have one owner is root. ----/home/sub1/test1 ----/home/sub2/test1 My local machine is destination. ----/home/sub1/test1 owner by user1 ----/home/sub2/test1 owner by user2 How I ...
2
votes
1answer
44 views

why rsync does not do delta transfer

I have binary file which has approx 77MB: nupic@nupic-virtualbox:~/VboxSharedFolder/experiments/sync/exp2$ ls -lah src/ total 77M drwxrwx--- 1 root vboxsf 0 Jun 21 13:31 . drwxrwx--- 1 root vboxsf ...
0
votes
0answers
24 views

Does changing your OS (fedora>OpenSuse) or FS (ext4>btrfs) “break” rsync?

I am using a rather simple script to do incremental backups of my laptop to my external HDD's, where the core line is probably the following: rsync -arbuv --delete --progress -exclude-from=/backup-...
1
vote
1answer
20 views

copy_only_missing? - Copy from /A to /C only paths missing on /B and /C - concise way

I'd like to copy from /A to /C only paths missing on /B and /C. (Please assume those are paths, and can represent also remote locations e.g. mounted via sshfs) I wonder... Is there more concise way ...
2
votes
0answers
19 views

flock command wont run through cron [duplicate]

I am trying to cron an rsync sync over ssh, but for some reason, as soon as I put the command in cron, it won't run. I don't know what is causing it to break, but it is certainly something related to ...
-1
votes
2answers
46 views

rsync --link-dest not working as expected with symlinks

I'm using rsync to backup some of my files: rsync -aEN --delete --link-dest="$CURR/" "$SOURCE/" "$NEW/" The --link-dest option works fine with most files, but not with symlinks. When I was writing a ...
1
vote
0answers
18 views

rsync no matching key exchange found

I am trying to use rsync to send a file to a remote device on my network. I can SSH into the device just fine, but trying to use rsync gives no matching key exchange found. Their offer: diffie-...
0
votes
1answer
14 views

Download with rsync through bastion/jumper, without .ssh/config changes

I'd like to download a file from server C, through server B (bastion) to my local server A. Normally I'd handle the mess in ssh/config with ProxyCommand, but in this case I can't. Can we make a one-...
0
votes
1answer
39 views

Using Rsync include and exclude options to include directory and subdirectory but exlude files in subdirectory

I'm wondering if my scenario can actually be handled with rsync. Rsync working fine between my local and my remote. htdocs/ folderswithfilesIneed/ somefilesandfolders.jpg afolder/ ...
1
vote
1answer
17 views

Rsync files-from problem

rsync -av --files-from=list.txt A/* B/ Inside the list.txt I have A/text1.txt When executing the command, I get an error refering me to the man page, does anyone know why? Please see the rsync(1)...
0
votes
1answer
32 views

Use of Verbose in a cron job

I'm busy setting up a back-up script to run on my Pi using rsync. I see that a number of people use the -v option in their cron jobs. Why? It's going to be run as root, and not in a terminal where ...
1
vote
3answers
45 views

rsync not overwriting newer files [closed]

Replication details: mkdir test && cd test mkdir folder && cd folder echo "#line1" > file rsync -a -I . .. echo "#line2" >> ../file rsync -a -I . .. Output: Content of ../...
5
votes
2answers
11 views

Can you scp, sftp, or rsync, a pipe?

I want to tar and send a ~700GiB directory to a remote drive I don't control. I don't have the HDD space locally to create the tarball and then copy that over. The remote is also protected by rssh - ...
1
vote
1answer
28 views

how to rsync certain directory and files - problem

I have looked at previous posts but cannot get this working. I want to just rsync all the server03 directories and any sub directories of them to a new server. I tried the following but it was picking ...
5
votes
0answers
98 views

Synchronising millions of files between two Linux servers

I have a server which exports a directory containing ~7 million files (mostly images) from its local disk to network clients via NFS. I need to add a second one for the sake of HA, and to keep it in ...
0
votes
0answers
97 views

Rsync freezes while copying

I'm having trouble using rsync to back-up my system locally. I'm using this short guide from the arch wiki. Here's the modified one-liner I'm using : rsync -aAX --debug=all5 --delete --modify-window=...
1
vote
1answer
26 views

rsync wants to copy files that already exist in the destination directory

I am trying the following command using rsync to copy only files that are new have a different size rsync -niav --size-only /home/me/source/Electronica /media/externalDrive/dest/Electronica ...
4
votes
2answers
168 views

SSH broken pipe, message authentication code incorrect

I have set up a Ubuntu server that I plan on using to backup my macbook air using rsync. But every time I use rsync, or even scp, the connection drops, with one of the following errors: ...
2
votes
1answer
37 views

Recursive move (`mv -rn`, like `cp -rn`), a move that will only move not present files

Context I have user uploaded content that needs to be backed up. The content is over 3 separate servers at /var/www/domain/media/ (on each server it is in the same place). The backup is a NFS ...
2
votes
0answers
37 views

Why do two directories differ after syncing with rsync?

I copied some directories on one removable drive to another removable one using rsync. The command used was: rsync -avPS <source> <destination> rsync doesn't report any errors. After ...
2
votes
1answer
37 views

Rsync files, excluding a list

I am working on setting up cron jobs,and I am new to this. The purpose is to analyze the new data that is generated.The data is present in directories. I want to sync only the latest data/that has ...
0
votes
1answer
26 views

To rsync -rtvuc in Two Filesystems?

I am newbie with rsync. Systems OS_X_Extended/Source/ FAT32/Destination/ I want to rsync everything from OSX extended to Fat32 directory and delete those files/directories which I deleted from ...
2
votes
0answers
25 views

How to make rsync delete files/folders on backup server that no longer exist on main server? [closed]

I am using this command to backup a main server to a backup server. rsync -avz --delete-after --exclude-from '/usr/order/exclude.txt' --password-file=/usr/prod/masterpass.rsync /usr/order/ order@...
1
vote
2answers
17 views

Rsync rotating logfiles

currently I have an troublesome problem. I needed quite a time for identifying this problem. Anyhow that's what I'm doing: I collect log files with rsync from multiple servers to archive them. Its ...
1
vote
1answer
28 views

rsync fails/hangs when copying from a Linux ext4 to a FreeBSD ZFS (via SSH)

When I try to copy directories from an ext4 on Linux to a ZFS on FreeBSD (via SSH), rsync immediately fails without copying anything: # rsync -haxHAX /mnt/source/ root@lethe:/mnt/dest/ -vvv opening ...
3
votes
2answers
38 views

How to copy just timestamps, or “I should have used cp -p”

I foolishly copied a very large amount of data using cp -r. Looking at it now, I've realized that this means I lost my file modification times. I should have used cp -rp. My directory structure and ...
3
votes
0answers
61 views

Sync with Onedrive

I would like to sync (and backup) my /home directory with OneDrive. I found some great terminal clients, where you can even mount your directory, but nowhere did I found an option to this with some ...
2
votes
1answer
49 views

Transfer Size limit for SCP, SFTP, RSYNC?

Is there a maximum size limit to the size of collective size of the files that are to be transferred in one go for the above protocol. My intent is to know if for example after 1 GB any of these ...
0
votes
1answer
18 views

help with rsync (with samba) and ignoring perm/time/group/owner

so this is what I'm trying to use: rsync -DHilrv --delete --progress /my-local-drive/ /my-network-share/ I've run the command above. After the operation was complete, I ran it again but this time I ...
1
vote
1answer
41 views

How to rsync files between two remotes with an explicit port and different usernames?

I want to rsync files between two remote servers. I tried to follow the next solution of @roaima: http://unix.stackexchange.com/a/183516/137526, but I need a more delicate solution, for two reasons: ...
1
vote
2answers
45 views

Differences between rsync on remote and rsync local on mounted sshfs?

Is there any difference if I run rsync with remote host (ssh://) as source/destination or use local path to share mounted directory via sshfs? Could there be differences be with regards to security ...
0
votes
1answer
25 views

Rsync --dry-run not showing correct sent bytes

I'm trying to use rsyn with the --dry-run option to see if there is enough space for the real synchronization. For test purposes I'm trying to synchronize one directory Documents. The size of the ...
0
votes
1answer
27 views

rsync options to transfer big tgz files to zfs filesystem and snapshot later

I need transfer everyday a lot of compressed tar files from a hosting server to a zfs data storage server. The standard way to rsync transfer seems to not zfs snapshot friendly. Each snapshot keep ...
1
vote
2answers
42 views

rsync on AIX gives popt The module has an invalid magic number error

[SERVER:root:/home/user:] rsync -avz --delete ... Could not load program rsync: Dependent module /opt/freeware/lib/libpopt.a(libpopt.so.0) could not be loaded. The module has an invalid magic ...
0
votes
2answers
41 views

One shell script to perform commands locally and remotely

So, here's the problem. I have a file on a remote machine available only to root, and a private-key-only no-root SSH access(I do have sudo though). I need to copy that file to the local machine, and ...
1
vote
2answers
75 views

rsync transfers unmodified files, why? [closed]

I have three servers A,B,C. A and B share a drive via nfs on A, and C is the UAT server where all changes have been made. After a successful change it transferred to server A via rsync. Earlier it was ...
3
votes
1answer
22 views

how do I exclude a specific folder on the destination when using rsync?

consider the following example: /source /source/folder1 /source/folder2 /source/folder3 /destination /destination/folder2 /destination/folder3 /destination/folder3/mytestfolder1 /...
0
votes
2answers
32 views

NTFS compression and RSync

I currently have a hard drive that I backup using RSync. I do weekly; monthly snapshots. I would like to compress some of my hard drive using NTFS compression. How would that affect my future ...
3
votes
4answers
74 views

du --exclude directories - is this possible?

How to calculate disk usage of a file tree but excluding directories. I'd like to have something like: du --exclude type d I use rsync to mirror/backup part of my home dir and I want to double ...
1
vote
1answer
44 views

Migrating mounts with identical permissions not working

I have two mounts /mount1 and /mount2. I ran the command: rsync -azrt /mount1/* /mount2/ to clone everything from /mount1 to /mount2. I then altered the /etc/fstab (see below) to remove /mount1 ...
0
votes
1answer
27 views

rsync wants to resend files after a recent run

I am using rsync to keep two directories in sync. Specifically I ran: rsync -avz /path/to/src /path/to/dest After this command finished, I ran: rsync --dry-run -avz /path/to/src /path/to/dest ...
1
vote
0answers
19 views

How to reconfigure grub on a backed up arch linux on a USB flash disk

i managed to back up my arch linux suing rsync : # rsync -aAXv --exclude={"/dev/*","/proc/*","/sys/*","/tmp/*","/run/*","/mnt/*","/media/*","/lost+found"} / /run/media/username/archlinux edited ...
0
votes
1answer
26 views

How shall I rsync changes in directory structure without actually recopying

I had the folder structure as below ./a/b/c_file synced to the destination ./a/b/c_file Now I changed the structure in source as ./a/d/e/c_file. But rsync seems to be delete the old directory ...
0
votes
1answer
34 views

rsync files that are in remote directory's subfolder

I have an old copy of the remote folder (FD) user@IP:/folder1/folder2/folder3/FD/ which has subfolders fol1, fol2, ..., user@IP:/folder1/folder2/folder3/FD/ |__fol1 ...
1
vote
2answers
48 views

How to tell rsync not to delete some folders at destination?

So I use pelican for writing my blog and I upload the whole thing using rsync. OK. But I use also Let's Encrypt and therefor need the repository .well-known preserved at the root of my website. So ...
3
votes
2answers
58 views

How to make ssh account capabele to only sshfs and rsync?

I'd like to make ssh account that is capable of doing two things: mounting (can be one) directory via sshfs performing backup&recovery of his/her desired directories using rsync I would love ...
0
votes
1answer
33 views

Automating Backup and Shutdown

I want to backup my entire internal hard drive files into an external hardrive and execute system shutdown once the backup is finished. The reason why I want to do that is to execute the backup during ...
0
votes
1answer
47 views

rsync over ssh without typing the password each time [duplicate]

I got a bash script to synchronize data between two computers. It works fine but I have to type my password every time the rsync command is called. #!/bin/bash sourceIP="192.168.178.128" sourceUser=...