rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
1answer
25 views

moving a linux to another device

I am working on an embedded linux ip-camera. I need to have a backup of our Linux for testing and repairing cameras. I have tested multiple options like using tar and rsync , but it does not work and ...
1
vote
1answer
21 views

rsync to backup and delete remote files [on hold]

I have to cleanup some space on the server where we have 23 GB of audio files stored in data directory. I want to take the backup of that audio recordings on my local system and then delete those ...
1
vote
0answers
33 views

Proper way to create a compressed, rsyncable mirror of a directory?

I would like to create a compressed mirror of some directories in such a way that it can be rsynced again, both from the original destination and to a remote destination. I can do it inefficiently in ...
4
votes
3answers
56 views

Is there a way to send custom arguments to an rsync server?

I have a backup server that clients use with rsync over SSH. The server is configured to run a custom shell script that wraps the invocation of the rsync server side. The client side is unaware of ...
1
vote
0answers
22 views

Rsync link-dest - unsure if its creating hard links

This is my first attempt at a shell script. I'm simply trying to make incremental copies of certain folders from a server to another server using Rsync, but using the link-dest option to create ...
2
votes
1answer
56 views

How can I mount encrypted folder via SSH in Synology NAS?

Now I mount an encrypted folder: open browser and login to NAS gui click Control panel -> Shared Folder > Encryption > Mount enter key after folder is mounted: rsync -ah --progress --delete /path/*...
-3
votes
0answers
31 views

When running bash /cygdrive/ in front of Windows path issue

On my Windows Visual Studio project javing build file to build project. but when it runs this line it stopping execution rsync -av --exclude="*.mdb" --exclude="*.pdb" ./Services/...
0
votes
1answer
35 views

Rsync (No need to copy the time stamp)

With rsync command I want only copy/sync changed files/folder to the destination folder. I had some issue with Rsync-like whenever am executing the rsync command am copied along with the time stamp as ...
3
votes
0answers
45 views

rsync --verbose always shows directory structure when syncing to NTFS volume

When you run rsync with the -v option, for example rsync -av "/from/this/dir/" "/to/this/dir" ... you will get a list of what was updated/deleted etc. So, the first run will give you a bunch of ...
1
vote
0answers
50 views

BTRFS send only new files without deleting anything on remote

I'm looking into replacing rsync with BTRFS tools, but I'm not sure if what I want to do is even possible. I have a small local volume and a large remote volume used for archiving. Files will be ...
4
votes
1answer
45 views

sudo rsync -a does not preserve mtime

In order to debug my repeatedly crashing Ubuntu 16.04 I want to backup /var/log from my HDD to an external USB medium. I am running an live OS (Ubuntu 16.04) and using the --archive option: $ sudo ...
3
votes
1answer
34 views

Fit timestamps of multiple files/folders to existing ones

I've copied a large directory to another location (through a network). I needed to preserve all the timestamps (especially ctime and mtime). However somewhere in the process I screwed things up. (I ...
0
votes
1answer
20 views

Rsync: Prioritise files and folders

I'm copying a large directory from one computer to another using rsync. Is there a way to tell rsync I would like it to copy some files and / or folders first, before others so that I can start ...
3
votes
2answers
48 views

rsync claims different files, but diff does not?

I have a file both locally and on server. I first try running rsync in "dry-run" mode, to see if there are some differences between the files: $ rsync -aP --dry-run USER@192.168.0.55:/home/dir . USER@...
0
votes
1answer
45 views

Can rsync be used to make only hard links, not copies? [duplicate]

I'm working on a system to automatically back up my computer using rsync and the Google Drive app (I have a Macintosh computer). (This app creates a directory whose contents are saved to the Google ...
0
votes
1answer
45 views

Expect Rsync with Double quotes

Below is my code: #!/usr/bin/expect -f set timeout -1 spawn rsync -arvz -e 'ssh -p 1690' --protect-args --progress /home/pappu/ 'backup@xx.xx.xx.xx:/volume1/56 - Backup Server/pappu' expect "password:...
0
votes
1answer
41 views

Rsync to copy specific subfolders and files to new directory

Original path, RootFolderI: RootFolderI/FolderA/Subfolder1/Subsub1/JPG1.jpg -> want this jpg RootFolderI/FolderA/Subfolder2/Subsub1/JPG2.jpg -> want this jpg RootFolderI/FolderA/Subfolder2/...
0
votes
1answer
40 views

Rsync with destination owner and permission possible?

Source server have one owner is root. ----/home/sub1/test1 ----/home/sub2/test1 My local machine is destination. ----/home/sub1/test1 owner by user1 ----/home/sub2/test1 owner by user2 How I ...
2
votes
1answer
85 views

why rsync does not do delta transfer

I have binary file which has approx 77MB: nupic@nupic-virtualbox:~/VboxSharedFolder/experiments/sync/exp2$ ls -lah src/ total 77M drwxrwx--- 1 root vboxsf 0 Jun 21 13:31 . drwxrwx--- 1 root vboxsf ...
0
votes
0answers
35 views

Does changing your OS (fedora>OpenSuse) or FS (ext4>btrfs) “break” rsync?

I am using a rather simple script to do incremental backups of my laptop to my external HDD's, where the core line is probably the following: rsync -arbuv --delete --progress -exclude-from=/backup-...
1
vote
1answer
33 views

copy_only_missing? - Copy from /A to /C only paths missing on /B and /C - concise way

I'd like to copy from /A to /C only paths missing on /B and /C. (Please assume those are paths, and can represent also remote locations e.g. mounted via sshfs) I wonder... Is there more concise way ...
2
votes
0answers
19 views

flock command wont run through cron [duplicate]

I am trying to cron an rsync sync over ssh, but for some reason, as soon as I put the command in cron, it won't run. I don't know what is causing it to break, but it is certainly something related to ...
0
votes
2answers
65 views

rsync --link-dest not working as expected with symlinks

I'm using rsync to backup some of my files: rsync -aEN --delete --link-dest="$CURR/" "$SOURCE/" "$NEW/" The --link-dest option works fine with most files, but not with symlinks. When I was writing a ...
0
votes
1answer
19 views

Download with rsync through bastion/jumper, without .ssh/config changes

I'd like to download a file from server C, through server B (bastion) to my local server A. Normally I'd handle the mess in ssh/config with ProxyCommand, but in this case I can't. Can we make a one-...
0
votes
1answer
51 views

Using Rsync include and exclude options to include directory and subdirectory but exlude files in subdirectory

I'm wondering if my scenario can actually be handled with rsync. Rsync working fine between my local and my remote. htdocs/ folderswithfilesIneed/ somefilesandfolders.jpg afolder/ ...
1
vote
1answer
19 views

Rsync files-from problem

rsync -av --files-from=list.txt A/* B/ Inside the list.txt I have A/text1.txt When executing the command, I get an error refering me to the man page, does anyone know why? Please see the rsync(1)...
0
votes
1answer
37 views

Use of Verbose in a cron job

I'm busy setting up a back-up script to run on my Pi using rsync. I see that a number of people use the -v option in their cron jobs. Why? It's going to be run as root, and not in a terminal where ...
1
vote
3answers
49 views

rsync not overwriting newer files [closed]

Replication details: mkdir test && cd test mkdir folder && cd folder echo "#line1" > file rsync -a -I . .. echo "#line2" >> ../file rsync -a -I . .. Output: Content of ../...
5
votes
2answers
54 views

Can you scp, sftp, or rsync, a pipe?

I want to tar and send a ~700GiB directory to a remote drive I don't control. I don't have the HDD space locally to create the tarball and then copy that over. The remote is also protected by rssh - ...
1
vote
1answer
31 views

how to rsync certain directory and files - problem

I have looked at previous posts but cannot get this working. I want to just rsync all the server03 directories and any sub directories of them to a new server. I tried the following but it was picking ...
7
votes
0answers
127 views

Synchronising millions of files between two Linux servers

I have a server which exports a directory containing ~7 million files (mostly images) from its local disk to network clients via NFS. I need to add a second one for the sake of HA, and to keep it in ...
0
votes
0answers
118 views

Rsync freezes while copying

I'm having trouble using rsync to back-up my system locally. I'm using this short guide from the arch wiki. Here's the modified one-liner I'm using : rsync -aAX --debug=all5 --delete --modify-window=...
1
vote
1answer
33 views

rsync wants to copy files that already exist in the destination directory

I am trying the following command using rsync to copy only files that are new have a different size rsync -niav --size-only /home/me/source/Electronica /media/externalDrive/dest/Electronica ...
4
votes
2answers
323 views

SSH broken pipe, message authentication code incorrect

I have set up a Ubuntu server that I plan on using to backup my macbook air using rsync. But every time I use rsync, or even scp, the connection drops, with one of the following errors: ...
3
votes
1answer
41 views

Recursive move (`mv -rn`, like `cp -rn`), a move that will only move not present files

Context I have user uploaded content that needs to be backed up. The content is over 3 separate servers at /var/www/domain/media/ (on each server it is in the same place). The backup is a NFS ...
2
votes
0answers
38 views

Why do two directories differ after syncing with rsync?

I copied some directories on one removable drive to another removable one using rsync. The command used was: rsync -avPS <source> <destination> rsync doesn't report any errors. After ...
2
votes
1answer
40 views

Rsync files, excluding a list

I am working on setting up cron jobs,and I am new to this. The purpose is to analyze the new data that is generated.The data is present in directories. I want to sync only the latest data/that has ...
0
votes
1answer
26 views

To rsync -rtvuc in Two Filesystems?

I am newbie with rsync. Systems OS_X_Extended/Source/ FAT32/Destination/ I want to rsync everything from OSX extended to Fat32 directory and delete those files/directories which I deleted from ...
2
votes
0answers
27 views

How to make rsync delete files/folders on backup server that no longer exist on main server? [closed]

I am using this command to backup a main server to a backup server. rsync -avz --delete-after --exclude-from '/usr/order/exclude.txt' --password-file=/usr/prod/masterpass.rsync /usr/order/ order@...
1
vote
2answers
19 views

Rsync rotating logfiles

currently I have an troublesome problem. I needed quite a time for identifying this problem. Anyhow that's what I'm doing: I collect log files with rsync from multiple servers to archive them. Its ...
1
vote
1answer
43 views

rsync fails/hangs when copying from a Linux ext4 to a FreeBSD ZFS (via SSH)

When I try to copy directories from an ext4 on Linux to a ZFS on FreeBSD (via SSH), rsync immediately fails without copying anything: # rsync -haxHAX /mnt/source/ root@lethe:/mnt/dest/ -vvv opening ...
3
votes
2answers
39 views

How to copy just timestamps, or “I should have used cp -p”

I foolishly copied a very large amount of data using cp -r. Looking at it now, I've realized that this means I lost my file modification times. I should have used cp -rp. My directory structure and ...
3
votes
0answers
84 views

Sync with Onedrive

I would like to sync (and backup) my /home directory with OneDrive. I found some great terminal clients, where you can even mount your directory, but nowhere did I found an option to this with some ...
2
votes
1answer
76 views

Transfer Size limit for SCP, SFTP, RSYNC?

Is there a maximum size limit to the size of collective size of the files that are to be transferred in one go for the above protocol. My intent is to know if for example after 1 GB any of these ...
0
votes
1answer
19 views

help with rsync (with samba) and ignoring perm/time/group/owner

so this is what I'm trying to use: rsync -DHilrv --delete --progress /my-local-drive/ /my-network-share/ I've run the command above. After the operation was complete, I ran it again but this time I ...
1
vote
1answer
46 views

How to rsync files between two remotes with an explicit port and different usernames?

I want to rsync files between two remote servers. I tried to follow the next solution of @roaima: http://unix.stackexchange.com/a/183516/137526, but I need a more delicate solution, for two reasons: ...
1
vote
2answers
83 views

Differences between rsync on remote and rsync local on mounted sshfs?

Is there any difference if I run rsync with remote host (ssh://) as source/destination or use local path to share mounted directory via sshfs? Could there be differences be with regards to security ...
0
votes
1answer
53 views

Rsync --dry-run not showing correct sent bytes

I'm trying to use rsyn with the --dry-run option to see if there is enough space for the real synchronization. For test purposes I'm trying to synchronize one directory Documents. The size of the ...
0
votes
1answer
32 views

rsync options to transfer big tgz files to zfs filesystem and snapshot later

I need transfer everyday a lot of compressed tar files from a hosting server to a zfs data storage server. The standard way to rsync transfer seems to not zfs snapshot friendly. Each snapshot keep ...
1
vote
2answers
55 views

rsync on AIX gives popt The module has an invalid magic number error

[SERVER:root:/home/user:] rsync -avz --delete ... Could not load program rsync: Dependent module /opt/freeware/lib/libpopt.a(libpopt.so.0) could not be loaded. The module has an invalid magic ...