rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

0
votes
0answers
28 views

How to rsync files from machine A to machine C via machine B? [duplicate]

I need to rsync files from machine A which is not accessible from my machine (machine C) and it can only be accessed from machine B. How do I rsync files via another machine? files (machine A) ---...
3
votes
2answers
1k views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
5
votes
1answer
30 views

prevent backup from running in parallel

In my script /usr/local/bin/backup, that I call every hour from /etc/crontab, I use rsync to copy data to an off-site server. That all worked fine, even in cases where we had somewhat more new data ...
1
vote
0answers
45 views

rsync + chmod only selected files

I'm trying to sync specific cron files between 2 servers and change the permissions for them. However, the command I am trying is also changing the permissions on the main directory. Command used: ...
0
votes
2answers
36 views

What is the meaning of the option formatting in the rsync man page?

If you run man rsync and go to the options summary, there are alot of long form (i.e. --long-option) style options which are either an alias of, or grouped with a short form option. e.g. OPTIONS ...
0
votes
0answers
49 views

mysterious out-of-space message from rsync

I am mystified by the out-of-space message from rsync - I have enough freespace on the destination to hold everything, and I blv enough also on --vg-root as well. This doesn't seem to be the same ...
15
votes
6answers
22k views

tar + rsync + untar. Any speed benefit over just rsync?

I often find myself sending folders with 10K - 100K of files to a remote machine (within the same network on-campus). I was just wondering if there are reasons to believe that, tar + rsync + ...
0
votes
1answer
22 views

how to mirror a samba folder into an ext4 folder via rsync?

I have a FreeBSD file server and I also have just setup a xUbuntu 15.10 desktop. The desktop was previously running OS X but I backed up my files to the FreeBSD server before installing xUbuntu. ...
0
votes
2answers
25 views

CentOS rsync directory contents but not directory?

I'm trying to get the contents of /deploy/ to populate to /panda/ but it doesn't seem to work. I searched on here and found instruction to leave the trailing slashes; however each time I run it a ...
1
vote
3answers
116 views

File System Permissions: User who can backup all files

I am setting up an automated backup job for some computers on my network. There is a server that will, daily, run an rsync command to backup each of the other computers. I'd like the user that the ...
0
votes
0answers
32 views

rsync doesn't delete files from ~/tmp

I'm trying to sync my home folder, named "kjs", with another folder (my usb drive mounted in /mnt/USB1). I use the following command: rsync -aAXv --delete /home/kjs/ /mnt/USB1/kjs This works mostly ...
0
votes
2answers
41 views

rsync to USB flash drive always transferring all data

When rsyncing a directory to a freshly plugged-in external USB flash drive, via rsync -av /source/ /dest/ all files get transferred (i.e. rewritten) despite no changes in the files. Note that ...
2
votes
2answers
41 views

How can Bash determine if it is running due to an rsync over ssh?

I need my Bash init scripts to be able to distinguish between having been invoked like ssh me@host /some/complicated/operation, and having been invoked like rsync -e ssh /src me@host:/dest In the ...
1
vote
2answers
1k views

How to rsync just the current folder?

I want to sync some files from a remote server to my local computer. How can I make rsync to just copy the files with a certain file extension in the directory but no subdirectories? I assumed this ...
20
votes
8answers
19k views

How to rsync over ssh when directory names have spaces

I am new to Linux and am trying to rsync from one server to another. The servers have the same directory structure but I am having trouble getting the remotes server to properly recognize the path ...
0
votes
1answer
77 views

Screen/system hangs when using scp or rsync + ssh in local network

First, I noticed frequent hang ups with the mouse when using scp in local network. I checked RAM usage, but free -m showed me about 33% usage without buffers/caches. (I have 8G RAM.) The CPU usage was ...
10
votes
2answers
19k views

rsync is very slow (factor 8 to 10) compared to cp on copying files from nfs-share to local dir

I have a freshly installed Ubuntu-server which is ought to be the new backup-server for our VM-storage. The server has 4 nics, 2 of them 10Gbit (in fact an intel x540-T2 with the newest driver ...
0
votes
0answers
37 views

problem during rsync backup to a ntfs network share

I'm running a machine with Linux 3.16.0-4-686-pae #1 SMP Debian 3.16.7-ckt20-1+deb8u3 (2016-01-17) i686 GNU/Linux, during a rsync backup to a ntfs network share (succesfully mounted with: mount -t ...
0
votes
0answers
22 views

Rsync update only destination files where file size is zero

I am using rsync to download the images from ftp server every night. Some of the images get copied but have zero size on it with the exact same name as on source but empty . how can I tell to run the ...
0
votes
0answers
74 views

rsync fails when ssh can't open /dev/tty

I've got a script that needs to rsync some files to a remote machine. The rsync command looks like this: rsync -avz -e 'ssh -vv -o IdentitiesOnly=yes -i /data/credentials/rsync2.key' \ --rsync-...
0
votes
0answers
28 views

Mount directory elsewhere with different permissions [duplicate]

I would like to be able to mount a directory (i.e. /home/user1) to a different location on the same disk (i.e. /mnt/user1_home), but with different permissions so that the mount point (/mnt/user1_home)...
0
votes
2answers
39 views

Copy last used files of total size

I want to copy the last used (or maybe created) files of a total size to another folder. Is this possible without additional tools? I have an USB drive of a certain size that is less than the total ...
1
vote
0answers
258 views

rsync only files newer than given date, with --delete

I'm trying to use rsync to backup only the files that have been created or changed after a certain date. The reason is that on that date, the whole system has been backed up. However, those global ...
1
vote
0answers
40 views

rsync: --fuzzy doesn't detect name changes with link-dest

So these are my test files: $ ls -li live/ total 2048 804974 -rwxrwx--- 1 ariel ariel 1048576 Feb 22 00:45 live/file1 804975 -rwxrwx--- 1 ariel ariel 1048576 Feb 22 00:47 live/file2 And a first ...
1
vote
0answers
109 views

rsync's “Read-only file system (30)” error

NB: This is a 2-part question: why does an error happen, and how to work around the error. (The two parts are related, inasmuch as the answer to the "why"-question may shed light on the "how"-...
6
votes
2answers
19k views

How to force overwrite non-empty directories using `mv`

I am wanting to move (not just copy) a group of files/directories to a different directory some of which have name clashes with files/directories in the target directory. My main objective is to move ...
3
votes
1answer
4k views

Logging only transferred files with rsync

I've created a backup script with rsync and I have it running every 10 minutes. I am copying files from HFS to Fat32. I have it logging using --progress but to make reading the log easier I only want ...
0
votes
0answers
43 views

rsync in script on mac

I have a Script on my Mac Server to sync with another Mac Server. #!/bin/bash DestVolume="/Path/to/destshare" SrcVolume="/Path/to/srcshare" SSHKey="sshkey" SrcUser="user" SrcHost="remoteserver" ...
0
votes
1answer
36 views

What is the switch or option of rsync command inorder to skip the backup of corrupt files? [closed]

What is the switch or option of rsync command inorder to skip the backup of corrupt files so that it does not overwrite good files?
0
votes
2answers
41 views

Executable file isn't “really there” after rsync [duplicate]

I am issuing the following rsync command (obfuscating the exact path & host), which should copy two binaries: rsync -e "ssh -p 443" -a --info=progress2 -z user@remote:/srv/cgi-bin/ . user@remotes'...
0
votes
1answer
35 views

Comparing 2 directories and copying the different sub-directories to a 3rd directory

I have 2 directories DIR1 and DIR2 DIR1 is base directory, where new changes come often, sometimes new sub-directories as well. DIR2 has older version of files. I want to compare these 2 directories,...
0
votes
3answers
88 views

Backup script fails with the rsync command's options in a quoted variable

Using: rsync version 3.1.0 protocol version 31; Linux Mint 17 (based on: Ubuntu 14.04.3) In one of my backup Bash scripts, which uses rsync, I put the rsync options in a variable like this: # Set ...
5
votes
1answer
214 views

Reuse rsync --dry-run output

I usually do rsync -n before doing an actual rsync. The thing is, how could I automate the second run to reuse exactly the list generated with --dry-run? I mean, if I run rsync -n then I get a ...
1
vote
1answer
40 views

Comparing original & backup folder, then deleting non-existing files

I'm using Raspbian jessie (ubuntu). I made a .sh that makes a backup .img of everything (excluding mnt, tmp, run, dev, boot, etc.) and let this run once a week with crontab. It checks for modified ...
38
votes
6answers
41k views

rsync all files of remote machine over SSH without root user?

I have this command to backup a remote machine. The problem is that I need root rights to read and copy all files. I have no root user enabled for security reasons and use sudo the Ubuntu way. Would I ...
2
votes
1answer
133 views

RSYNC periodically fails via SSH, broken pipe

A post-commit script calls a rsync command to update files from the SVN system to a production web server, both running Ubuntu 10.04.3, rsync 3.1.1. The issue had been occuring with rsync 3.0.7 as ...
4
votes
1answer
105 views

How do I mount an external SD card without using sudo?

I wrote a bash-script with the intention to back up a specific (truecrypt-)file onto a SD-card (and a folder shared over the cloud) using the rsync command. The problem was that the SD-card usually ...
1
vote
2answers
68 views

Is it possible to synchronization real time date from source to destination?

We want to copy ~800GB of data from a source server to destination server using rsync. I was wondering if its safe to use rsync without shutting down source server application? Can rsync handle real ...
1
vote
1answer
63 views

rsync generating a destination directory of bigger size than source?

We are copying our data from source server to destination server using rsync : rsync -av --progress --sparse user@destination server After rsync, we observed that destination directory is bigger in ...
0
votes
1answer
55 views

How to “Find” then “Rsync” then “Tar/gz” on destination host?

I have a Cassandra node with snapshots broken up into 64 directories with over 350 files per directory. I want to "find" all snapshot files, preserve their location, rsync them across to a host with ...
0
votes
1answer
52 views

ersync --compare-dest arg does not exist no matter what

I have these folders: . ├── result ├── test │   ├── file1 │   ├── file2 │   ├── file3 │   └── file4 └── test2 ├── file1 ├── file2 ├── file3 └── file5 test is the original folder. ...
0
votes
0answers
37 views

rsync can't update a folder that has no x permissions

I have an rsync job running in one server that keeps folders in sync. The job is running as root in one server and transferred to a backup server as normal user. In the origin server one folder (...
5
votes
2answers
85 views

rsync delete only excluded files

rsync option --delete-excluded implies --delete as well. From man page: --delete-excluded In addition to deleting the files on the receiving side that are not on the sending side, this tells ...
0
votes
0answers
41 views

lftp — continue behavior?

I have a straight forward use case that I thougth lftp could do with the --continue flag - alas it didnt work. Is it doable? - Am I missing some flags, and are there any easier way to do this with ...
2
votes
1answer
31 views

rsync and watch partial transfered video file

I try to copy a large video from my server to my local device with rsync -aP remotefile.mov localfile.mov But the local file does not show up unless I stop the rsync process. I can then watch the ...
0
votes
1answer
91 views

rsync failing to exclude directory [duplicate]

We are using rsync to copy files from one location to another location on a different host. We want to exclude a directory from the source location so that files from this directory are not copied . ...
1
vote
1answer
41 views

Ways to consolidate music folder

Having used iTunes for a long time, my iPod Classic finally started showing signs of dying. I bought a FiiO X5II and put all my music onto it's microSD XC card(s) using rsync to ensure the same folder ...
1
vote
1answer
200 views

Fastest file copying within sshfs directory (rsync?)

I have a directory on a remote server remote1, mounted via sshfs. I am installing new versions of some of the files in the remote directory, which are quite large (~50M). I am currently using ...
1
vote
2answers
217 views

bi-directional sync with rsync

I am trying to setup bi-direction or two way sync with rsync. In my case I only need to delete the files when syncing from B to A. So, I was thinking of running rsync twice as follow : rsync -rtuv ./...
1
vote
0answers
76 views

Why is my rsync slow?

I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built ...