rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
1answer
33 views

How do I mount an external SD card without using sudo?

I wrote a bash-script with the intention to back up a specific (truecrypt-)file onto a SD-card (and a folder shared over the cloud) using the rsync command. The problem was that the SD-card usually ...
1
vote
2answers
45 views

Is it possible to synchronization real time date from source to destination?

We want to copy ~800GB of data from a source server to destination server using rsync. I was wondering if its safe to use rsync without shutting down source server application? Can rsync handle real ...
1
vote
1answer
10 views

rsync generating a destination directory of bigger size than source?

We are copying our data from source server to destination server using rsync : rsync -av --progress --sparse user@destination server After rsync, we observed that destination directory is bigger in ...
0
votes
1answer
28 views

How to “Find” then “Rsync” then “Tar/gz” on destination host?

I have a Cassandra node with snapshots broken up into 64 directories with over 350 files per directory. I want to "find" all snapshot files, preserve their location, rsync them across to a host with ...
0
votes
1answer
20 views

ersync --compare-dest arg does not exist no matter what

I have these folders: . ├── result ├── test │   ├── file1 │   ├── file2 │   ├── file3 │   └── file4 └── test2 ├── file1 ├── file2 ├── file3 └── file5 test is the original folder. ...
2
votes
1answer
1k views

rsync specific directories

Below are the directories of my directory structure. I only want to run rsync on the content under the archive directory of any subdirectory and exclude everything else: ./ ap/ ap/aploader/ ...
0
votes
0answers
28 views

rsync can't update a folder that has no x permissions

I have an rsync job running in one server that keeps folders in sync. The job is running as root in one server and transferred to a backup server as normal user. In the origin server one folder ...
4
votes
2answers
61 views

rsync delete only excluded files

rsync option --delete-excluded implies --delete as well. From man page: --delete-excluded In addition to deleting the files on the receiving side that are not on the sending side, this tells ...
0
votes
0answers
17 views

lftp — continue behavior?

I have a straight forward use case that I thougth lftp could do with the --continue flag - alas it didnt work. Is it doable? - Am I missing some flags, and are there any easier way to do this with ...
54
votes
5answers
55k views

scp without replacing existing files in the destination

How do I copy an entire directory into a directory of the same name without replacing the content in the destination directory? (instead, I would like to add to the contents of the destination folder) ...
2
votes
1answer
16 views

rsync and watch partial transfered video file

I try to copy a large video from my server to my local device with rsync -aP remotefile.mov localfile.mov But the local file does not show up unless I stop the rsync process. I can then watch the ...
0
votes
0answers
18 views

rsync : fixing Permission denied error with no rwx permission

We can see that one of our rsync jobs is failing with the following error rsync: opendir "/share/resources/0731402367/docs/quick-check/answers" failed: Permission denied (13) rsync: opendir ...
0
votes
1answer
32 views

rsync failing to exclude directory [duplicate]

We are using rsync to copy files from one location to another location on a different host. We want to exclude a directory from the source location so that files from this directory are not copied . ...
1
vote
1answer
25 views

Ways to consolidate music folder

Having used iTunes for a long time, my iPod Classic finally started showing signs of dying. I bought a FiiO X5II and put all my music onto it's microSD XC card(s) using rsync to ensure the same folder ...
1
vote
1answer
46 views

Fastest file copying within sshfs directory (rsync?)

I have a directory on a remote server remote1, mounted via sshfs. I am installing new versions of some of the files in the remote directory, which are quite large (~50M). I am currently using ...
1
vote
2answers
45 views

bi-directional sync with rsync

I am trying to setup bi-direction or two way sync with rsync. In my case I only need to delete the files when syncing from B to A. So, I was thinking of running rsync twice as follow : rsync -rtuv ...
1
vote
0answers
32 views

Why is my rsync slow?

I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built ...
3
votes
1answer
20 views

Rsync unable to remove remote file not exist in local

Consider my local folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/3.txt and my remote folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/4.txt and in my local side, I run the ...
8
votes
6answers
5k views

How to rsync files between two remotes?

I would like to transfer files between two remote hosts using on local shell, but it seems rsync doesn't support synchronisation if two remotes are specified as follow: $ rsync -vuar host1:/var/www ...
0
votes
0answers
15 views

How to exclude .htaccess from rsync? [duplicate]

So I've been trying to use rsync and came up with problem. When using: rsync -avzhP --update --delete --include ".*" --exclude-from ./exclude /data/.. user@server:/dir If there is no .htaccess on ...
1
vote
1answer
52 views

Rsync folder time and date

I'm using rsync to copy and noticed that the destination folders have the current time and date. Not the time and date of the source. Did I miss a switch in my command? nohup rsync -avhP ...
0
votes
1answer
82 views

ntfs issue with rsync: read errors mapping permission denied (13)

I have an issue when I want to rsync folders from my external backup hard disk to my NAS. I get this error : read errors mapping permission denied (13) I have root rights; if I want to change ...
0
votes
1answer
26 views

deleting directory with large amount of files with rsync -a delete

I have a directory called crmlogs, how do I use rsync -a --delete to delete it? mkdir emptydir rsync - a --delete \emptydir \crmlogs ?
3
votes
2answers
922 views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
1
vote
1answer
710 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
39
votes
4answers
34k views

Can rsync resume after being interrupted?

I used rsync to copy a large number of files, but my OS (Ubuntu) restarted unexpectedly. After reboot, I ran rsync again, but from the output on the terminal, I found that rsync still copied those ...
1
vote
1answer
14 views

Rsyncing files without taking into account change in timestamps

Consider the following structure: I develop using SVN. Once I am done I export the revision \qa\project Once QAing is complete, I rsync the files to staging area. I am using the following rsync ...
0
votes
1answer
21 views

rsync backup not creating any files

I am trying to run rsync to back up my file system to an external flash drive. It finishes almost immediately, and no files are present on the flash drive when I view it. What am I doing wrong? ...
4
votes
2answers
128 views

How do I sync files between two drives?

What command can check that a directory contains the same files as another directory, all the files are up to date and copy any updated files or new files to the first directory. It should not care ...
2
votes
2answers
61 views

Is it possible to show rsync output on a single line?

I have a bash script that is rsyncing a large directory and the --progress function is great, but is it possible to show all this output on a single line? ie. as the files transfer, just spit it the ...
0
votes
0answers
24 views

What is the effect of rsync with -E and --chmod?

Reading through a script I came across an rsync command with the following flags: -rtlDE -c --delete-after --chmod=u+rwX,go-rwx /path/to/dir1/ /path/to/dir2/ Background: I am refactoring the ...
0
votes
2answers
3k views

Parallelise rsync using GNU Parallel

I have been using a rsync script to synchronize data at one host with the data at another host. The data has numerous small-sized files that contribute to almost 1.2TB. In order to sync those files, ...
0
votes
3answers
28 views

How to stop rsync from replacing every file whether or not it has been changed?

I want rsync to copy everything from "copy_to_home" directory (which is on a NTFS-formatted hard drive) to the users home directory. I don't want it to delete anying, but it should replace files on ...
9
votes
5answers
1k views

Rsync that handles moves sensibly

I've been successfully using rsync to synchronize my home directories between my laptop and my netbook (both using ext4 with Linux). My only problem with it is that every now and then I like to ...
1
vote
1answer
25 views

rsync exclude directory not working, when also scanning for only *.php files

Im trying to rsync all the .PHP and .HTML files from any directory inside of /home/ . However in /home/site2/public_html/cache_old/ there are .html files that i do not want to include in the sync ...
1
vote
2answers
37 views

Rsync deletes files in old directory?

I'm really stuck on an rsync problem and I haven't been able to crack it by reading the documentation. I want to make 7 directories, one for each day of the week, for back-ups of some folders and ...
1
vote
0answers
15 views

Does rsync\duplicity real write files on mounted storage?

I've got an external storage, which is mounted as cifs: $: mount ... //somespace/backup on /mnt/backup type cifs (rw) ... And I have write some file: $: rsync /home/user/files /mnt/backup or $: ...
4
votes
2answers
87 views

synchronize only the newest files and folders, limit by size

I would like to sync Folder A to Folder B with the following restrictions Folder A contains thousands of files in hundreds of folders and many hundreds of GBs of files. Folder B will contain the ...
5
votes
3answers
8k views

rsync mkstemp failed Invalid argument (22) with davfs mount of Box.com cloud

I mounted Box.com cloud storage using davfs according to these instructions. I mounted my Box.com account under /home/me/Cloud/Box I can access the mounted filesystem via Dolphin as well as via the ...
8
votes
1answer
231 views

Does rsync delete files on the destination that were deleted from the sending side?

Does rsync delete files from the destination if they were deleted from the source? For example, say in the source /home/me I have three files: a.txt b.txt c.txt Now, I run the command rsync -v ...
0
votes
3answers
222 views

rsync partial LVM volume to Remote Directory

Can I rsync a full hdd partition (which is inaccessible) to a remote directory? Inaccessible means it cannot be mounted, it was part of LV volume merged with other HDD which is faulty and removed ...
0
votes
0answers
34 views

cron not running rsync

I'm trying to setup a rsync task using cron. The point is to sync a work folder on a linux partition and its counterpart on a windows partition on a dual-boot computer. To do that, I'm trying to ...
0
votes
1answer
22 views

Can't get rsync options right

I am running this command as bash script: rsync -avz -e ssh -o StrictHostKeyChecking=no /srv/system/scripts/test.txt server@hidden:/home/server/serverscripts/mounts/digitalocean And this is the ...
3
votes
1answer
37 views

Rsync contents of tar with remote server

I've got a number of backups as tar archives, and to do checking/testing of them I restore to some test machines using: cat archive.tar.gz | ssh server2 "cd /path/to/dir; tar zxvf -" Most of the ...
0
votes
1answer
26 views

how to use 'rsync --files-from' to avoid ssh's password repeatition?

right now i'm using this code to syncronise stuff between my pcs: nexus_ip=$(ip neigh | grep "nexus's mac addr" | grep -Eo '^[^ ]+') function syncit () { # rsync -rLEAXpogtP --delete "$1" "$2" rsync ...
2
votes
0answers
31 views

How to keep remote directory up-to-date with local directory automatically?

Say, I have a directory A on my local machine and B on remote machine(Both are CentOS 7). I am using rsync to sync between them. But I want to track my changes on local directory and automatically ...
1
vote
5answers
375 views

rsync keeps disconnecting: broken pipe

I'm using rsync to backup my home directory. This has been working fine for a long time now. Here's the command I'm using: rsync \ -pavz \ --delete \ --exclude 'mnt/' \ --exclude ...
1
vote
2answers
43 views

Rsync behavior with changed files

When after running rsync for the first time a file is changed on the source, when you next run rsync on the same filesystem does it copy the whole file from the source again or just the changes to the ...
0
votes
0answers
31 views

Move files according to their name in corresponding folder only if the file does not exist already

I created a script that creates reports using R and Latex and that should move the reports to a designated location only if a report with the same size does not already exist there. The script looks ...
0
votes
0answers
40 views

rsync “no such file or directory” when using wildcard

I am trying to use rsync to copy the contents of a folder to another folder. This is the command I am using for this. rsync -v -r $folder64/Pictures/* $folder65/Pictures/ And here is the error ...