rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
2answers
211 views

bi-directional sync with rsync

I am trying to setup bi-direction or two way sync with rsync. In my case I only need to delete the files when syncing from B to A. So, I was thinking of running rsync twice as follow : rsync -rtuv ./...
1
vote
0answers
75 views

Why is my rsync slow?

I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built ...
3
votes
1answer
30 views

Rsync unable to remove remote file not exist in local

Consider my local folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/3.txt and my remote folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/4.txt and in my local side, I run the ...
0
votes
0answers
15 views

How to exclude .htaccess from rsync? [duplicate]

So I've been trying to use rsync and came up with problem. When using: rsync -avzhP --update --delete --include ".*" --exclude-from ./exclude /data/.. user@server:/dir If there is no .htaccess on ...
1
vote
1answer
84 views

Rsync folder time and date

I'm using rsync to copy and noticed that the destination folders have the current time and date. Not the time and date of the source. Did I miss a switch in my command? nohup rsync -avhP /c/Media/...
0
votes
1answer
161 views

ntfs issue with rsync: read errors mapping permission denied (13)

I have an issue when I want to rsync folders from my external backup hard disk to my NAS. I get this error : read errors mapping permission denied (13) I have root rights; if I want to change ...
0
votes
1answer
34 views

deleting directory with large amount of files with rsync -a delete

I have a directory called crmlogs, how do I use rsync -a --delete to delete it? mkdir emptydir rsync - a --delete \emptydir \crmlogs ?
57
votes
4answers
47k views

Can rsync resume after being interrupted?

I used rsync to copy a large number of files, but my OS (Ubuntu) restarted unexpectedly. After reboot, I ran rsync again, but from the output on the terminal, I found that rsync still copied those ...
1
vote
1answer
19 views

Rsyncing files without taking into account change in timestamps

Consider the following structure: I develop using SVN. Once I am done I export the revision \qa\project Once QAing is complete, I rsync the files to staging area. I am using the following rsync ...
-1
votes
1answer
37 views

rsync backup not creating any files

I am trying to run rsync to back up my file system to an external flash drive. It finishes almost immediately, and no files are present on the flash drive when I view it. What am I doing wrong? king@...
4
votes
2answers
148 views

How do I sync files between two drives?

What command can check that a directory contains the same files as another directory, all the files are up to date and copy any updated files or new files to the first directory. It should not care ...
2
votes
2answers
192 views

Is it possible to show rsync output on a single line?

I have a bash script that is rsyncing a large directory and the --progress function is great, but is it possible to show all this output on a single line? ie. as the files transfer, just spit it the -...
0
votes
0answers
33 views

What is the effect of rsync with -E and --chmod?

Reading through a script I came across an rsync command with the following flags: -rtlDE -c --delete-after --chmod=u+rwX,go-rwx /path/to/dir1/ /path/to/dir2/ Background: I am refactoring the ...
0
votes
3answers
61 views

How to stop rsync from replacing every file whether or not it has been changed?

I want rsync to copy everything from "copy_to_home" directory (which is on a NTFS-formatted hard drive) to the users home directory. I don't want it to delete anying, but it should replace files on ...
9
votes
5answers
2k views

Rsync that handles moves sensibly

I've been successfully using rsync to synchronize my home directories between my laptop and my netbook (both using ext4 with Linux). My only problem with it is that every now and then I like to ...
0
votes
1answer
60 views

rsync exclude directory not working, when also scanning for only *.php files

Im trying to rsync all the .PHP and .HTML files from any directory inside of /home/ . However in /home/site2/public_html/cache_old/ there are .html files that i do not want to include in the sync ...
1
vote
2answers
53 views

Rsync deletes files in old directory?

I'm really stuck on an rsync problem and I haven't been able to crack it by reading the documentation. I want to make 7 directories, one for each day of the week, for back-ups of some folders and ...
1
vote
0answers
20 views

Does rsync\duplicity real write files on mounted storage?

I've got an external storage, which is mounted as cifs: $: mount ... //somespace/backup on /mnt/backup type cifs (rw) ... And I have write some file: $: rsync /home/user/files /mnt/backup or $: ...
4
votes
2answers
174 views

synchronize only the newest files and folders, limit by size

I would like to sync Folder A to Folder B with the following restrictions Folder A contains thousands of files in hundreds of folders and many hundreds of GBs of files. Folder B will contain the ...
5
votes
3answers
9k views

rsync mkstemp failed Invalid argument (22) with davfs mount of Box.com cloud

I mounted Box.com cloud storage using davfs according to these instructions. I mounted my Box.com account under /home/me/Cloud/Box I can access the mounted filesystem via Dolphin as well as via the ...
7
votes
1answer
292 views

Does rsync delete files on the destination that were deleted from the sending side?

Does rsync delete files from the destination if they were deleted from the source? For example, say in the source /home/me I have three files: a.txt b.txt c.txt Now, I run the command rsync -v /...
0
votes
3answers
345 views

rsync partial LVM volume to Remote Directory

Can I rsync a full hdd partition (which is inaccessible) to a remote directory? Inaccessible means it cannot be mounted, it was part of LV volume merged with other HDD which is faulty and removed ...
0
votes
0answers
55 views

cron not running rsync

I'm trying to setup a rsync task using cron. The point is to sync a work folder on a linux partition and its counterpart on a windows partition on a dual-boot computer. To do that, I'm trying to ...
0
votes
1answer
30 views

Can't get rsync options right

I am running this command as bash script: rsync -avz -e ssh -o StrictHostKeyChecking=no /srv/system/scripts/test.txt server@hidden:/home/server/serverscripts/mounts/digitalocean And this is the ...
3
votes
1answer
69 views

Rsync contents of tar with remote server

I've got a number of backups as tar archives, and to do checking/testing of them I restore to some test machines using: cat archive.tar.gz | ssh server2 "cd /path/to/dir; tar zxvf -" Most of the ...
0
votes
1answer
32 views

how to use 'rsync --files-from' to avoid ssh's password repeatition?

right now i'm using this code to syncronise stuff between my pcs: nexus_ip=$(ip neigh | grep "nexus's mac addr" | grep -Eo '^[^ ]+') function syncit () { # rsync -rLEAXpogtP --delete "$1" "$2" rsync -...
1
vote
0answers
45 views

How to keep remote directory up-to-date with local directory automatically?

Say, I have a directory A on my local machine and B on remote machine(Both are CentOS 7). I am using rsync to sync between them. But I want to track my changes on local directory and automatically ...
1
vote
5answers
2k views

rsync keeps disconnecting: broken pipe

I'm using rsync to backup my home directory. This has been working fine for a long time now. Here's the command I'm using: rsync \ -pavz \ --delete \ --exclude 'mnt/' \ --exclude '....
1
vote
2answers
64 views

Rsync behavior with changed files

When after running rsync for the first time a file is changed on the source, when you next run rsync on the same filesystem does it copy the whole file from the source again or just the changes to the ...
0
votes
0answers
54 views

Move files according to their name in corresponding folder only if the file does not exist already

I created a script that creates reports using R and Latex and that should move the reports to a designated location only if a report with the same size does not already exist there. The script looks ...
0
votes
0answers
210 views

rsync “no such file or directory” when using wildcard

I am trying to use rsync to copy the contents of a folder to another folder. This is the command I am using for this. rsync -v -r $folder64/Pictures/* $folder65/Pictures/ And here is the error code....
2
votes
0answers
25 views

Certain folders are always missing using Rsync to server

I have tried several different ways using rsync modules and ssh trying to pull my linux desktop from my freenas server and no matter how I do it, certain folders are always missing. I am trying to ...
2
votes
2answers
153 views

pipe ls and awk to rsync

Trying to complete a script with the following steps: (1) select 1gig of most recently changed files across a number of subdirectories (2) preferably uses rsync to copy the files to local directory -- ...
5
votes
0answers
235 views

How to convert existing gz (gzip) files to rsyncable

I am using rsync to back up a repository that contains many gz files including many new ones each day. The rsync backup proceeds more slowly than it should because these gz files are not built with ...
8
votes
2answers
7k views

Copy symlink AND where it points to using rsync

It doesn't need to be done by rsync, but it would be nice not have to write a script to do this, and rsync is very close to what I want. rsync -a (or -l) can preserve symlinks, and -L can dereference ...
0
votes
2answers
58 views

rsync on running home dir causes infinite run

I have a rsync set to run every morning at 5am. sudo rsync -xrltDu --delete /home/mirthen/ /long/backup/folder/name/ It works for the most part, however it will once in a while hang and never ...
3
votes
2answers
1k views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
20
votes
2answers
11k views

How to use rsync to backup a directory without git subdirectory

I want to copy my c directory with all subdirectories excluding ./git subdirectory. I do it using rsync : echo "copy c and sh files " rsync -a --include='*.c' --include='*.sh' --include='*/' --...
1
vote
1answer
30 views

What happens if rsync is scheduled to do backup, but remote location is unavailable?

I'm thinking of creating a sync/backup routine with rsync for some crucial files between my Desktop computer and Laptop. The point is not to use a Cloud service. I would set up an automated schedule ...
0
votes
0answers
57 views

How to find 100 GB of most recently modified files and send to rsync for local synchronization

I need to select 100gig of most recently changed files from a local directory and do an rsync to a local directory (skipping files that are already rsynced). If I try something like find . -mtime +...
1
vote
2answers
468 views

What's the differernce between differential and incremental backup in terms of rsync command?

I use the following rsync command to backup my local folder ~/dir1 to a remote backup server: rsync -a ~/dir1 username@remote_host:destination_directory As per my understanding it's incremental ...
1
vote
1answer
183 views

rsync leads to almost all corrupted files [closed]

I copied files from one server to another with rsync 3.0.6 on CentOS 6: rsync --exclude=".bash*" --progress --verbose -lpogtzr /home/ 1.2.3.4:/home/ but many synced files have different checksum on ...
1
vote
2answers
37 views

Rsync two “filepath” found by find commands [closed]

Original file /001day/backup/001m/name_test_v1.txt Destination file /001date/003m/name_test_v12.txt Method 1 rsync -av --progress /001day/backup/001m/ /001date/003m/ Method 2 ...
1
vote
1answer
41 views

Backup in Linux with resume support only the latest one

We have a backup server in a remote location with low bandwidth. We send data to that server in a regular basis from our Datacenter. The file size of each day backup is around 100 GB. We would like to ...
1
vote
3answers
182 views

Get rsync to report if any local files were updated

I'm running rsync to do pull from a remote host to the local host. rsync -a --update user@remotehost:/files/ ~/files/ I'm running that command from java and using the exit code to work out if it ...
0
votes
1answer
51 views

rsync and logDtpre.iLsfx

What is the parameter -logDtpre.iLsfx or -vlogDtpre.iLsfx or -vvlogDtpre.iLsfx used for with rsync? Here's an example of where I've seen this used: rsync --server --sender -vvlogDtpre.iLsfx
0
votes
0answers
25 views

fetch data from remote server for last 15mins

I am fetching data from a remote server using rsync and the data that I have to fetch is from different subfolders . So , connecting the remote machine via ssh I have to check which data are populated ...
1
vote
0answers
168 views

Can rsync command run using multiple cpu?

I executed this command but it took long time when checking checksum. Load average was 1.00 at all times. Can rsync command run using multiple cpu? $ rsync --checksum -av -e ssh /usr/local/xxx/* ...
1
vote
1answer
308 views

rsync with different user

I'm working with two ubuntu instances on AWS (which I use a pem key to access them). I set up rsync for both instances, and it works if I use the default user which is ubuntu@ipaddress. However if I ...
1
vote
1answer
87 views

Preserve date modified on directories / folders with rsync

I am trying to backup a failing hard drive and rsync would be ideal due to the features it has such as progress indicator and ability to stop and resume. The one issue I am having is that while file ...