rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

4
votes
0answers
22 views

Reuse rsync --dry-run output

I usually do rsync -n before doing an actual rsync. The thing is, how could I automate the second run to reuse exactly the list generated with --dry-run? I mean, if I run rsync -n then I get a ...
1
vote
1answer
10 views

rsync generating a destination directory of bigger size than source?

We are copying our data from source server to destination server using rsync : rsync -av --progress --sparse user@destination server After rsync, we observed that destination directory is bigger in ...
1
vote
2answers
53 views

Is it possible to synchronization real time date from source to destination?

We want to copy ~800GB of data from a source server to destination server using rsync. I was wondering if its safe to use rsync without shutting down source server application? Can rsync handle real ...
0
votes
1answer
20 views

ersync --compare-dest arg does not exist no matter what

I have these folders: . ├── result ├── test │   ├── file1 │   ├── file2 │   ├── file3 │   └── file4 └── test2 ├── file1 ├── file2 ├── file3 └── file5 test is the original folder. ...
3
votes
1answer
36 views

How do I mount an external SD card without using sudo?

I wrote a bash-script with the intention to back up a specific (truecrypt-)file onto a SD-card (and a folder shared over the cloud) using the rsync command. The problem was that the SD-card usually ...
0
votes
1answer
28 views

How to “Find” then “Rsync” then “Tar/gz” on destination host?

I have a Cassandra node with snapshots broken up into 64 directories with over 350 files per directory. I want to "find" all snapshot files, preserve their location, rsync them across to a host with ...
0
votes
0answers
29 views

rsync can't update a folder that has no x permissions

I have an rsync job running in one server that keeps folders in sync. The job is running as root in one server and transferred to a backup server as normal user. In the origin server one folder ...
0
votes
0answers
17 views

lftp — continue behavior?

I have a straight forward use case that I thougth lftp could do with the --continue flag - alas it didnt work. Is it doable? - Am I missing some flags, and are there any easier way to do this with ...
2
votes
1answer
16 views

rsync and watch partial transfered video file

I try to copy a large video from my server to my local device with rsync -aP remotefile.mov localfile.mov But the local file does not show up unless I stop the rsync process. I can then watch the ...
0
votes
0answers
18 views

rsync : fixing Permission denied error with no rwx permission

We can see that one of our rsync jobs is failing with the following error rsync: opendir "/share/resources/0731402367/docs/quick-check/answers" failed: Permission denied (13) rsync: opendir ...
0
votes
1answer
33 views

rsync failing to exclude directory [duplicate]

We are using rsync to copy files from one location to another location on a different host. We want to exclude a directory from the source location so that files from this directory are not copied . ...
1
vote
1answer
25 views

Ways to consolidate music folder

Having used iTunes for a long time, my iPod Classic finally started showing signs of dying. I bought a FiiO X5II and put all my music onto it's microSD XC card(s) using rsync to ensure the same folder ...
1
vote
1answer
46 views

Fastest file copying within sshfs directory (rsync?)

I have a directory on a remote server remote1, mounted via sshfs. I am installing new versions of some of the files in the remote directory, which are quite large (~50M). I am currently using ...
1
vote
0answers
34 views

Why is my rsync slow?

I run a rsync job transferring about 45 million files/approximately 1.8 TB data (a Mac OS X Time Machine backup) over a 100 MBit connection. I use rsync 3.1.1 from MacPorts (I first tried the built ...
1
vote
2answers
46 views

bi-directional sync with rsync

I am trying to setup bi-direction or two way sync with rsync. In my case I only need to delete the files when syncing from B to A. So, I was thinking of running rsync twice as follow : rsync -rtuv ...
3
votes
1answer
20 views

Rsync unable to remove remote file not exist in local

Consider my local folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/3.txt and my remote folder /tmp/foo/ /tmp/foo/1.txt /tmp/foo/2.txt /tmp/foo/4.txt and in my local side, I run the ...
0
votes
0answers
15 views

How to exclude .htaccess from rsync? [duplicate]

So I've been trying to use rsync and came up with problem. When using: rsync -avzhP --update --delete --include ".*" --exclude-from ./exclude /data/.. user@server:/dir If there is no .htaccess on ...
0
votes
1answer
26 views

deleting directory with large amount of files with rsync -a delete

I have a directory called crmlogs, how do I use rsync -a --delete to delete it? mkdir emptydir rsync - a --delete \emptydir \crmlogs ?
1
vote
1answer
14 views

Rsyncing files without taking into account change in timestamps

Consider the following structure: I develop using SVN. Once I am done I export the revision \qa\project Once QAing is complete, I rsync the files to staging area. I am using the following rsync ...
0
votes
1answer
21 views

rsync backup not creating any files

I am trying to run rsync to back up my file system to an external flash drive. It finishes almost immediately, and no files are present on the flash drive when I view it. What am I doing wrong? ...
2
votes
2answers
63 views

Is it possible to show rsync output on a single line?

I have a bash script that is rsyncing a large directory and the --progress function is great, but is it possible to show all this output on a single line? ie. as the files transfer, just spit it the ...
4
votes
2answers
128 views

How do I sync files between two drives?

What command can check that a directory contains the same files as another directory, all the files are up to date and copy any updated files or new files to the first directory. It should not care ...
0
votes
0answers
24 views

What is the effect of rsync with -E and --chmod?

Reading through a script I came across an rsync command with the following flags: -rtlDE -c --delete-after --chmod=u+rwX,go-rwx /path/to/dir1/ /path/to/dir2/ Background: I am refactoring the ...
0
votes
3answers
28 views

How to stop rsync from replacing every file whether or not it has been changed?

I want rsync to copy everything from "copy_to_home" directory (which is on a NTFS-formatted hard drive) to the users home directory. I don't want it to delete anying, but it should replace files on ...
1
vote
1answer
25 views

rsync exclude directory not working, when also scanning for only *.php files

Im trying to rsync all the .PHP and .HTML files from any directory inside of /home/ . However in /home/site2/public_html/cache_old/ there are .html files that i do not want to include in the sync ...
1
vote
2answers
39 views

Rsync deletes files in old directory?

I'm really stuck on an rsync problem and I haven't been able to crack it by reading the documentation. I want to make 7 directories, one for each day of the week, for back-ups of some folders and ...
1
vote
0answers
15 views

Does rsync\duplicity real write files on mounted storage?

I've got an external storage, which is mounted as cifs: $: mount ... //somespace/backup on /mnt/backup type cifs (rw) ... And I have write some file: $: rsync /home/user/files /mnt/backup or $: ...
8
votes
1answer
231 views

Does rsync delete files on the destination that were deleted from the sending side?

Does rsync delete files from the destination if they were deleted from the source? For example, say in the source /home/me I have three files: a.txt b.txt c.txt Now, I run the command rsync -v ...
0
votes
1answer
22 views

Can't get rsync options right

I am running this command as bash script: rsync -avz -e ssh -o StrictHostKeyChecking=no /srv/system/scripts/test.txt server@hidden:/home/server/serverscripts/mounts/digitalocean And this is the ...
0
votes
0answers
36 views

cron not running rsync

I'm trying to setup a rsync task using cron. The point is to sync a work folder on a linux partition and its counterpart on a windows partition on a dual-boot computer. To do that, I'm trying to ...
0
votes
1answer
28 views

how to use 'rsync --files-from' to avoid ssh's password repeatition?

right now i'm using this code to syncronise stuff between my pcs: nexus_ip=$(ip neigh | grep "nexus's mac addr" | grep -Eo '^[^ ]+') function syncit () { # rsync -rLEAXpogtP --delete "$1" "$2" rsync ...
2
votes
0answers
31 views

How to keep remote directory up-to-date with local directory automatically?

Say, I have a directory A on my local machine and B on remote machine(Both are CentOS 7). I am using rsync to sync between them. But I want to track my changes on local directory and automatically ...
3
votes
1answer
37 views

Rsync contents of tar with remote server

I've got a number of backups as tar archives, and to do checking/testing of them I restore to some test machines using: cat archive.tar.gz | ssh server2 "cd /path/to/dir; tar zxvf -" Most of the ...
4
votes
2answers
89 views

synchronize only the newest files and folders, limit by size

I would like to sync Folder A to Folder B with the following restrictions Folder A contains thousands of files in hundreds of folders and many hundreds of GBs of files. Folder B will contain the ...
0
votes
0answers
31 views

Move files according to their name in corresponding folder only if the file does not exist already

I created a script that creates reports using R and Latex and that should move the reports to a designated location only if a report with the same size does not already exist there. The script looks ...
1
vote
2answers
45 views

Rsync behavior with changed files

When after running rsync for the first time a file is changed on the source, when you next run rsync on the same filesystem does it copy the whole file from the source again or just the changes to the ...
0
votes
0answers
42 views

rsync “no such file or directory” when using wildcard

I am trying to use rsync to copy the contents of a folder to another folder. This is the command I am using for this. rsync -v -r $folder64/Pictures/* $folder65/Pictures/ And here is the error ...
2
votes
0answers
23 views

Certain folders are always missing using Rsync to server

I have tried several different ways using rsync modules and ssh trying to pull my linux desktop from my freenas server and no matter how I do it, certain folders are always missing. I am trying to ...
2
votes
0answers
62 views

How to convert existing gz (gzip) files to rsyncable

I am using rsync to back up a repository that contains many gz files including many new ones each day. The rsync backup proceeds more slowly than it should because these gz files are not built with ...
0
votes
2answers
40 views

rsync on running home dir causes infinite run

I have a rsync set to run every morning at 5am. sudo rsync -xrltDu --delete /home/mirthen/ /long/backup/folder/name/ It works for the most part, however it will once in a while hang and never ...
1
vote
1answer
22 views

What happens if rsync is scheduled to do backup, but remote location is unavailable?

I'm thinking of creating a sync/backup routine with rsync for some crucial files between my Desktop computer and Laptop. The point is not to use a Cloud service. I would set up an automated schedule ...
1
vote
5answers
393 views

rsync keeps disconnecting: broken pipe

I'm using rsync to backup my home directory. This has been working fine for a long time now. Here's the command I'm using: rsync \ -pavz \ --delete \ --exclude 'mnt/' \ --exclude ...
2
votes
2answers
108 views

pipe ls and awk to rsync

Trying to complete a script with the following steps: (1) select 1gig of most recently changed files across a number of subdirectories (2) preferably uses rsync to copy the files to local directory -- ...
0
votes
0answers
41 views

How to find 100 GB of most recently modified files and send to rsync for local synchronization

I need to select 100gig of most recently changed files from a local directory and do an rsync to a local directory (skipping files that are already rsynced). If I try something like find . -mtime ...
1
vote
2answers
62 views

What's the differernce between differential and incremental backup in terms of rsync command?

I use the following rsync command to backup my local folder ~/dir1 to a remote backup server: rsync -a ~/dir1 username@remote_host:destination_directory As per my understanding it's incremental ...
1
vote
2answers
34 views

Rsync two “filepath” found by find commands [closed]

Original file /001day/backup/001m/name_test_v1.txt Destination file /001date/003m/name_test_v12.txt Method 1 rsync -av --progress /001day/backup/001m/ /001date/003m/ Method 2 ...
2
votes
1answer
70 views

RSYNC periodically fails via SSH, broken pipe

A post-commit script calls a rsync command to update files from the SVN system to a production web server, both running Ubuntu 10.04.3, rsync 3.1.1. The issue had been occuring with rsync 3.0.7 as ...
4
votes
2answers
62 views

rsync delete only excluded files

rsync option --delete-excluded implies --delete as well. From man page: --delete-excluded In addition to deleting the files on the receiving side that are not on the sending side, this tells ...
1
vote
1answer
23 views

Backup in Linux with resume support only the latest one

We have a backup server in a remote location with low bandwidth. We send data to that server in a regular basis from our Datacenter. The file size of each day backup is around 100 GB. We would like to ...
1
vote
3answers
60 views

Get rsync to report if any local files were updated

I'm running rsync to do pull from a remote host to the local host. rsync -a --update user@remotehost:/files/ ~/files/ I'm running that command from java and using the exit code to work out if it ...