rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
1answer
33 views

How do I mount an external SD card without using sudo?

I wrote a bash-script with the intention to back up a specific (truecrypt-)file onto a SD-card (and a folder shared over the cloud) using the rsync command. The problem was that the SD-card usually ...
3
votes
1answer
157 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...
2
votes
1answer
69 views

RSYNC periodically fails via SSH, broken pipe

A post-commit script calls a rsync command to update files from the SVN system to a production web server, both running Ubuntu 10.04.3, rsync 3.1.1. The issue had been occuring with rsync 3.0.7 as ...
2
votes
1answer
39 views

rsync selected subdirectories only

I want to rsync a part of my music library from external drive to my audio player. Generally speaking, say, there is a $source and $target directories, and a text file $subdirs with a list of ...
2
votes
1answer
205 views

Efficient way to download binary from server

I am using a remote machine to compile a project. When it finishes building, I use scp to copy the archive to a local machine. This worked fine till I was on broadband. Now I am using a 3G ...
2
votes
1answer
1k views

rsync specific directories

Below are the directories of my directory structure. I only want to run rsync on the content under the archive directory of any subdirectory and exclude everything else: ./ ap/ ap/aploader/ ...
2
votes
1answer
93 views

Is monitoring rsync with a pts device possible?

I have a rsync backup script, and I was wondering about methods of monitoring it as it runs. I could have it save a log and use watch and tail, but I had a more elegant solution in mind that might be ...
2
votes
1answer
53 views

Can I set defaults for rsync in non daemon mode?

Can I set defaults for rsync in non daemon mode? I know the daemon mode has this configuration file: /etc/rsyncd.conf But I typically use the non daemon version in this sort of manner: rsync -avzcO ...
1
vote
1answer
92 views

rsync with different user

I'm working with two ubuntu instances on AWS (which I use a pem key to access them). I set up rsync for both instances, and it works if I use the default user which is ubuntu@ipaddress. However if I ...
1
vote
1answer
172 views

scp can't upload/download files even though ssh works

I can connect to my server using ssh dziura and it works as it should, but I have problems copying any files to/from the server using rsync/scp/sftp. Scp: $ scp dziura:/home/kossak/file_remote.txt . ...
1
vote
1answer
52 views

Rsync folder time and date

I'm using rsync to copy and noticed that the destination folders have the current time and date. Not the time and date of the source. Did I miss a switch in my command? nohup rsync -avhP ...
1
vote
1answer
47 views

Syncing folders where multiple files are partially changed

I have following directory structure on remote machine ALLLibs/LibA/LibA.1 ALLLibs/LibA/LibA.2 ALLLibs/LibB/LibB.1 ALLLibs/LibB/LibB.4 for info LibA.1 and LibA.2 are version of a directory, ...
1
vote
1answer
176 views

lsyncd: Is it possible to sync individual files from a list?

I want to sync certain files from one linux system to another using lsyncd. The files are not confined to one directory, neither do I want all files from a directory. Specifically I'm trying to make ...
1
vote
1answer
49 views

What happens if I move the hard drives used by Rsync to another computer, and keep syncing them with it?

I realise the question is confusing, so allow me to elaborate. I apologise for the phrasing, as I wasn't sure how to put it. Here's the scenario: As my backup, currently my Mac launches Rsync every ...
1
vote
1answer
113 views

Copy a rolling “last 2 months” of files

I have a friend who is a photographer and she has a lot of large files as a result. Our current solution is where some files are delivered to my house. I don't have the storage capability to store all ...
1
vote
1answer
162 views

File corruption using rsync, multiple rsync processes, moved/renamed source file

I'm encountering some file corruption when using rsync (that is, the file contents do not match the source file). I can understand the file becoming corrupt if it is being written to while being ...
1
vote
1answer
132 views

How to keep a redundant home directory for offline use?

Scenario: My home dir is on NFS, identities are in LDAP and authorization is via Kerberos. My NFS, LDAP and Kerberos servers are all VMs -- I'm stretching a little hardware a long way at home. Life ...
1
vote
1answer
51 views

What is the proper bash method of prompting the user for administrative password before backing up the usb data to the computer?

mate-terminal --window-with-profile=PROFILENAME="Hold the terminal open" -e "sudo rsync -azvu --log-file=/var/log/simplebackup.log --append-verify --exclude '.gvfs' /media/user/usb/ ...
1
vote
1answer
710 views

Deduplication tool for rsync?

Is there a Linux / Unix tool that does de-duplication similar to the way Veeam does it before compressing and sending a backup with rsync to a mirrored location?
1
vote
1answer
224 views

Linux command to copy as hard links, while deleting unwanted files?

I'm looking for a command that behaves both like cp -al in only creating hard links rather than copying file contents, and rsync -a --delete in removing files from the destination that are not ...
1
vote
1answer
337 views

Wildcards in exclude-filelist for duplicity

I am trying to exclude a "bulk" folder in each home directory from the backup. For this purpose, I have a line - /data/home/*/bulk in my exclude-filelist file. However, this doesn't seem to be ...
1
vote
1answer
172 views

get rsync to dereference symlinked dirs presented on cmdline like find -H

I'd love rsync to copy symlinks to dirs specified on the cmdline as dirs but leave all symlinks in the copied tree as is - like find -H, but the only way is a nasty hack of rsync -aR --rsync-path='cd ...
1
vote
1answer
170 views

rsync only leaves partial files?

I am trying to copy files from my hard drive to a networked external disk (WDMyCloud). I have enabled the FTP access to the hard drive and mounted it to a local directory using curlftpf to a local ...
0
votes
0answers
18 views

rsync : fixing Permission denied error with no rwx permission

We can see that one of our rsync jobs is failing with the following error rsync: opendir "/share/resources/0731402367/docs/quick-check/answers" failed: Permission denied (13) rsync: opendir ...
0
votes
0answers
24 views

What is the effect of rsync with -E and --chmod?

Reading through a script I came across an rsync command with the following flags: -rtlDE -c --delete-after --chmod=u+rwX,go-rwx /path/to/dir1/ /path/to/dir2/ Background: I am refactoring the ...
0
votes
0answers
35 views

cron not running rsync

I'm trying to setup a rsync task using cron. The point is to sync a work folder on a linux partition and its counterpart on a windows partition on a dual-boot computer. To do that, I'm trying to ...
0
votes
0answers
31 views

Move files according to their name in corresponding folder only if the file does not exist already

I created a script that creates reports using R and Latex and that should move the reports to a designated location only if a report with the same size does not already exist there. The script looks ...
0
votes
0answers
41 views

rsync “no such file or directory” when using wildcard

I am trying to use rsync to copy the contents of a folder to another folder. This is the command I am using for this. rsync -v -r $folder64/Pictures/* $folder65/Pictures/ And here is the error ...
0
votes
0answers
41 views

How to find 100 GB of most recently modified files and send to rsync for local synchronization

I need to select 100gig of most recently changed files from a local directory and do an rsync to a local directory (skipping files that are already rsynced). If I try something like find . -mtime ...
0
votes
0answers
18 views

fetch data from remote server for last 15mins

I am fetching data from a remote server using rsync and the data that I have to fetch is from different subfolders . So , connecting the remote machine via ssh I have to check which data are populated ...
0
votes
0answers
20 views

How to force rsync to recopy files with equal timestamp but not newer ones

I need rsync to recopy all files where timestamp is equal on the receiver, skipping newer ones.
0
votes
0answers
143 views

sshfs connection breaks, and cannot be re-established (“Stopping User Manager for UID 65534”)

A Raspberry Pi device connect to my NAS via sshfs, and saves a large backup on it. After some time, the sshfs connection breaks, resulting in a broken backup. At the raspberry system, the sshfs ...
0
votes
0answers
91 views

rsync, find, and other useful commands for synchronizing a large quantity of data

Here is the structure of the folders I would like to consider: /mnt/network/ is my network drive and /local/ is my local folder. What I want is to synchronize the content of these two folders ...
0
votes
0answers
34 views

rsync failed on SSH even after changing Maxstartup option in sshd_config

I am using following command to copy file from another system. sshpass -p 'XXXXX' rsync --partial -avvvv --inplace --rsh=ssh -e 'ssh -vvvv -p 62002 -o StrictHostKeyChecking=no -l username' ...
0
votes
0answers
30 views

Exclude pattern not working for rsync

The following command is working correctly for copying only files matching Mem* rsync -uvma '--include=*/' '--include=**/Mem*' '--exclude=*' ../srcdir/ /targdir I would like to also exclude a ...
0
votes
0answers
160 views

Backup debian folder to qnap nas with rsync repeatly every day

Sorry for this dummy question, but I really stuck here. I have debian web server, which have a backup with usb hdd. I would like to get that backup and send it to my NAS. My NAS is QNAP model TS-231, ...
0
votes
0answers
26 views

After rsync no files exist

From my Ubuntu server I used rsync to copy all my data to my USB drive (FAT). After copying the data (it needed quite a while to copy so I guess the copying did happen) I deleted it from the server. ...
0
votes
0answers
46 views

Working with Rsync and changing archives

I'm working with Acronis archives that I want to transfer offsite using rsync (since backing up via FTP or SMB is too troublesome with Acronis via internet). I`m using Acronis to backup Windows ...
0
votes
0answers
162 views

Trying to setup a 2 way file sync in Linux

I am trying to setup a 2 way file sync in linux of reasonably small data-set. I would like to replicate data over WAN so distributed filesystems like gluster are not in point of my interest - they are ...
0
votes
0answers
13 views

sync source A into destination B

I want to create a perfect copy of A in B. I'm using this command, but is working good only on same existing folders rsync -h --progress --stats -r -tgo -p -l -D --delete /A /B if folder x exists ...
0
votes
0answers
44 views

rsync question about a directory

I went ahead and used rsync to back up a root directory called /files my exact commands werersync -avzh /files willc66@server.com:/backup, inside my /files directory I had 2 sub directories home and ...
0
votes
0answers
91 views

rsync unexpected EOF in read_timeout

I'm trying to rsync directories from server A to server B, but i get the following error: permission denied unexpected EOF in read_timeout Command is: rsync -avzn ${LOCAL_DIR} ...
0
votes
0answers
126 views

Rsync Issue (AWS EC2)

I have spent quite a bit of time trying to Rsync from a remote to a local machine but been having issues with finding the synced files apparently. The command I entered is: sync -avzhe ...
0
votes
0answers
400 views

rsync does not return on error

I am running a backup script from a udev rule. The script mounts and copies data to a newly connected USB drive, with help of rsync. # Mounting stuff MOUNTPOINT=/media/backup export ...
0
votes
0answers
91 views

rsync --delete doesn't delete all files

This is the script I have so far rsync -avz -e ssh --delete /tftp/ username@192.168.1.51:/tftp/ I want it to completely copy every directory/file in /tftp/ and overwrite everything in the ...
0
votes
0answers
243 views

Script to compare directories and move files (like rsync)

I use rsync to sync data between two servers. If I completely rebuild the directory structure, rsync cannot understand this and will attempt to recopy everything. I am aware that Unison is capable ...
0
votes
0answers
186 views

Use Rsync with HTTP

Is it possible to use rsync with an HTML POST request? If so what would the rsync command look like? For example let's say using HTML5 I have this (bear with me going back to linux stuff): <form ...
0
votes
0answers
398 views

Why I can't pass ip to rsync script?

I am writing script were rsync should be called and ask for password. However I cannot pass IP as argument. I think I am missing something simple. Any ideas? Even trivial script like this just outputs ...
0
votes
0answers
111 views

rsync include-from exlcude-from with including subdir but excluding dirs above

I try to use rsync with --include-from and --exclude-from options. I have a directory structure like: /docs/domain-[a-z]/templates Now I want to sync templates only if something is in there. Further ...
0
votes
0answers
247 views

Rsync seems to back up files that haven't been opened or changed

I have started using rsync to back some data on my mac to an external HD. It works really well, but I have noticed something odd. Every time I run the command, I get a list of files that haven't been ...