rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
2answers
44 views

Rsync behavior with changed files

When after running rsync for the first time a file is changed on the source, when you next run rsync on the same filesystem does it copy the whole file from the source again or just the changes to the ...
0
votes
0answers
31 views

Move files according to their name in corresponding folder only if the file does not exist already

I created a script that creates reports using R and Latex and that should move the reports to a designated location only if a report with the same size does not already exist there. The script looks ...
0
votes
0answers
41 views

rsync “no such file or directory” when using wildcard

I am trying to use rsync to copy the contents of a folder to another folder. This is the command I am using for this. rsync -v -r $folder64/Pictures/* $folder65/Pictures/ And here is the error ...
32
votes
3answers
23k views

Does rsync verify files copied between two local drives?

I want to make a fresh new copy of a large number of files from one local drive to another. I've read that rsync does a checksum comparison of files when sending them to a remote machine over a ...
2
votes
0answers
23 views

Certain folders are always missing using Rsync to server

I have tried several different ways using rsync modules and ssh trying to pull my linux desktop from my freenas server and no matter how I do it, certain folders are always missing. I am trying to ...
2
votes
2answers
108 views

pipe ls and awk to rsync

Trying to complete a script with the following steps: (1) select 1gig of most recently changed files across a number of subdirectories (2) preferably uses rsync to copy the files to local directory -- ...
2
votes
0answers
62 views

How to convert existing gz (gzip) files to rsyncable

I am using rsync to back up a repository that contains many gz files including many new ones each day. The rsync backup proceeds more slowly than it should because these gz files are not built with ...
8
votes
2answers
7k views

Copy symlink AND where it points to using rsync

It doesn't need to be done by rsync, but it would be nice not have to write a script to do this, and rsync is very close to what I want. rsync -a (or -l) can preserve symlinks, and -L can dereference ...
0
votes
2answers
40 views

rsync on running home dir causes infinite run

I have a rsync set to run every morning at 5am. sudo rsync -xrltDu --delete /home/mirthen/ /long/backup/folder/name/ It works for the most part, however it will once in a while hang and never ...
3
votes
2answers
866 views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
19
votes
2answers
9k views

How to use rsync to backup a directory without git subdirectory

I want to copy my c directory with all subdirectories excluding ./git subdirectory. I do it using rsync : echo "copy c and sh files " rsync -a --include='*.c' --include='*.sh' --include='*/' ...
1
vote
1answer
22 views

What happens if rsync is scheduled to do backup, but remote location is unavailable?

I'm thinking of creating a sync/backup routine with rsync for some crucial files between my Desktop computer and Laptop. The point is not to use a Cloud service. I would set up an automated schedule ...
15
votes
2answers
21k views

rsync compare directories?

Is it possible to compare two directories with rsync and only print the differences? There's a dry-run option, but when I increase verbosity to a certain level, every file compared is shown. ls -alR ...
0
votes
0answers
41 views

How to find 100 GB of most recently modified files and send to rsync for local synchronization

I need to select 100gig of most recently changed files from a local directory and do an rsync to a local directory (skipping files that are already rsynced). If I try something like find . -mtime ...
1
vote
2answers
62 views

What's the differernce between differential and incremental backup in terms of rsync command?

I use the following rsync command to backup my local folder ~/dir1 to a remote backup server: rsync -a ~/dir1 username@remote_host:destination_directory As per my understanding it's incremental ...
1
vote
1answer
66 views

rsync leads to almost all corrupted files [closed]

I copied files from one server to another with rsync 3.0.6 on CentOS 6: rsync --exclude=".bash*" --progress --verbose -lpogtzr /home/ 1.2.3.4:/home/ but many synced files have different checksum on ...
1
vote
2answers
34 views

Rsync two “filepath” found by find commands [closed]

Original file /001day/backup/001m/name_test_v1.txt Destination file /001date/003m/name_test_v12.txt Method 1 rsync -av --progress /001day/backup/001m/ /001date/003m/ Method 2 ...
1
vote
1answer
22 views

Backup in Linux with resume support only the latest one

We have a backup server in a remote location with low bandwidth. We send data to that server in a regular basis from our Datacenter. The file size of each day backup is around 100 GB. We would like to ...
1
vote
3answers
59 views

Get rsync to report if any local files were updated

I'm running rsync to do pull from a remote host to the local host. rsync -a --update user@remotehost:/files/ ~/files/ I'm running that command from java and using the exit code to work out if it ...
0
votes
1answer
150 views

rsync “unknown module” error [duplicate]

I use rsync for backing up the data from servers to a backup machine. For that purpose I start bash scripts via cronjobs but one of them is not working. I searched through the web to see if there is a ...
0
votes
1answer
32 views

rsync and logDtpre.iLsfx

What is the parameter -logDtpre.iLsfx or -vlogDtpre.iLsfx or -vvlogDtpre.iLsfx used for with rsync? Here's an example of where I've seen this used: rsync --server --sender -vvlogDtpre.iLsfx
0
votes
0answers
18 views

fetch data from remote server for last 15mins

I am fetching data from a remote server using rsync and the data that I have to fetch is from different subfolders . So , connecting the remote machine via ssh I have to check which data are populated ...
1
vote
0answers
57 views

Can rsync command run using multiple cpu?

I executed this command but it took long time when checking checksum. Load average was 1.00 at all times. Can rsync command run using multiple cpu? $ rsync --checksum -av -e ssh /usr/local/xxx/* ...
1
vote
1answer
94 views

rsync with different user

I'm working with two ubuntu instances on AWS (which I use a pem key to access them). I set up rsync for both instances, and it works if I use the default user which is ubuntu@ipaddress. However if I ...
1
vote
1answer
47 views

Preserve date modified on directories / folders with rsync

I am trying to backup a failing hard drive and rsync would be ideal due to the features it has such as progress indicator and ability to stop and resume. The one issue I am having is that while file ...
1
vote
0answers
153 views

Using Rsync to SSH and Find files

Hello I am trying to use Rsync to SSH into a remote server and pull a certain type of file that has been modified within the last 24 hours. Here is what I am trying: rsync -avx --timeout=480 ...
1
vote
0answers
39 views

Live OS freezes while copying files

I was trying to backup many files (~10,000) from a hard drive on an OS-less notebook to an external 500 GB HDD, so I booted up the Fedora 22 Live XFCE spin using a USB, started the copy and after 5 ...
1
vote
1answer
45 views

rsync: show when newer file on destination is to be overwritten

I'm running a command that updates some files to a centralized server. The command does first a --dry-run to show which files will be transferred. It may happen that a newer file on server may have to ...
1
vote
1answer
68 views

Incremental backup script (shared hosting)

Please consider I'm not sys admin so I have only limited experience with the tools involved, I know there are similar question but I cannot find anything that suit my needs. In a similar question ...
1
vote
1answer
172 views

scp can't upload/download files even though ssh works

I can connect to my server using ssh dziura and it works as it should, but I have problems copying any files to/from the server using rsync/scp/sftp. Scp: $ scp dziura:/home/kossak/file_remote.txt . ...
0
votes
1answer
46 views

Calling a shell rsync command from C

I am creating a basic C file in order to learn the basic Linux commands a little better. I am trying to implement a tar back up function. I am struggling to implement it in C (still learning C) so ...
0
votes
0answers
20 views

How to force rsync to recopy files with equal timestamp but not newer ones

I need rsync to recopy all files where timestamp is equal on the receiver, skipping newer ones.
0
votes
1answer
91 views

Why does 'rysnc' change file-system permissions?

I am trying to use rsync to sync files from my laptop (Ubuntu 14.04) to an external disk. When connecting the disk I start the sync with the following command: rsync -av --delete ...
10
votes
4answers
50k views

rsync without prompt for password

I need to execute rsync, without it prompting me for password. I've seen in rsync manpage that it doesn't allow specifying the password as command line argument. But I noticed that it allows ...
1
vote
2answers
47 views

Using rsync to synchronize directories

I have a script that I am using to backup a directory on a CentOS 6 machine. It's very basic but it is executing rsync -a remote:~/original ./backup This works fine: it is copying the contents of ...
1
vote
1answer
54 views

rsync with --link-dest options doesn't create hard links [closed]

I created a backup script that should create incremental backups every day and a full backup once a week from a remote host to my external backup hard drive. (short example at the bottom) The script ...
1
vote
2answers
68 views

Looking for rsync+ssh-based method as alternative to Dropbox

I want to set up a personal (i.e. one user) Dropbox alternative using rsync, to keep some directories synchronized over several Unix hosts. Since only one user (namely, me) will be changing the ...
0
votes
1answer
76 views

SSH known_hosts ignored on one machine

I am experience strange behavior using ssh with a jump host. While the setup works on machine A (cygwin, OpenSSH_7.1p1, OpenSSL 1.0.2d 9 Jul 2015) it does not work on machine B (OpenSSH_6.7p1 ...
2
votes
2answers
69 views

How to get information about files being copied to my machine by remote rsync command?

I am rsyncing a directory from machine B to machine A. rsync command is run on machine B. On machine A, what kind of information can I get about this rsync process (progress/amount of data downloaded ...
1
vote
1answer
55 views

Rsync over custom shell with fifo

I'm trying to use rsync over a custom shell created with fifo. However I cannot find a way to deal with it : The script initsh to simulate a standard shell by fifo : #!/bin/bash rm fin mkfifo fin ...
1
vote
2answers
35 views

Is it necessary to transfer `tar` files through `rsync` in archive mode?

I have a bunch of tar files in my machine which I want to transfer to an external hard drive (EHD); they where created preserving permissions (using the -p flag). I plan to use rsync to copy them to ...
2
votes
2answers
157 views

rsync option to exclude partial files

We are using rsync to sync two folders on same machine. Files will be written to a source folder from another application. We have the problem that, even if a file is not completely written/copied to ...
2
votes
1answer
42 views

Is it feasible to update the modified times only without copying files when using rsync?

The modified times of a large amount of local files are incorrect. I want to update the timestamps by syncing the timestamps on the server. It would be time-consuming if the files themselves are ...
0
votes
0answers
143 views

sshfs connection breaks, and cannot be re-established (“Stopping User Manager for UID 65534”)

A Raspberry Pi device connect to my NAS via sshfs, and saves a large backup on it. After some time, the sshfs connection breaks, resulting in a broken backup. At the raspberry system, the sshfs ...
11
votes
2answers
23k views

Rsync Error 23: Can I tell which files were not transfered?

I ran sudo rsync -va --progress from the root of one ext. drive to a folder on another ext. drive. The reason is that the source drive has an error-ful NTFS and I don't have access to a Windows PC to ...
1
vote
0answers
115 views

rsync + renaming the copied files

Is it possible to change the name of the destination file (add some timestamp as a prefix) when copy is done by rsync ? For example, I can use the following command to change the name of the ...
2
votes
1answer
148 views

Rsync backup script for multiple servers

I have simple script that backing up data from remote server via ssh using rsync. I have external config file for that. In this config file I have variables: OPTIONS, REMOTE_IP, SOURCE and ...
1
vote
1answer
54 views

Getting error with rsync and scp

My issue is an odd one. I am logged into my University's server with my host name and all that good stuff. I am able to copy files from my local computer into my school's account. My issue, is the ...
1
vote
1answer
1k views

lsyncd and additional parameters for rsync

Currently Im using lsyncd to monitor data and sync them (same machine) settings{ logfile = "/var/log/lsyncd/lsyncd.log", statusFile = "/var/log/lsyncd/lsyncd_status.log", ...
0
votes
0answers
91 views

rsync, find, and other useful commands for synchronizing a large quantity of data

Here is the structure of the folders I would like to consider: /mnt/network/ is my network drive and /local/ is my local folder. What I want is to synchronize the content of these two folders ...