rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

3
votes
2answers
984 views

rsync mkstemp failed: Invalid argument (22) with USB flash drive

I use "Back In Time" which is nothing more than a front end GUI to rsync version 3.0.9 protocol version 30. I'm running ubuntu 12.04. My backup device is a locally mounted USB flash stick/drive ...
20
votes
2answers
11k views

How to use rsync to backup a directory without git subdirectory

I want to copy my c directory with all subdirectories excluding ./git subdirectory. I do it using rsync : echo "copy c and sh files " rsync -a --include='*.c' --include='*.sh' --include='*/' ...
1
vote
1answer
26 views

What happens if rsync is scheduled to do backup, but remote location is unavailable?

I'm thinking of creating a sync/backup routine with rsync for some crucial files between my Desktop computer and Laptop. The point is not to use a Cloud service. I would set up an automated schedule ...
0
votes
0answers
53 views

How to find 100 GB of most recently modified files and send to rsync for local synchronization

I need to select 100gig of most recently changed files from a local directory and do an rsync to a local directory (skipping files that are already rsynced). If I try something like find . -mtime ...
1
vote
2answers
303 views

What's the differernce between differential and incremental backup in terms of rsync command?

I use the following rsync command to backup my local folder ~/dir1 to a remote backup server: rsync -a ~/dir1 username@remote_host:destination_directory As per my understanding it's incremental ...
1
vote
1answer
152 views

rsync leads to almost all corrupted files [closed]

I copied files from one server to another with rsync 3.0.6 on CentOS 6: rsync --exclude=".bash*" --progress --verbose -lpogtzr /home/ 1.2.3.4:/home/ but many synced files have different checksum on ...
1
vote
2answers
36 views

Rsync two “filepath” found by find commands [closed]

Original file /001day/backup/001m/name_test_v1.txt Destination file /001date/003m/name_test_v12.txt Method 1 rsync -av --progress /001day/backup/001m/ /001date/003m/ Method 2 ...
1
vote
1answer
36 views

Backup in Linux with resume support only the latest one

We have a backup server in a remote location with low bandwidth. We send data to that server in a regular basis from our Datacenter. The file size of each day backup is around 100 GB. We would like to ...
1
vote
3answers
149 views

Get rsync to report if any local files were updated

I'm running rsync to do pull from a remote host to the local host. rsync -a --update user@remotehost:/files/ ~/files/ I'm running that command from java and using the exit code to work out if it ...
0
votes
1answer
47 views

rsync and logDtpre.iLsfx

What is the parameter -logDtpre.iLsfx or -vlogDtpre.iLsfx or -vvlogDtpre.iLsfx used for with rsync? Here's an example of where I've seen this used: rsync --server --sender -vvlogDtpre.iLsfx
0
votes
0answers
23 views

fetch data from remote server for last 15mins

I am fetching data from a remote server using rsync and the data that I have to fetch is from different subfolders . So , connecting the remote machine via ssh I have to check which data are populated ...
1
vote
0answers
138 views

Can rsync command run using multiple cpu?

I executed this command but it took long time when checking checksum. Load average was 1.00 at all times. Can rsync command run using multiple cpu? $ rsync --checksum -av -e ssh /usr/local/xxx/* ...
1
vote
1answer
233 views

rsync with different user

I'm working with two ubuntu instances on AWS (which I use a pem key to access them). I set up rsync for both instances, and it works if I use the default user which is ubuntu@ipaddress. However if I ...
1
vote
1answer
79 views

Preserve date modified on directories / folders with rsync

I am trying to backup a failing hard drive and rsync would be ideal due to the features it has such as progress indicator and ability to stop and resume. The one issue I am having is that while file ...
1
vote
0answers
233 views

Using Rsync to SSH and Find files

Hello I am trying to use Rsync to SSH into a remote server and pull a certain type of file that has been modified within the last 24 hours. Here is what I am trying: rsync -avx --timeout=480 ...
1
vote
0answers
62 views

Live OS freezes while copying files

I was trying to backup many files (~10,000) from a hard drive on an OS-less notebook to an external 500 GB HDD, so I booted up the Fedora 22 Live XFCE spin using a USB, started the copy and after 5 ...
1
vote
1answer
80 views

rsync: show when newer file on destination is to be overwritten

I'm running a command that updates some files to a centralized server. The command does first a --dry-run to show which files will be transferred. It may happen that a newer file on server may have to ...
1
vote
1answer
115 views

Incremental backup script (shared hosting)

Please consider I'm not sys admin so I have only limited experience with the tools involved, I know there are similar question but I cannot find anything that suit my needs. In a similar question ...
1
vote
1answer
293 views

scp can't upload/download files even though ssh works

I can connect to my server using ssh dziura and it works as it should, but I have problems copying any files to/from the server using rsync/scp/sftp. Scp: $ scp dziura:/home/kossak/file_remote.txt . ...
0
votes
1answer
62 views

Calling a shell rsync command from C

I am creating a basic C file in order to learn the basic Linux commands a little better. I am trying to implement a tar back up function. I am struggling to implement it in C (still learning C) so ...
0
votes
0answers
24 views

How to force rsync to recopy files with equal timestamp but not newer ones

I need rsync to recopy all files where timestamp is equal on the receiver, skipping newer ones.
0
votes
1answer
256 views

Why does 'rysnc' change file-system permissions?

I am trying to use rsync to sync files from my laptop (Ubuntu 14.04) to an external disk. When connecting the disk I start the sync with the following command: rsync -av --delete ...
10
votes
4answers
62k views

rsync without prompt for password

I need to execute rsync, without it prompting me for password. I've seen in rsync manpage that it doesn't allow specifying the password as command line argument. But I noticed that it allows ...
1
vote
2answers
49 views

Using rsync to synchronize directories

I have a script that I am using to backup a directory on a CentOS 6 machine. It's very basic but it is executing rsync -a remote:~/original ./backup This works fine: it is copying the contents of ...
1
vote
1answer
105 views

rsync with --link-dest options doesn't create hard links [closed]

I created a backup script that should create incremental backups every day and a full backup once a week from a remote host to my external backup hard drive. (short example at the bottom) The script ...
0
votes
1answer
155 views

SSH known_hosts ignored on one machine

I am experience strange behavior using ssh with a jump host. While the setup works on machine A (cygwin, OpenSSH_7.1p1, OpenSSL 1.0.2d 9 Jul 2015) it does not work on machine B (OpenSSH_6.7p1 ...
2
votes
2answers
84 views

How to get information about files being copied to my machine by remote rsync command?

I am rsyncing a directory from machine B to machine A. rsync command is run on machine B. On machine A, what kind of information can I get about this rsync process (progress/amount of data downloaded ...
1
vote
1answer
74 views

Rsync over custom shell with fifo

I'm trying to use rsync over a custom shell created with fifo. However I cannot find a way to deal with it : The script initsh to simulate a standard shell by fifo : #!/bin/bash rm fin mkfifo fin ...
1
vote
2answers
47 views

Is it necessary to transfer `tar` files through `rsync` in archive mode?

I have a bunch of tar files in my machine which I want to transfer to an external hard drive (EHD); they where created preserving permissions (using the -p flag). I plan to use rsync to copy them to ...
2
votes
2answers
266 views

rsync option to exclude partial files

We are using rsync to sync two folders on same machine. Files will be written to a source folder from another application. We have the problem that, even if a file is not completely written/copied to ...
2
votes
1answer
47 views

Is it feasible to update the modified times only without copying files when using rsync?

The modified times of a large amount of local files are incorrect. I want to update the timestamps by syncing the timestamps on the server. It would be time-consuming if the files themselves are ...
0
votes
0answers
242 views

sshfs connection breaks, and cannot be re-established (“Stopping User Manager for UID 65534”)

A Raspberry Pi device connect to my NAS via sshfs, and saves a large backup on it. After some time, the sshfs connection breaks, resulting in a broken backup. At the raspberry system, the sshfs ...
14
votes
2answers
29k views

Rsync Error 23: Can I tell which files were not transfered?

I ran sudo rsync -va --progress from the root of one ext. drive to a folder on another ext. drive. The reason is that the source drive has an error-ful NTFS and I don't have access to a Windows PC to ...
1
vote
0answers
351 views

rsync + renaming the copied files

Is it possible to change the name of the destination file (add some timestamp as a prefix) when copy is done by rsync ? For example, I can use the following command to change the name of the ...
2
votes
1answer
229 views

Rsync backup script for multiple servers

I have simple script that backing up data from remote server via ssh using rsync. I have external config file for that. In this config file I have variables: OPTIONS, REMOTE_IP, SOURCE and ...
1
vote
1answer
104 views

Getting error with rsync and scp

My issue is an odd one. I am logged into my University's server with my host name and all that good stuff. I am able to copy files from my local computer into my school's account. My issue, is the ...
2
votes
1answer
2k views

lsyncd and additional parameters for rsync

Currently Im using lsyncd to monitor data and sync them (same machine) settings{ logfile = "/var/log/lsyncd/lsyncd.log", statusFile = "/var/log/lsyncd/lsyncd_status.log", ...
0
votes
0answers
124 views

rsync, find, and other useful commands for synchronizing a large quantity of data

Here is the structure of the folders I would like to consider: /mnt/network/ is my network drive and /local/ is my local folder. What I want is to synchronize the content of these two folders ...
1
vote
3answers
1k views

Copy and get files from one machine which is connected via ssh to another one

I read a lot of answers to questions very similar to this one, but I couldn't find something that really fits my problem. Here's the situation. I have a machine whose address is "machine1@address", ...
0
votes
2answers
78 views

rsync directory tree structure with restricted depth and exclude specific folders

I want to rysnc my folder and subfolder tree structure without their files but with a max depth of 3 (/folder1/folder2/folder3) and exclude specific folders (ex. cache/) I have tried this command: $ ...
0
votes
0answers
18 views

rsync directory and subdirectories structure with max depth and except some specific folders [duplicate]

I want to rysnc all folders and subfolders only without their files but with a max depth of 3 (/folder1/folder2/folder3) and exclude some specific folder (ex. cache) I have tried this: $ rsync -azv ...
-2
votes
1answer
51 views

Update files from server to server

I am building a tool using bash script, to move the files from server to server. But the tool for update, so I don't want to overwrite the exist files, in the other server from the first moment. I ...
0
votes
2answers
251 views

checking rsync run status

We have a cron job running to rsync files from one server to a different host. The cron runs daily at midnight. The file copy is critical for us so we want to monitor the backup runs. We want to ...
2
votes
3answers
111 views

How can I keep rsync from using encryption and compression for the file transfers after the connection is authorized?

I understand that a secure connection (i.e. ssh) is needed to authorize a connection to the remote server. But after that is authorized can the data be transmitted without encryption and compression ...
0
votes
0answers
55 views

rsync failed on SSH even after changing Maxstartup option in sshd_config

I am using following command to copy file from another system. sshpass -p 'XXXXX' rsync --partial -avvvv --inplace --rsh=ssh -e 'ssh -vvvv -p 62002 -o StrictHostKeyChecking=no -l username' ...
7
votes
5answers
2k views

force copying a corrupted home directory

I have a home directory in a disk that has a lot of corrupted files. I am trying to save most files as possible. I am trying to create a backup of my home directory on an external drive using tar ...
0
votes
0answers
34 views

Exclude pattern not working for rsync

The following command is working correctly for copying only files matching Mem* rsync -uvma '--include=*/' '--include=**/Mem*' '--exclude=*' ../srcdir/ /targdir I would like to also exclude a ...
1
vote
1answer
2k views

RSync - Permission denied (13) while executing rsync as a root

I am trying to set up hourly rsync beetwen my local machine and remote server. I have already created a ssh certificate to enable login less connection to remote machine. Now however when I execute ...
2
votes
2answers
98 views

RSync Error in script

At my job, we have a central Backup server, running Debian Wheezy, and on-site servers at each site, also running Debian Wheezy. A few weeks ago, the central office tech emailed me that the backup ...
0
votes
1answer
24 views

Verbose copying of complete folder deleting target

I want to copy a development folder that has some changes into the server folder with rsync. Without rsync I would do it like rm -Rf /var/www/site cp -a dev /var/www/ But I would like to use rsync, ...