Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [rsync]

rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

0
votes
1answer
15 views

rsync copy file without user and password less access

Please explain below mention command we are not passing username as well password still we can do rsync. rsync -avz rsync.apache.org::apache-dist /path/to/mirror
0
votes
1answer
27 views

Rsync shows files being copied, but the destination directory doesn't have the files

I put a new drive in my NAS(Freenas) and need to copy the contents from another drive. I'm signed in as root via SSH. I've been using the command rsync -avP /mnt/Red3TB/Temp/Videos/ /mnt/Red4TB/Temp/...
0
votes
1answer
32 views

rsync not quitting and running next rsync

I have a shell script that has 6 rsync commands. What it should do is run the first and then move on to the next. However, what it does right now is do the first once it is finished it'll hang and ...
1
vote
0answers
49 views

Rsync pull script? [closed]

I need to make a Rsync pull script on my backup server from my rsync server running on: Rsync port: 873 Ip: 192.168.1.189 User: Rene Password 12345 Folder on Rsync server: / Myfiles-share It should ...
0
votes
0answers
18 views

Why --link-dest stops creating hardlinks when --relative is added?

Why is the first rsync command working perfectly creating a clone of /tmp/data to /tmp/bak using hardlinks but the second creates a clone by copying bytes instead of hardlinking? rsync -a --link-...
3
votes
1answer
21 views

rsync: Why is “quick check” default but “--times” is not?

rsync's manpage states: Rsync finds files that need to be transferred using a "quick check" algorithm (by default) that looks for files that have changed in size or in last-modified time. Any ...
0
votes
1answer
25 views

Run rsync as root but keep target owner

I've already checked many threads regarding the topic and tried different flags combinations, but couldn't solve the problem. Scenario: I'm working under user A and have source files owned by A, ...
4
votes
1answer
61 views

Use rsync to clone one server to another?

I have two Debian 9 servers, server A and Server B. Server A is a LAMP stack server. Server A is slow. Server B is fast. I want to clone server A to server B without shutting down server A. How do ...
1
vote
0answers
15 views

Rsnapshot made my external disk run out of space

I have Rsnapshot doing incremental backups from Client1 to Server1 (RAID 5) within folder "BACKUP". On Server 1, tonight, I copied the "BACKUP"to an external disk for the first time using the command ...
1
vote
2answers
27 views

rsync as root - does it change the ownership of synced files?

I'm going to be using rsync to sync an old home folder onto a backup drive. I'm thinking of using rsync as root. Is there a way to avoid changing the ownership of the files etc I copy?
-1
votes
1answer
19 views

How to sync ram disk of one server to another

I have created ram disk as /mnt/ramdisk/test in both server A and B. Where I will be writing dedicated content in each server's ram disk. Now, i want the content of ram disk in server A to sync with ...
-1
votes
1answer
20 views

Why does adding -prune to my sync script cause rsync to do a DRY-RUN?

I'm testing a script to do a by-directional sync of two directories intelligently using rsync. Since I'm testing many of the rsync options are not applicable to the testing environment including the ...
-1
votes
0answers
81 views

rsync: read error: Connection reset by peer (104)

I was running rsync just fine between 2 windows machine with cygwin. I am moving files from old Windows 2008 server to NFS share storage through 2016 Windows server. Don't ask why, that's the way it ...
0
votes
1answer
47 views

Linux mint files color changed in terminal

I am using Linux Minter 19.0 on two machines. I have a src and destination folder. My src folder is on my local machine, and the dest folder is on a remote machine. I ran rsync to move files from ...
0
votes
0answers
15 views

rsync - omit top-level dir time

I would like to rsync -avh /usr/local/ remote:/usr/local/ and got rsync: failed to set times on "/usr/local/.": Permission denied (13) ./ Could I sync dir time for subdirs but not for the top dir? ...
0
votes
1answer
22 views

rsync: copy symlink realpaths vs. re-create symlinks

I have this command now: rsync --copy-links -r src dest this will copy the target files of any symlinks in src and write out copies of those files in dest. My question is - is there a way to re-...
0
votes
2answers
54 views

rsync based on modified time [duplicate]

I am using rsync rsync $source $destination. How do I rsync based on modified time? I see an option for file size --size-only but nothing for modified time?
1
vote
0answers
71 views

rsync error code 20 when ran under systemd

Running CentOS7.4 , rsync v3.1.2 I've a python script(v3.6) that polls a remote file server location using rsync. Rsync ensures that the drop folder on the remote location is identical to the folder ...
1
vote
1answer
32 views

Rsync - Splitt Folder / Subfolder structure

I use openmediavault (OMV is a NAS software from openmediavault.org) and have different shares defined. In one of the shares I have a folder structure like this: (examples) Subfolder"ABC"/...
3
votes
1answer
39 views

Copy *changed/new files only* to a DIFFERENT directory?

I have two directories that I'd like to keep in sync. For backup purposes I'd like to run the rsync command such that it will copy new or changed files to a separate USB drive (or another directory) ...
1
vote
1answer
71 views

Rsync - write permission denied

I use rsync on Windows (Cygwin), where I move files from shared folder (from another Windows instance) to NFS storage. I have mapped the shared folder to one drive and mounted the NFS folder to ...
1
vote
0answers
37 views

How to append a new disk to an existing folder

I have a server with a program which rapidly writes data to a folder. I attached a new disk to the server, mounted it and now I want it to expand or replace the folder with data. The program works ...
1
vote
1answer
54 views

rsync not copying any files

I'm running something like the following: rsync -av -e "ssh" --include="dir1/***" --include="file1.txt" --exclude="*" superuser@remote-server:/var/www/ /var/, and all I'm getting is the following ...
1
vote
1answer
21 views

Rsync exclude-from through ssh

I want to rsync content from a remote host to my laptop through ssh. There are files I want to exclude, and in the remote host, there is a file called ".rsyncexclude" that specifies what I want to ...
-1
votes
1answer
36 views

Copy dir and its contents in RAM and backup on the original dir

I'd like to copy a dir and its contents in RAM, do my routines and periodically make some backups/sync on my original dir. So if I have a dir mydir/ with 2 files: $ ls mydir/ file1.tex file2.tex I ...
1
vote
0answers
50 views

rsync keeps previous partial file when resuming

I often transfer large files from a remote server using rsync with the following command : rsync -rvhm \ --progress \ --size-only \ --stats \ --partial-dir=.rsync-partial \ "user@...
0
votes
1answer
30 views

Did my rsync successfully back-up all data or not?

It looks like not a single byte is missing after the rsync, but there were some errors: ujjain@DS3018xs:/volume1$ cat rsync.sh rsync -av photo.tar /var/services/homes/ujjain/nfs/RAIDF1/ rsync -av ...
0
votes
2answers
49 views

Problem with permissions when trying to sync two external hard drives with rsync

I'm trying to sync an external hardrive with the one containing my photo archive. I wanted to begin with the basics, so I run: rsync -aHm --delete /Volumes/archivo_1a/ /Volumes/archivo_1c/ In the ...
3
votes
0answers
66 views

rsync gets stuck on *.png files [closed]

I have been running the following rsync command as a cronjob for the past month. Today I discovered that this has been getting stuck on a *.png file and none of my other data has been backing up! In ...
0
votes
3answers
46 views

How to properly substitute a string containing spaces in my script

In my script I've got: sshkey="/Users/me/some path/with spaces/id_rsa" dstport=... dstparent=... dstuserhost=... rsync -az --delete -e "ssh -i $sshkey -p $dstport" $src $dstuserhost:$dstparent And ...
1
vote
0answers
38 views

how to get the status in dry run on rsync command

Use case - Compare all the files and directories on the mounts ( /apps , /logs , etc ) and calculate which one is the latest and size differences. I am trying with rsync command , but with the ...
2
votes
0answers
127 views

Parallel Copy from local folders to remote servers at the same time

I have a multiple folders, and each folder has about 1500 files. I have a kind of for loop going over each folder and then sending the files to either one or 4 remote hosts depending upon the ...
1
vote
1answer
17 views

Determine extra size of hard link tree

It is relatively common to use a "hard link tree" to create a second backup of a folder that is effectively just a copy of the files that have changed since the original backup. For example, rsync ...
-1
votes
0answers
33 views

Does rsync --compare-dest evaluate once or after each file?

I am using rsync to archive a very large number of files from a 36TB ZFS pool to three large separate disks. I don't care which file ends up on which of the three disks I do not want duplicates I ...
1
vote
1answer
18 views

rsync directories in to remote server

I would like to know how to sync directories with same owner, timestamp, group etc I tried below but it ask for my password and respective files/directories will be copied with my name. Please ...
3
votes
1answer
137 views

Why is rsync taking a long time on large files that already exist?

I made a backup of one of my computer's internal drives to an external. The next time I used rsync to sync the two drives, I noticed that large (40 + GB) files that weren't modified were still taking ...
1
vote
1answer
148 views

Does rsync completely overwrite files with different timestamps?

I've used a command similar to this to rsync files from macOS to Linux: rsync -avz <ip-address>:/Backup/ Backup/ The folder Backup/ was previously copied from the same machine using scp, with ...
0
votes
1answer
44 views

scp/rsync autocomplete works one way but not the other

I have two machines, laptop and server. Both of them source /etc/bash_completion in .bashrc. What works: server$ scp file laptop:~/stage/[tab][tab] server$ scp laptop:~/stage/[tab][tab] . server$ ...
1
vote
1answer
47 views

Run rsync only if target directory exists?

I have a secondary backup drive that is usually stored offsite, but sometimes mounted. I'd like to put something in a crontab that automatically clones my backup drive to the secondary backup if it's ...
1
vote
0answers
23 views

Unintentional bandwidth throttling — where else to look?

This is embarrassing, but I seem to have inadvertently set a persistent bandwidth throttle on SSH connections from my Ubuntu machine. When transferring files from a remote server via scp, sftp, or ...
-1
votes
0answers
22 views

Efficient way to move data before rsync

I'm trying to migrate data to a replacement VM. In trying to speed up the transfer and reduce stress on the network pipe, I tried to tar and gzip the datadirs and transport across town, extract on the ...
1
vote
2answers
74 views

Create hardlinks instead of copying files with rsync

The following command finds recursively all files containing foo (but not bar) and preserves the directory structure in the target directory, for example if I have /path/to/2017/foo.ps and /path/to/...
1
vote
0answers
69 views

Linux file sync options [closed]

Looking for advice on best way of setting up file replication between two Linux servers running Ubuntu. I've previously used rsync, and csync2 in a clustering situation I ran previously. I know of ...
0
votes
3answers
63 views

Local Repo Update

I got a local repository in /var/www/html/centos/7 directory. In here, all rpm packages from centos are downloaded. I will create a crontab for updating my local repository every 1 week or sth. I ...
0
votes
1answer
34 views

How to rsync chronologically starting with the most recent files

I have the following directory structure item_1 item_12 item_33 ..etc.. Now I would like to start rsyncing from the most recent files and chronologically sync down the list. Or option 2: How to ...
0
votes
1answer
32 views

what is the right approach to copy folder content that include links

we have the following folders / links /files under /usr/hdp/2.6.0.3-8/zookeeper folder -rw-r--r--. 1 root root 794542 Apr 1 2017 zookeeper-3.4.6.2.6.0.3-8.jar drwxr-xr-x. 6 root root 4096 Mar 28 ...
1
vote
1answer
62 views

rsnapshot is not doing incremental backup

I recently installed rsnapshot and trying to get it to do incremental backups. Now, I run first "rsnapshot alpha" and it creates alpha.0. Folder is 8GB Then I add a 1 GB video file to the source ...
0
votes
1answer
120 views

ssh: Warning despite disabling strict host key checking

I am running an ansible task but this is more of an ssh issue; I execute an rsync command (from my localhost to a vagrant machine) as follows: command: "rsync -zaP -e 'ssh -p {{ ansible_port }} -o ...
1
vote
1answer
35 views

Can I use rsync to move a list of files in different directories to a remote sever without logging in more than once?

So, I'm trying to write a script to back up some various configuration files with my ssh fileserver, but I'm not sure the best way to go about this. It would be nice if I could just fill a file with ...
0
votes
1answer
101 views

Getting Rsnapshot permissions right

I've used rsync for years to keep a backup copy of my /home/User1 (Client1) on my Server1 (in a folder /mnt/Server1/Backup). These are not production machines. This folder is mounted on Client1 with ...