Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [rsync]

rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

0
votes
1answer
19 views

Is there some program that can copy sparse file (/var/log/lastlog) over ssh as fast as cp (on local pc)?

I'm backing ip my server via rsync over ssh but /var/log/lastlog file is 1.2G (it takes only 24K on the hdd). On a local machine cp can copy it for no time (a few ms) but rsync requires reading the ...
1
vote
1answer
34 views

Rsync not correctly copying Symlinks

I have an rsync to copy over some rpms from one server to another but the issue is that the symlinks are not being created properly on the receiving server. My rsync options are -avz --force --delete ...
1
vote
1answer
40 views

Compare two directories: if files don't exist or are the same, move; else, do nothing

I have four types of files: JUST_SOURCE exist only in the source directory JUST_TARGET exist only in the target directory SAME exist in in both source and target directories, and have the same ...
-1
votes
1answer
26 views

Transferring big files from local hard drive to computing cluster by rsync

I have 40 WGS files each one about to 0.1 TB stored in a hard drive next to me. I need to transfer them to my scratch in our computing cluster. I am using windows OS so I am using MobaxTerm for ...
0
votes
0answers
22 views

Backup configuration for Ubuntu Server

How can I make a restore point for a Ubuntu Server 18.04? I have a clean install of the Ubuntu Server OS and before installing any Web Server I want to perform a backup and if something goes wrong ...
0
votes
0answers
25 views

Snapshot or rsync for all configuration in Ubuntu Server 18.04 using LVM [on hold]

I have hosted a VPS online. This VPS has 130GB SSD and Ubuntu Server 18.04 installed under LVM /dev/sda1 Type Linux LVM. I want to configure this software for hosting a Web Application. The idea ...
0
votes
1answer
31 views

Encrypting a currently used external hard drive such that it can be updated with rsync?

I currently have an unencrypted external hard drive that I use as a backup for my encrypted (with LUKS) main machine. To update my backup, I simply log in to the main machine and rsync to my external ...
0
votes
0answers
42 views

rsync problem when spaces in files when using recursive [on hold]

I am using Arch Linux and rsync version 3.1.3 protocol version 31. When I do rsync -aEu ~/folderA/ /run/media/USER/folderB/ and folderA contains the file file 1.txt (with space). folderA is in my ...
0
votes
0answers
21 views

rcp/rsync create a file with a single question mark as name, instead of the original file name

Here's are the commands I've tried (in a .sh file). rcp $1/target/$1*SNAPSHOT.jar remote_server:~/ rsync -v $1/target/$1*SNAPSHOT.jar remote_server:~/ Both of these create a file on remote_server ...
-1
votes
2answers
45 views

How can I redirect rsync output to a directory with date and time stamp?

I want to redirect the output of rsync to a particular directory with the date and time stamp. Example: rsync -r source-dir dest-dir/current-date-time Is there any way the "current-date-time" folder ...
2
votes
0answers
54 views

How does the rsync symlink exploit work?

munge symlinks [...] The way rsync disables the use of symlinks is to prefix each one with the string "/rsyncd-munged/". This prevents the links from being used as long ...
0
votes
1answer
20 views

Why does `RSYNC_RSH` not work, but `--rsh` does?

Setting RSYNC_RSH is not working, but the --rsh option is. Why? rsync is correctly using the --rsh option: $ rsync --rsh "echo" invalid invalid::invalid rsync: server sent "invalid rsync --server --...
1
vote
3answers
81 views

Initial rsync backup of large data slow to RAID 5

I'm using rsync to copy about 28TB of images to a 36TB RAID 5. The source has SSDs and the destination has 6 8TB 7200 SATA3 512e drives in a RAID 5 configuration. Servers are connected over a 10G ...
1
vote
1answer
42 views

Can we use rsyncd.conf to restrict rsync over ssh?

I had a look at the restricted rsync script, rrsync, which is mentioned in man rsync. Basically the client rsync command seems to pass all of its options through, to the remote rsync command that it ...
1
vote
2answers
37 views

How to recursively move one file type but only when another file type is also present?

In my directory tree, some subfolders contain both *.flac and *.mp3 files, but other subfolders contain only *.mp3 files. I'd like to move all of the *.mp3 files to another destination (a different ...
0
votes
0answers
23 views

exit 255 when copy with rysnc on linux

I would like to copy some files from my remote to google drive using rsync. On the terminal I do nohup rsync /mylocal/mydir/subdir/. mydrive:folder/data/mydir/subdir & but it exits giving ...
2
votes
0answers
12 views

lsyncd: big directories

My plan was to use lsyncd to synchronize a directory with about 1,5m files and 0,3m directories to another host. Performance is not most important. After first tests I see that lsyncd uses inotify ...
2
votes
1answer
50 views

rsync: Use filters to exclude top-level directory but include some of its subdirectories

I want to back up my /home directory with rsync. I have read rsync's man page and decided to use filter rules for this task. What I would like to achieve: Exclude all files and directories in the ...
2
votes
1answer
39 views

Bash scripting and rsync: how to include just some folders and subfolders and what happends if I use ../ as path with --delete

I have a bash script where I'm trying to copy some folders and archives in local with rsync. I have something like this: RootFolder A B C D D1 D2 D3 . . . ...
1
vote
2answers
78 views

How to recursively copy only the files from folders and subfolders?

Under /home folder we have many subfolders, as the following: /home/user1 /home/user2/user_sub_2 /home/user3/user_sub_3/info_sub /home/user4/INFO_FOLDER We want to copy all the files under /home, ...
1
vote
1answer
25 views

Rsync is syncing $HOME instead of the provided directory

Any idea why this rsync command could be syncing contents of a home directory instead of the actual path provided? echo "\${REMOTE_STORAGE_PATH}: ${REMOTE_STORAGE_PATH}/files/" rsync -zqr -e "ssh -p ...
2
votes
1answer
41 views

Why does rsync keep skipping the directory I want to sync? [closed]

I want to sync a directory between my Mac High Sierra machine and a CentOs 7 machine, excluding a certain file. I have tried the below (venv) localhost:dental davea$ rsync -e 'ssh -p 7822' --exclude=...
0
votes
0answers
18 views

Using Rsync for remote file exchange

I have 6 Linux (Ubuntu 32 bit) that are not in a network of any sort. How can I use rsync to sync the home folder between them every day or with some similar time frame?
0
votes
1answer
45 views

rsync output (ongoing) not recorded in new log file after rotation with newsyslog

I discovered this morning that on-going rsync output does not appear in the rsync log after rotation by newsyslog. It is lost In other words, a running rsync is logging to /var/log/rsync ...
2
votes
3answers
77 views

Copying Hundred of Thousands Files from Remote Directory to Another Remote Directory

I have a remote directory (SSH enabled) on 11.11.11.11/:/path/from (an Ubuntu machine) that has millions of tiny .txt small size files, doing like simple ls command or even opening the /path/from/ ...
5
votes
1answer
476 views

What happens when you rsync without a destination path? [duplicate]

I copied a file to destination without providing the path. It seems to have copied successfully, but i cant find the file in the destination, where could it be located? rsync -av --progress file.txt ...
0
votes
2answers
95 views

Backup remote Linux server to windows

I would like to backup a remote linux server into a windows workstation. I am looking for an approach similar to this, but in windows: Backup from remote server Is there any rsync client for windows ...
1
vote
1answer
112 views

No such file or directory during rsync/cp copy command

I am trying to copy my entire shares directory from one server to my current directory. Running the command: rsync -avhP /shares . it will copy 90% of the data to that directory but I am getting ...
1
vote
1answer
62 views

Rsync --progress parameter syntax error

when i try to use rsync with --progress or -P option (--progress --partial) i get an error saying: Unknown --info item: "flist" rsync error: syntax or usage error (code 1) at options.c(453) [client=3....
0
votes
1answer
59 views

How to know if rsync did not change any files?

In a bash script, I am using rsync to make an exact copy of a directory: rsync --verbose --archive --update --delete \ ~/cat-pics/ \ ~/top-secret/ But how can I get feedback on whether or ...
1
vote
1answer
79 views

RSYNC : exclude multiple files

I would like to sync two directories with excluding a few files. I tried below code but it fails in exclude. FILES=abc.zip,hh.sh,Workarea/test/hi.jpg rsync -av --exclude={$FILES} /home/test/ /home/...
0
votes
0answers
37 views

Set permissions and owner's group for destination folder with rsync

I'm transferring html pages to my web server with rsync with: rsync -r -og --chown=transfer:www-data webpage/* transfer@myserver:/path/to/wwwfolder/ I use the transfer account (dedicated for data ...
2
votes
2answers
73 views

How can I tar and gzip my web directory files and download (using rsync) it in one command from my local machine?

I'm rewriting my original question because I realized this is more efficient: I'd like to tar and gzip my website files and then download it. I know I can tar and gzip it with one command using tar ...
0
votes
1answer
59 views

How to store an rsync backup of my system on a NFS mount?

I'd like to use rsync to make a backup of my complete system including files owned by root and myself as well as other system and non-system users. I'd like to be able to restore the source directory ...
0
votes
1answer
34 views

rsync copy file without user and password less access

Explain below mention command we are not passing username as well password still we can do rsync. rsync -avz rsync.apache.org::apache-dist /path/to/mirror
0
votes
1answer
40 views

Rsync shows files being copied, but the destination directory doesn't have the files

I put a new drive in my NAS(Freenas) and need to copy the contents from another drive. I'm signed in as root via SSH. I've been using the command rsync -avP /mnt/Red3TB/Temp/Videos/ /mnt/Red4TB/Temp/...
0
votes
1answer
38 views

rsync not quitting and running next rsync

I have a shell script that has 6 rsync commands. What it should do is run the first and then move on to the next. However, what it does right now is do the first once it is finished it'll hang and ...
1
vote
0answers
56 views

Rsync pull script? [closed]

I need to make a Rsync pull script on my backup server from my rsync server running on: Rsync port: 873 Ip: 192.168.1.189 User: Rene Password 12345 Folder on Rsync server: / Myfiles-share It should ...
3
votes
2answers
62 views

Why --link-dest stops creating hardlinks when --relative is added?

Why is the first rsync command working perfectly creating a clone of /tmp/data to /tmp/bak using hardlinks but the second creates a clone by copying bytes instead of hardlinking? rsync -a --link-...
3
votes
1answer
36 views

rsync: Why is “quick check” default but “--times” is not?

rsync's manpage states: Rsync finds files that need to be transferred using a "quick check" algorithm (by default) that looks for files that have changed in size or in last-modified time. Any ...
0
votes
1answer
49 views

Run rsync as root but keep target owner

I've already checked many threads regarding the topic and tried different flags combinations, but couldn't solve the problem. Scenario: I'm working under user A and have source files owned by A, ...
4
votes
1answer
108 views

Use rsync to clone one server to another?

I have two Debian 9 servers, server A and Server B. Server A is a LAMP stack server. Server A is slow. Server B is fast. I want to clone server A to server B without shutting down server A. How do ...
1
vote
0answers
17 views

Rsnapshot made my external disk run out of space

I have Rsnapshot doing incremental backups from Client1 to Server1 (RAID 5) within folder "BACKUP". On Server 1, tonight, I copied the "BACKUP"to an external disk for the first time using the command ...
1
vote
2answers
61 views

rsync as root - does it change the ownership of synced files?

I'm going to be using rsync to sync an old home folder onto a backup drive. I'm thinking of using rsync as root. Is there a way to avoid changing the ownership of the files etc I copy?
-1
votes
1answer
29 views

How to sync ram disk of one server to another

I have created ram disk as /mnt/ramdisk/test in both server A and B. Where I will be writing dedicated content in each server's ram disk. Now, i want the content of ram disk in server A to sync with ...
-1
votes
1answer
24 views

Why does adding -prune to my sync script cause rsync to do a DRY-RUN?

I'm testing a script to do a by-directional sync of two directories intelligently using rsync. Since I'm testing many of the rsync options are not applicable to the testing environment including the ...
0
votes
1answer
65 views

Linux mint files color changed in terminal

I am using Linux Minter 19.0 on two machines. I have a src and destination folder. My src folder is on my local machine, and the dest folder is on a remote machine. I ran rsync to move files from ...
0
votes
0answers
26 views

rsync - omit top-level dir time

I would like to rsync -avh /usr/local/ remote:/usr/local/ and got rsync: failed to set times on "/usr/local/.": Permission denied (13) ./ Could I sync dir time for subdirs but not for the top dir? ...
0
votes
1answer
66 views

rsync: copy symlink realpaths vs. re-create symlinks

I have this command now: rsync --copy-links -r src dest this will copy the target files of any symlinks in src and write out copies of those files in dest. My question is - is there a way to re-...
0
votes
2answers
82 views

rsync based on modified time [duplicate]

I am using rsync rsync $source $destination. How do I rsync based on modified time? I see an option for file size --size-only but nothing for modified time?