Questions tagged [rsync]

rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

Filter by
Sorted by
Tagged with
0
votes
0answers
14 views

elegant way to sync file between local machine and server (in real time)

I am looking for a "local Dropbox" to sync files between local and server. For complex reason I couldn't install Dropbox on the server. I thought about rsync but it doesn't work bi-directionally. ...
0
votes
1answer
28 views

Destination folder in rsync disappears

I try to sync the source directory to a destination directory that is mounted inside the source directory. I run the command: rsync -avP /folder/with/files /destination_directory I can see the ...
1
vote
0answers
12 views

rsync does not follow symlink

I want to copy one file from one Linux server to another one: Firstly, I've checked the following: ls -l /etc/letsencrypt/live/example.com/fullchain.pem lrwxrwxrwx 1 root root 46 mar 28 19:50 /etc/...
0
votes
1answer
21 views

Using rsync to back up /home folder with same permissions, recursive

I would like to request information on using rsync. I tried reading the manuals, but the examples are few and confusing for me. I do not need advanced features or live sync or remote sources or ...
0
votes
1answer
21 views

using rsync to distinguish between files that are different on local vs remote vs files that exist on one but not the other

I'm using the following command to compare directories on my local and remote machines rsync -K --delete -n -avrc $cwd/* simon@${othIP}:$cwd > /tmp/output where the macros have the obvious ...
0
votes
1answer
11 views

How to run this rsyncs as deamon (trigger only when a file has changed)

I have multiple folders that I rsync now with cron like in this example. rsync -aq source1/ user1@machine1:/some/destination1 rsync -aq source2/ user2@machine2:/some/destination2 ... and so on ...
-1
votes
1answer
24 views

Is there such thing as an .rsyncignore file

Just like with tar and npm and commands like that, I am looking to use an ignore file like: .myrsyncignore like: rsync -r --exclude='.myrsyncignore' ./ tmp/foo instead of having to ignore ...
0
votes
0answers
18 views

Use variable to exclude multiple directories with rsync

The following snippet of code is part of a larger Bash script I'm working on. My intention is to pass input variables as arguments to Rsync. I managed to make most of it work, except for the "--...
0
votes
1answer
24 views

Resume rsync transfer after failure?

I'm transfering the content from one smaller partition to another larger using rsync -vacHS --progress /oldPartMountPoint/ /newPartMountPoint/. The data is large ~1TB, I left it overnight but at the ...
0
votes
1answer
37 views

rsync copies everything

I'm using rsync to back up my filesystem to a mounted disk /media/<user>/UbuntuBackups1/. I want 6 daily backups, 3 weekly backups and 3 monthly backups if possible. I've read that by default ...
0
votes
1answer
32 views

Failure of rsync to detect new files and directory

I have been performing backups to a remote machine via rsync for several years. At least over the past two months, rsync has stopped detecting new files and directories on the machine to be backed up. ...
1
vote
2answers
64 views

Use find with scp or rsync to send found files

I am trying to run a simple command that searches for a dedicated file type and once found copy's that file and directory structure to a remote server. For example: find Source/ -name *.CR2 | xargs ...
0
votes
0answers
13 views

rsync hangs when in archive mode

I'm trying to move several hundred GBs from one Ubuntu machine to another. The target machine (tgt-server), has my MongoDB server on it. I'm invoking rsync like so $ rsync -rva /path/to/src $USER@...
0
votes
1answer
34 views

How to make a reproducible iso file with mkisofs/genisoimage?

In an automated process an iso file is created with mkisofs. Even, as the original data is excactly the same, the resulting iso files are not the same (their md5sum changes). Since I rsync --checksum ...
0
votes
1answer
29 views

How can I quickly synchronize changed Exif tags of photos?

I have a big collection of raw photo files. On most of them I have changed the Exif Data for Dates and Time Zones. Now I want to synchronize these changes to a remote location. I tried to use rsync. ...
0
votes
0answers
19 views

Avoiding rsync --delete surprises: What is the difference between destination and receiver? Between source and sender?

I've been using rsync for years and I still run into unexpected behavior with rsync --delete. The rsync man page says: This option can be dangerous if used incorrectly! It is a very good idea to ...
0
votes
2answers
27 views

rsync: notify of any files that were skipped

I am using the following rsync command which includes the "update" option, meaning it will skip files at the receiver which are newer. It works, except that I need it to tell me the files which were ...
0
votes
1answer
36 views

rsync failed - no such file or directory - script works since 8 years(!)

Using Debian and Apache2 webserver: I have a cron job, that makes a two different db_dumps, and then saves all files from the website (www) to adrive.com and also the db dump to a drive in a 2nd ...
0
votes
0answers
19 views

How to include source of symlink when downloading with rsync?

I would like to download clinvar from the NCBI server: > rsync -rvzhl --partial --append --progress --filter="merge rsync_include_pub" rsync://ftp.ncbi.nlm.nih.gov/pub/ pub/ rsync_include_pub: + ...
0
votes
1answer
25 views

cp / rsync - Overwrite if smaller, backup original and then overwrite if larger

I have files in Folder A than I want to copy in Folder B. Folder B contains some files by the same name. Timestamps on all files are the same and I want to overwrite and backup larger files of the ...
0
votes
2answers
28 views

rsync remove only some file extensions from source after syncing

On my local machine I have some directories (with subdirectories) with many files (jpeg and nef), like: 1.jpg 1.nef 2.jpg 2.nef .... what I want to do is to sync on an HD all files (both jpeg and ...
0
votes
1answer
43 views

rsync and original permissions

I know that there are a lot of treads about this subject, but I was unable to solve it. I'd like to make a simple backup with rsync between my hard drive and a USB device. My original directories and ...
0
votes
0answers
24 views

Copy between two remote servers via local server [duplicate]

I've search and tried many solutions from this page. But I wasn't able to use any of them. Here is the situation: I have linux VM (hostname = debianVM). From this VM I'm connecting to remote servers. ...
0
votes
1answer
21 views

Rsync - preserving user, group, and permissions without su or being logged in as the user?

I need to automate (via script) rsync to send some files to a remote host for processing. However the user, group, and file permissions must persist across hosts for the processing to occur. Due to ...
2
votes
1answer
96 views

Delete millions of files efficiently, without first generating a list of all files to be deleted [duplicate]

I've been trying to figure out how to delete millions of files from a mounted NAS drive. The OS I'm accessing it from is RHEL 7.6. The directory is actively being written to, with tens or hundreds ...
0
votes
3answers
77 views

Linux vs. Windows copy performance

I am attempting to copy files from an old NAS to a new one (I say "new", but the new one is about 8 years old, and the old one is about 12 years old). Since both have RAIDed disks, physically removing ...
0
votes
1answer
27 views

How to update a same file to a destination folder which has different directory structure?

Suppose I have folder structure: folder: a.text folder_2: folder_3: a.text How I can sync this file without mentioning the full destination path? I have tried rsync -hvrPt folder/* folder_2 ...
0
votes
0answers
31 views

Merge two directories with files in common

I have two directories that I need to merge: B (base), which is very large U (update), which is moderately sized and contains some modifications and additions to files in B Both B and U are updated ...
0
votes
1answer
25 views

rsync with `--links` option

The rsync(1) man page manual says: -l, --links When symlinks are encountered, recreate the symlink on the destination. But where will the link point? To the same point on the source ...
1
vote
1answer
44 views

How to make rsync's complete progress percentage more reliable?

I'm running rsync to sync 2 local folders, using --info=progress2 (show complete progress). The percentage value presented started rising fast to 97%, then dropped and "waved" between 40+% to 90+% ...
0
votes
0answers
38 views

rsync folder size discrepancy

I'm running rsync between two Synology NAS machines. However, after running, there is a huge size discrepancy between the source and destination folders - as in, the source folder reads as 6.64 TB/...
0
votes
1answer
26 views

Rsync with specific day condition in respective subdirectories

I have two identical folders with subfolders for development and live like: /development/subdirectory1 /development/subdirectory1/subsub1 /development/subdirectory2 /development/subdirectory2/subsub2 ...
0
votes
0answers
28 views

One-way folder sync using symlinks

I’m trying to one-way sync the content of a folder (public) to another (private) recursively using symbolic links. /public /foo textfile /foo2 /private /foo (symlink → ../public/...
0
votes
1answer
32 views

Should I keep group file permissions using Rsync with a Shared folder

I’m going to use Rsync to make a copy of all the user data on my Mac. There are 6 users. I have also set up a Shared directory, which is user 7, but this isn’t really shared as explained here. I ...
0
votes
1answer
40 views

How does rsync work in this simple example?

Let's say: a is a 256 MB file containing random bytes b is the same file except it has one additional leading byte 0 Thanks to this answer, I discovered that rsync is able to compute a "binary diff ...
0
votes
1answer
26 views

rsync but with a difference

I use my android phone to record my 4K videos. Now, i want to auto transfer the files (from the DCIM folder) to my NAS folder as soon as the files are generated and delete the original files from my ...
0
votes
1answer
21 views

How to rsync faster while checking the folder size first

I have just written a simple shell script with Automator on my Mac, which looks like this: rsync -a --delete "/Volumes/Backup Plus/photo" "/Volumes/My Passport/photo" rsync -a --delete "/Volumes/...
1
vote
1answer
56 views

rsync command doesn't work when run as a systemd service

summary: I am trying to set up a systemd timer to regularly backup a directory using the rsync command. I made an rsync command that works when run manually in a terminal, but it doesn't work ...
0
votes
1answer
48 views

How to automate rsync without risk of simultanous instantiations

I have an rsync command for copying across data from my ~/home to the remote /srv/share folder. /usr/bin/rsync -rltvz --progress --stats -e 'ssh -p MYPORT' /home/luke/share/ uploader@MY.IP.ADDRESS:/...
1
vote
1answer
47 views

Can I avoid using `sudo` to back up files owned by root?

I'm using rsync to back up a set of files in /etc. The 'source' files are on an ext4 filesystem, and the 'destination' is an ext4 partition on a USB thumb drive. My incantation is similar to this: ...
0
votes
2answers
67 views

Is there a utility like rsync, but with the speed of btrfs COW?

rsync has various performance issues; I have never been able to make it perform a sync in O(#changes). Even if it uses modification time and not checksums, it still needs to generate a list of all ...
0
votes
0answers
37 views

Rsync is not copying my files over, why?

I use rsync to backup my files from my (x)Ubuntu desktop to one external USB drive (not a flash drive, a hard disk of the old spinning type.) It works OK most of the time, the command I use is rsync ...
0
votes
1answer
34 views

multiple rsync commands without prompting the password multiple times

I am writing a bash script to rsync multiple files from a remote host into my personal computer. What I wrote so far works, one rsync command after the other (three in total), though I have to input ...
0
votes
1answer
24 views

rsync daemon stopped working a few days ago - some update has broken it

I have an rsync daemon on a machine running Ubuntu 18.04 which I use for daily backups. Daily backups stopped working on 22nd January with the following error:- @ERROR: access denied to esprimo ...
0
votes
0answers
24 views

How to transfer files to an encrypted container from Mac to Ubuntu?

I have run a backup from my Mac to Ubuntu machine with rsync. rsync -av —delete ~/ me@ubuntu:/mnt/Backup/date However, I would like to make at the Backup folder a compressed and encrypted file. The ...
0
votes
0answers
67 views

rsync from remote generates error `Name or service not known`

Context: I've configured my ~/.ssh/config so I can use a shorthand for sshing into the remote. Therefore, this works;- ssh somename But.. If I use the same name when trying to rsync from the remote ...
0
votes
3answers
50 views

rsync sync specific folders (by pattern) with file filters

I have the following structure: /src/2016/aaa1.pdf /src/2016/aaa2.pdf /src/2016/aaabbb1.pdf - needed /src/2016/aaabbb2.pdf - needed /src/2017/aaa1.pdf /src/2017/aaa2.pdf /src/2017/aaabbb1.pdf - ...
1
vote
1answer
31 views

rsync include only png images under a subfolder

I am trying to synchronize a folder over ssh using rsync. In particular, I only want to get the png fils in the remote folder, as all the folder may occupy several gigas. The folder structure is the ...
2
votes
1answer
40 views

Rsync files directories with different names

I am trying to rsync files from a directory incoming to a directory called outgoing, i.e., /testcopy/folder1/incoming/test1.txt to /testdest/folder1/outgoing/ Directory source: /testcopy/folder1/...
0
votes
0answers
40 views

rsync exclude folder but include some files in the folder

I want to backup my Windows home directory using cygwin: rsync.exe -vrptlH --delete --exclude=AppData "/cygdrive/C/Users/user1/" "/cygdrive/D/backup/" As you can see I excluded the AppData directory....

1
2 3 4 5
30