Skip to main content

Questions tagged [rsync]

rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

Filter by
Sorted by
Tagged with
2 votes
1 answer
42 views

How to Remove a Large File from ZFS Snapshots and Reclaim Space?

I have a series of daily ZFS 100Mb snapshots of archive_zp/my_zfs, going back 100 days. At day 60 (between @ss59%ss60) I had added a 10 GiB sized archive_zp/my_zfs/BIG.iso file, that 10 GiB now ...
NevilleDNZ's user avatar
0 votes
1 answer
24 views

Unknown password for rsync

I always used to send files to other ubuntu machines via rsync with no problems. But now the computer asks for the remote computer's password every time I try to use rsync. I use the login computer's ...
carlus ventura francos's user avatar
2 votes
1 answer
63 views

rsync recursive jumps across directories

I've used rsync recursively and, to my surprise, I witnessed this very strange behaviour in the output (I don't remember if it was deleting or creating or a combination, but I think it won't matter): ...
user324831's user avatar
0 votes
0 answers
32 views

Deleting incremental backups created with rsync and symbolic links: recursive effect?

I am doing incremental backup according to the following example found there: https://linuxconfig.org/how-to-create-incremental-backups-using-rsync-on-linux #!/bin/bash # A script to perform ...
ecjb's user avatar
  • 445
0 votes
0 answers
28 views

Can an HTTP Request work with RSYNC?

So I know RSYNC daemon which negates the usage of SSH in order to send or receive files. However, I'm seeing there's some HTTP GET traffic along with a web-scanning user agent over port 873 to these ...
Linuxnoob's user avatar
2 votes
1 answer
67 views

rsync a selection of directories to destination and delete anything else there

I have read the rsync docs and looked through threads here but cannot find a simple match for my requirement. I wish to copy a number of directories/files from source to a destination directory. I ...
JonBrave's user avatar
  • 293
1 vote
2 answers
49 views

How to distribute HTTPS certificate/key securely and automatically on internal servers

I have a some internally available servers (all Debian), that share a LetsEncrypt wildcard certificate (*.local.example.com). One server (Server1) keeps the certificate up-to-date and now I'm looking ...
emma.makes's user avatar
0 votes
0 answers
13 views

Device Notifier fails to safely remove USB drive Kubuntu

I have been using the command: rsync -av $localdir $usbdir to back up my local directories to NTSF formatted USB drives for years. I got a new system and now have a serious problem I am hoping ...
Jon Swanson's user avatar
0 votes
0 answers
46 views

Rsync total progress with interrupted transfer

I'm aware of being able to display the total progress of an rsync transfer using --info=progress2, and adding --no-i-r to not have it scan incrementally and display the total progress from the start. ...
Bas van den Wollenberg's user avatar
1 vote
1 answer
35 views

Retrieve large number of files from remote server with wildcards

I'm trying to download a large number of files from a remote server. Part of the path is known, but there's a folder name that's randomly generated, so I think I have to use wildcards. The path is ...
Mauricio Chavarriaga's user avatar
0 votes
0 answers
27 views

Rsync command to move directories and overwrite existing ones

I need an rsync command that moves directories from a source folder to a remote folder and overwrites existing directories on the remote side. I don't want to write into existing directories on the ...
Mayor Mayer's user avatar
0 votes
1 answer
58 views

How to quickly find the largest files/dirs that differ between two directories that should be identical on Linux?

I'm trying to synchronize two hard drives. I thought most people who don't want to lose any data and don't use RAID would use such a method so that there would be a well-working GUI. That doesn't seem ...
mYnDstrEAm's user avatar
  • 4,388
0 votes
1 answer
96 views

Why has rsync created many hidden files that duplicate my real file names?

I have a directory that I periodically rsync to via rsync -rva. Today I found out that for many files that I have, eg path/to/S00041.jpg, I also have an empty file with the name path/to/._S00041.jpg ...
loxs's user avatar
  • 103
1 vote
0 answers
78 views

rsync destination is larger than source somehow?

OS is Debian. I am simply trying to make backups from one drive to another. Both drives are the exact same size, same filesystem, and the destination is empty to start with. I'm running rsync like so: ...
cat pants's user avatar
  • 487
0 votes
0 answers
82 views

Rsync link to remote server in bash script without password prompt

I have set up public key authentication on an Ubuntu (22.04) server. I can log in to the server via SSH without having to provide a password. I want to run a backup script on another machine (a ...
Bruce Button's user avatar
0 votes
2 answers
124 views

Is it possible to create multiple users on Linux with the same UID and GID, especially UID and GID 0?

The ArchWiki - rsnapshot page mentions creating multiple users with uid and gid set to 0 as a means of creating users that login remotely to perform backups. One thing you can do to mitigate the ...
vfclists's user avatar
  • 7,619
0 votes
1 answer
42 views

How do I copy directory structure as symlinks inside other directory

I am looking for an easy way to backup all my dotfiles in a git repository. Solution that I'm aiming for: have git as my source of truth for my dotfiles contents in my home directory backed up files ...
Artem Sevos's user avatar
0 votes
1 answer
83 views

Can you tell me why rsync is saying my files are different

I'm using rsync to sync files from my NAS to a Remote Server. The files on the Remote Server appear to have the same user, group and permissions as the source. However rsync wants to copy the files ...
ghines's user avatar
  • 13
1 vote
0 answers
55 views

rsync not deleting files

OS is Debian 12, rsync version 3.2.7. I've been using rsync to make nightly backups like so: rsync -ar --info=progress2 --delete /mnt/data/ /mnt/backup_data This doesn't actually delete any files ...
cat pants's user avatar
  • 487
-1 votes
1 answer
59 views

using rsync to measure difference between filesystems?

I'm running some expiriments to test filesystem differences, for example upgrading an older nixOS version and newer one to the same flake/configuration, as well as the same with debian and ansible. I'...
ebrowningizer's user avatar
0 votes
1 answer
38 views

rsync: need help resolving a "nomenclature" question

I've used rsync for a while, and it's always performed very well. However, trying to rsync my macOS (source, APFS file system) with my Synology NAS (dest, btrfs filesystem) seems to always present &...
Seamus's user avatar
  • 3,087
2 votes
1 answer
48 views

rsync running under rsnapshot is not creating hard links, why?

I have rsnapshot taking backups for me. However, each backup is the full size of the source data. It is not making hard links and instead is making new copies of ever single (unchanged) file on every ...
Dansk's user avatar
  • 31
0 votes
2 answers
37 views

Rsync always overwrites files on external USB drive with BTRFS

On Ubuntu 20 Hyper-V VM rsync always overwrites same files on external USB drive (pass-through drive). Both source and destination are BTRFS. I checked sizes on both sides - they match. Timestamp ...
paul's user avatar
  • 11
1 vote
3 answers
139 views

The proper way to backup

I want do regular, automated backups to a raspberry pi in my homenetwork. It is sufficient to do backups, when at home. Every singe guide I read on 'how to do automated backups' tells me to put a ...
grbll's user avatar
  • 35
0 votes
0 answers
39 views

rsync command copying files that have been already copy and didn't change [duplicate]

I'm new with rsync command, so maybe I'm doing something wrong or I misunderstood something. I have a source folder with some files and one folder with files. I want to backup all this content in a ...
biorubenfs's user avatar
0 votes
1 answer
123 views

Rsync throwing errors but files appear to be fine

I am doing a massive 200TB transfer with rsync. I used a shell script I found off the internet to spawn a few processes but here is the relevant rsync command itself: rsync --recursive \ ...
john cs's user avatar
  • 164
0 votes
1 answer
46 views

Cannot find out which files were not copied with rsync

I copied files using rsync with: rsync -trvh "/media/user/HDD/Arch/" "/media/user/my_drv/Arch/" && rsync -trvhc "/media/user/HDD/Arch/" "/media/user/my_drv/...
vasili111's user avatar
  • 113
0 votes
0 answers
18 views

How to copy local directory to external drive and ensure file integrity while multiple computer unexpected restarts can happen. rsync, other?

My computer has restarts often unexpectedly. I am trying to backup data to external drive. Is the rsync best tool for that kind of job that can ensure file data integrity? If yes, what command should ...
vasili111's user avatar
  • 113
1 vote
2 answers
85 views

Rsync exclude and include problem; include file in excluded directory

I want to do the following with rsync. Directory structure example home/netadmin/docker-data home/netadmin/docker-data/uptime-kuma/ home/netadmin/docker-data/uptime-kuma/error.log I want to rsync ...
John Slegers's user avatar
0 votes
0 answers
26 views

rdfind-like tool to sparsify rsync operations

I use rsnapshot to take regular, automated snapshots of the home directory on my desktop (which runs Ubuntu on sda) and save them to a spare internal harddrive (sdb). Occasionally, I manually copy (...
Max's user avatar
  • 193
-1 votes
2 answers
71 views

RSYNC copies nothing when using option --include=file

I want to copy part of a source to a destination: SRC_DIR=/a/b/c/d/e DEST_DIR=/x/y/z/d/e When my script starts, I create all the folders in $DEST_DIR: mkdir -pv /x/y/z/d/e I have a list of ...
jcdole's user avatar
  • 3
1 vote
0 answers
63 views

rsync Problems using Parameter backup-dir

In all cases I use rsync it works like expected. And very fast. For example: rsync -a --exclude='.*' --stats --progress --delete --backup --suffix="OLD" SOURCE TARGET needs (with no ...
OpaPeter's user avatar
0 votes
0 answers
27 views

rsync: delete remote folder when its contains only excluded files

Imagine I have two folders, A/and B, with the following contents: $ ls A/ main.tex main.log main.pdf $ ls B/ project.tex project.log project.pdf Suppose further that folder B/ exists only on the ...
wmnorth's user avatar
  • 253
0 votes
1 answer
43 views

How to make rsync synchronize contents of a directory but don't touch the permissions of directory itself?

I want to use rsync to synchronize a specific set of files from some directory on remote machine to local one. I run something like: rsync -i -a --delete -f 'merge ~/files_list' x.x.x.x:/source/dir/ /...
raj's user avatar
  • 1,133
1 vote
1 answer
117 views

create bootable Image from Rsync System Backup

i've copied a Linux System Rootfolder (/) using Rsync to a local Folder. (Excluding 500GB Data) Is it possible to create a Bootable System Image that boots in Virt-manager? Rsync Command: Rsync -aAXv ...
user2534903's user avatar
0 votes
1 answer
49 views

How to hide rsync output for existing and synced files?

I have the output: sent 66 bytes received 12 bytes 156.00 bytes/sec total size is 204 speedup is 2.62 sending incremental file list sent 67 bytes received 12 bytes 158.00 bytes/sec total size is ...
Astora's user avatar
  • 449
0 votes
1 answer
53 views

Why does `du` report that my `rsync` backup is not the same size as the original?

I'm creating a backup of my $HOME directory on an external storage drive using rsync, using the following options: --archive --xattrs --hard-links After a fresh backup, du reports that the sizes of ...
jth's user avatar
  • 195
0 votes
0 answers
51 views

How do I use rsync to put all new files into a separate directory?

I have two directories, A and B. I created B initially by just copying over everything from A. In the interim, other people have added files to B. I want to use rsync to pull all new files in B (i.e., ...
gfunkdave's user avatar
0 votes
1 answer
70 views

Does the rsync --archive option override the --exclude option?

I am running an rsync -avz command which excludes a large 32GB file by using --exclude=/file/path and no matter what I do rsync transfers the file. I understand that logically the --archive option ...
vfclists's user avatar
  • 7,619
2 votes
1 answer
173 views

rsync --recursive --ignore-existing: what (if any) additional flags are needed to resume/repair/overwrite any partially copied files?

Assume an rsync --recursive --ignore-existing foo bar copy command was being run for a large directory tree named foo, but that that command got prematurely interrupted. For example, because of a ...
Will's user avatar
  • 125
0 votes
0 answers
51 views

rsnapshot backup fails with cryptomator mounted volume

I have rsnapshot (on macos) setup for my backups and in the config file one of the locations I am trying to back up is a Volume mounted by Cryptomator. Relevant line in config file: backup /Users/...
christopher.online's user avatar
0 votes
1 answer
61 views

How to use rsync to preserve time of content but not the directory itself?

I'm using rsync to update the content of a target directory to to be the same as a source directory from, i.e.: rsync -rt --delete from/ to/. I want to keep the time for the files in from, and found ...
renyuneyun's user avatar
-1 votes
2 answers
50 views

Rsync with multiple wildcards

How can I rsync all files of multiple types from a remote server? E.g. I want to rsync all pdf's and png's from a folder on the server. This raises a syntax error: rsync REMOTE_SERVER:REMOTE_PATH/{*....
dkv's user avatar
  • 477
2 votes
0 answers
44 views

Can rsync copy all files (including special ones like soft and hard links) from a ntfs partition to another one?

To make backups for my computer, I installed Xubuntu on an external hard disk to boot from and create images in another partition on the external hard disk. This also ensures that the file systems of ...
Adalbert Hanßen's user avatar
0 votes
1 answer
27 views

how to delete the files not on $home in destination with rsync

I am using rsync from my $HOME as: rsync -avr * /run/media/MyBackup --delete This command,as expectd, will not delete any file on $HOME, but only work on the folders. Is there any way to delete ...
BaRud's user avatar
  • 1,639
0 votes
2 answers
104 views

Root partition is running out of disk space due to too large syslog files

This is occurring while backing up whole drive with rsync. I'm trying to sync two large hard drives as a backup and I'm doing so exactly as described here using the Grsync GUI. While doing so I get ...
mYnDstrEAm's user avatar
  • 4,388
0 votes
1 answer
159 views

Rsync: operation not permitted

I use image-backup to create a backup of my entire system. For some reason it doesn’t work and I just can’t get it going. When running the command sudo image-backup and then enter /mnt/test.img I get ...
bernhard's user avatar
0 votes
1 answer
38 views

How do you synchronize files with partially failed download using rsync?

I'm trying to synchronize literally thousands of files of various sizes and I would like to have a 1:1 copy of the files. That means that already present files should be checked for their integrity ...
Sir Muffington's user avatar
2 votes
1 answer
127 views

rsync files-from and directory structure

I have been copying some files and folders by building an rsync command manually using a string list in the shell. For remote file structure like: /home/foo/ media/ bigfile.bin somedir/ a....
tsj's user avatar
  • 165
0 votes
1 answer
95 views

Operation not permitted when writing in sshfs

I use image-backup to backup my Rpi. I backup directly on an FTP server and I do so via sshfs. This is how I connect in my /etc/fstab: MYUSERNAME@MYSERVER:/home/myuser/rpi_backup /mnt/MYSERVER fuse....
bernhard's user avatar

1
2 3 4 5
42