Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [rsync]

rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

0
votes
0answers
20 views

lsyncd - How to include specific directories and exclude rest of all directories

I want to include some of the directories in lsyncd process and exclude rest of all directory. I have so many directories in a multisource directory. I want to include only temp and temp1 directory ...
0
votes
1answer
25 views

rsync while ignoring missing files. Problems with --exclude-from flag and invalid characters written to log

I'd like to move new music from my seedbox to my local server on an hourly cron job. My local music is moved into new folders by a musicbrainz script as soon as it finishes syncing on my local machine,...
1
vote
1answer
34 views

How do I confirm a file sync has completed before executing a command?

I have a computer periodically syncing folders of content with another computer using Resilio Sync. The receiving computer has a sorting process on an hourly cron, which analyses the folders and their ...
0
votes
1answer
35 views

What are the temporary files that rsync uses while continuing a breaked copy?

On "source side" I am running a: rsync -azP file.txt username@target:/root/ that I had to break once (CTRL+C), but then, issued the same command, so rsync is continuing, where it left (afaik). On "...
0
votes
0answers
12 views

rsync automatic creation of daily directories and/or date appending

Is there a command string to get rsync to - 1 copy files from one server to another and append a date stamp so saved files will have the date appended to avoid ongoing overwrite of the prior file? 2 ...
0
votes
1answer
24 views

Rsync isn't creating parent folders

I have a script that is rsync'ing folders. but rsync is not creating the parent directory. --dry-run says folder is being created but when i remove --dry-run the script errors saying failed: No such ...
0
votes
3answers
29 views

Why is rsync adding an extra directory?

I was running rsync -rv /home/myname/mydir1 myhost:/home/myname/mydir1 and got /home/mydir1/mydir1/... How do I fix this so i don't have a redundant "mydir1"?
0
votes
0answers
31 views

Timeshift alternative for solus

I'm running solus 4 and I just found out that they don't include timeshift in their repos due to it using outdated dependencies ( https://dev.getsol.us/T220 , https://www.reddit.com/r/SolusProject/...
0
votes
1answer
13 views

How to sync between log files between linux and windows machines?

I have 20 linux servers on which some of the microservices are deployed and they keep genrating some logs on respective servers. All the servers are on same network and have connectivity between all ...
2
votes
0answers
16 views

Why does rsync keep copying without actually writing after an error?

I've been trying to copying a bunch of files between two USB drives, the source NTFS, and the destination FAT32. There were a couple of files hidden amongst the source data that were > 4GB. I used: ...
0
votes
0answers
17 views

Local network rsync slower than internet download

I've tried rsyncing a 3gb movie from my arch box to my friend's ubuntu box, both on the same network (and router). It went really slow, between 50kb/s to 300kb/s and he decided to download it from the ...
0
votes
0answers
26 views

rsync du puzzle [duplicate]

This rsync command completed successfully. rsync --recursive --archive --progress --update /a/b/c/ e@f.g.h.i:/j/k/l Yet I'm puzzled by output of these du commands: on the origin server: cd /a/b/c/; ...
1
vote
0answers
109 views

Why does this rsync command running in a cron fail?

Why does this rsync command running in a cron fail and how to debug it and fix? unset SSH_AUTH_SOCK && unset KRB5CCNAME && rsync -hvru -e "ssh -p 34503 -i /root/.ssh/...
-1
votes
1answer
29 views

problem when generating backup of the root folder with rsync

I have almost an entire day trying to create a mirror backup of the root folder of my ubuntu linux. Install the rsync and create a script with the following content: #!bin/bash rsync -rtvpl / /home/...
0
votes
1answer
54 views

exit status from rsync command

When I am executing rysnc command the exit status is 0, even though the command throws an error (code 23). I want to use the exit status code to terminate the script when there are no files found but ...
1
vote
0answers
30 views

Attempt to backup a list of folders that some are git repositories

I have a list of folders that soime of them are git repositories. In order to backup it I tried thje following rsync command: LANG=EN_us.UTF-8 rsync -ravdhHP --delete --files-from=rsyncFolders.txt --...
0
votes
1answer
35 views

Rsync keep in textfile failed tranfers

I executed rsync in order to backup my files, some of files have not been removed but due to amount of output shown by rsync, I want to keep the failed tranfers into a file in order to distinguish ...
0
votes
1answer
20 views

Remove .gitignored folders and `node_modules` and `vendor` folders whilst I rsync them

On my GNU/Linux machine I want to backup a list of files specified in a text file names rsyncFolders.txt the idea is to keep the files I want and to exclude unwanted ones to backup. In these folders ...
0
votes
0answers
46 views

Why does 'rsync' overwrite files in my destination with the same contents?

I'm using rsync in a shell script to perform deployments of Bitbucket (Git) managed repositories. Part of the requirements for deployment is that files from several designated directories in source ...
2
votes
1answer
30 views

Rsync just structure and specified folders

I have a file structure as follows. Sites -------------------------------------- | | | | | | |...
1
vote
1answer
34 views

Allow non-root user to change group for it's own files

My server at home uses rsync to backup files to my VPS, but I have an issue with setting the group property for uploaded files. Because the rsync uploads the data to a folder which can also be ...
-1
votes
3answers
65 views

Use scp to copy files of specific extension from directory

I'm writing a bash script that needs to fetch all *_out.csv from a directory, on a remote server. All these files are several directories deep inside of another directory. So for instance, say the ...
0
votes
0answers
91 views

Why is rsync so slow when working with MTP devices?

In order to perform regular backup of my phone (Samsung A5 2016, or SM-A510F) using rsync, I used the following command: rsync --verbose --progress --omit-dir-times --no-perms --recursive --inplace --...
1
vote
1answer
47 views

ssh timeout with rsync and Ubuntu 18.10

I experienced this strange behavior with rsync command: sudo rsync --timeout=300 --compress-level=9 -aHe "ssh -o ConnectTimeout=200 -o ServerAliveInterval=2 -ServerAliveCountMax=200" --progress --...
1
vote
1answer
41 views

How to update a local mirror from a public server?

I already have a mirror of the entire slackware64-current/ directory tree using wget -r -np -R "index.html*" https://mirror.slackbuilds.org/slackware/slackware64-current/ and that's fine. But it's ...
0
votes
2answers
33 views

synchronize files from remote server with rsync

I have a question about rsync. I have two servers. I would like to run a rsync command on server 1 that synchronizes all data/files on server 2 to my server. Say I have on server 2 a folder /var/www/...
1
vote
2answers
37 views

How to copy files with certain extensions keeping the path from remote to local machine via scp --parents?

I want to copy all *out from various subdirectories from my remote account to my local machine my trail is scp --parents -r @remote:~/path/*out . this trail doesn't work I am wondering about the ...
0
votes
0answers
20 views

Syncing automatically files to a portable HDD

I need to syncing automatically the /home to a portable hard disk drive as follows : copying files on the HDD when new or modified from the source deleting files from the hard disk after 24 hours ...
1
vote
1answer
226 views

Run Rsync for multiple files in parallel from 2 different directories and find elapsed time for each file and all files

I have lots of dump files in 2 different directories that need to be uploaded using rsync, I want to run rsync for each dump file simultaneously to save time. Dump Files: Dir1: - /u05/expdpdump/...
0
votes
2answers
46 views

How to make rsync display only files being copied, not all the folders which are scanned?

My weekly backup script contains a bunch of bash statements like these: rsync -va /source_path/ /destination_path/ Now, this works great but the -v (verbose) option doesn't behave exactly like I ...
0
votes
1answer
42 views

Finding files and copy with folder structure intact

I am searching files who have either been created or modified for the last 60 minuts. I find these via find ~/data/ -cmin -60 -mmin -60 -type f ~ the home directory /usr/wg/ After that I want to ...
0
votes
1answer
22 views

rsnapshot wrongly filter getting added

I have following lines in rsnapshot.conf snapshot_root /mnt/T4Backup2T/Incremental-Backup rsync_long_args --numeric-ids exclude_file /home/CD/CLPB/backup-files/rsnapshot/saraswathi.exclude ...
0
votes
1answer
60 views

Is there some program that can copy sparse file (/var/log/lastlog) over ssh as fast as cp (on local pc)?

I'm backing ip my server via rsync over ssh but /var/log/lastlog file is 1.2G (it takes only 24K on the hdd). On a local machine cp can copy it for no time (a few ms) but rsync requires reading the ...
1
vote
1answer
41 views

Rsync not correctly copying Symlinks

I have an rsync to copy over some rpms from one server to another but the issue is that the symlinks are not being created properly on the receiving server. My rsync options are -avz --force --delete ...
1
vote
1answer
60 views

Compare two directories: if files don't exist or are the same, move; else, do nothing

I have four types of files: JUST_SOURCE exist only in the source directory JUST_TARGET exist only in the target directory SAME exist in in both source and target directories, and have the same ...
-1
votes
1answer
34 views

Transferring big files from local hard drive to computing cluster by rsync

I have 40 WGS files each one about to 0.1 TB stored in a hard drive next to me. I need to transfer them to my scratch in our computing cluster. I am using windows OS so I am using MobaxTerm for ...
0
votes
0answers
33 views

Backup configuration for Ubuntu Server

How can I make a restore point for a Ubuntu Server 18.04? I have a clean install of the Ubuntu Server OS and before installing any Web Server I want to perform a backup and if something goes wrong ...
0
votes
1answer
182 views

Encrypting a currently used external hard drive such that it can be updated with rsync?

I currently have an unencrypted external hard drive that I use as a backup for my encrypted (with LUKS) main machine. To update my backup, I simply log in to the main machine and rsync to my external ...
0
votes
0answers
28 views

rcp/rsync create a file with a single question mark as name, instead of the original file name

Here's are the commands I've tried (in a .sh file). rcp $1/target/$1*SNAPSHOT.jar remote_server:~/ rsync -v $1/target/$1*SNAPSHOT.jar remote_server:~/ Both of these create a file on remote_server ...
-1
votes
2answers
64 views

How can I redirect rsync output to a directory with date and time stamp?

I want to redirect the output of rsync to a particular directory with the date and time stamp. Example: rsync -r source-dir dest-dir/current-date-time Is there any way the "current-date-time" folder ...
2
votes
0answers
85 views

How does the rsync symlink exploit work?

munge symlinks [...] The way rsync disables the use of symlinks is to prefix each one with the string "/rsyncd-munged/". This prevents the links from being used as long ...
0
votes
1answer
86 views

Why does `RSYNC_RSH` not work, but `--rsh` does?

Setting RSYNC_RSH is not working, but the --rsh option is. Why? rsync is correctly using the --rsh option: $ rsync --rsh "echo" invalid invalid::invalid rsync: server sent "invalid rsync --server --...
1
vote
3answers
122 views

Initial rsync backup of large data slow to RAID 5

I'm using rsync to copy about 28TB of images to a 36TB RAID 5. The source has SSDs and the destination has 6 8TB 7200 SATA3 512e drives in a RAID 5 configuration. Servers are connected over a 10G ...
1
vote
1answer
83 views

Can we use rsyncd.conf to restrict rsync over ssh?

I had a look at the restricted rsync script, rrsync, which is mentioned in man rsync. Basically the client rsync command seems to pass all of its options through, to the remote rsync command that it ...
1
vote
2answers
42 views

How to recursively move one file type but only when another file type is also present?

In my directory tree, some subfolders contain both *.flac and *.mp3 files, but other subfolders contain only *.mp3 files. I'd like to move all of the *.mp3 files to another destination (a different ...
0
votes
0answers
39 views

exit 255 when copy with rysnc on linux

I would like to copy some files from my remote to google drive using rsync. On the terminal I do nohup rsync /mylocal/mydir/subdir/. mydrive:folder/data/mydir/subdir & but it exits giving ...
2
votes
0answers
21 views

lsyncd: big directories

My plan was to use lsyncd to synchronize a directory with about 1,5m files and 0,3m directories to another host. Performance is not most important. After first tests I see that lsyncd uses inotify ...
2
votes
1answer
93 views

rsync: Use filters to exclude top-level directory but include some of its subdirectories

I want to back up my /home directory with rsync. I have read rsync's man page and decided to use filter rules for this task. What I would like to achieve: Exclude all files and directories in the ...
2
votes
1answer
51 views

Bash scripting and rsync: how to include just some folders and subfolders and what happends if I use ../ as path with --delete

I have a bash script where I'm trying to copy some folders and archives in local with rsync. I have something like this: RootFolder A B C D D1 D2 D3 . . . ...
1
vote
2answers
94 views

How to recursively copy only the files from folders and subfolders?

Under /home folder we have many subfolders, as the following: /home/user1 /home/user2/user_sub_2 /home/user3/user_sub_3/info_sub /home/user4/INFO_FOLDER We want to copy all the files under /home, ...