rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

0
votes
0answers
28 views

rsync --delete doesn't delete all files

This is the script I have so far rsync -avz -e ssh --delete /tftp/ username@192.168.1.51:/tftp/ I want it to completely copy every directory/file in /tftp/ and overwrite everything in the ...
3
votes
3answers
2k views

rsync list of files in sub-directories to remote server and delete extraneous

I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory. This is what I'm trying to accomplish: ...
4
votes
1answer
39 views

rsync doesn't preserve directory ownership even with -a

I use this rsync invocation to backup my home directory: rsync -aARrx --info= --force --delete --info=progress2 -F "$USER_HOME" "$BACKUP_MNTPOINT" rsync man page says that -a implies -g and -o ...
2
votes
1answer
26 views

How to interpret rsync console output?

I use the following rsync command to backup my files: rsync -avHc Pictures /backup/ Isn't -v supposed to only display files and directories that were transferred? If I change a file and run the ...
2
votes
1answer
28 views

Rsync folder while --exclude-from'ing .gitignore files at different depths

So I'm trying to work on a command to rsync a source folder with a structure like so: - app.js - .gitignore - src/ - src/logs/ - src/logs/.gitignore The first .gitignore would have a series of ...
4
votes
2answers
4k views

Having an rsync job complete after closing SSH connection

I am transferring a large amount of files from one computer to another using rsync. I am doing this by SSHing into the source computer and executing a command like this: sudo rsync ssh ...
1
vote
1answer
12 views

RYSNC over SSH not working for restricted shell

I need to give access to some Mr X in my production server so that he can push files to my server. Since there is no necessity to give him shell access , I decided to use restricted shell (rssh) so ...
0
votes
0answers
13 views

rsync rules to only sync specific sub-dirs in long paths

I'm trying to perform complex rsync include/excludes to backup only the following within the /home/x dir: Recursively all files/dirs in Documents Recursively all files/dirs in ...
1
vote
1answer
18 views

Automatically pauseing rsync if target is full

I need to transfer 80gb's of unsorted text documents from one computer to another and all I have is a 32gb USB. Is there an option to make rsync automatically pause when the USB is full without losing ...
0
votes
0answers
65 views

rsync include-from exlcude-from with including subdir but excluding dirs above

I try to use rsync with --include-from and --exclude-from options. I have a directory structure like: /docs/domain-[a-z]/templates Now I want to sync templates only if something is in there. Further ...
2
votes
1answer
356 views

Incremental file back up by date

Is there any backup tool that supports partial back up by date? What I mean is that I have some small drives such as on a laptop that can't hold a full copy of all the files on an external 2TB drive. ...
1
vote
0answers
20 views

rsync copy only files facade

Is there a way to mirror a directory structure and files there contained with rsync, giving out facade zero length files? I mean, mirroring dirs (-d flag I think) exactly as they are, while not ...
1
vote
4answers
88 views

Interactive ssh works, but not rsync or scp, on OSX

The motivation is that there's a server that I can ssh into (with or without key pairs set up ... i.e., without or with a password) but that I cannot send files to via rsync, scp, or sftp. Someone ...
1
vote
1answer
13 views

I can't get rsync --exclude-from to work with a file

Here's the command : rsync -avAX --exclude-from=/home/vco/bin/wip-files-learning/backup_tests/rsyncexclude.txt ./some_tests/ ./back_to_me/ Here's the contents of the exclude file : ...
0
votes
1answer
49 views

rsync: Copy speed decreases while syncing two directories

I am using rsync on fedora 20 to sync my directories. I am using the command below:- $ rsync --progress -a srcDir DestDir But, as rsync copies files, copy speed decreases significantly. Here is my ...
1
vote
1answer
19 views

Chunked transfer contents of block device over bad network

/dev/sda is the only disk on system. I want to save it to a raw image on another server. I can't do it in one shot, because network disconnects often. Is it possible with e.g. torrent?
0
votes
1answer
21 views

Rsync doesn't skip existing files

I use rsync to backup all the files from a specific folder in a USB drive connected to my Mac (Osx 10.9) to a folder of my home network NAS. The problem is that rsync replace all files and it does not ...
3
votes
1answer
39 views

rsync causing errors after sync

When I run the rsync command to push my files to production, sometimes - not always, and it's very rare - after the sync has completed, we are getting errors within our production environment. The ...
5
votes
3answers
1k views

Transfering millions of files from one server to another

I have two servers. One of them has 15 million text files (about 40 GB). I am trying to transfer them to another server. I considered zipping them and transferring the archive. But I realized that ...
4
votes
1answer
191 views

What does all this extra data from rsync mean?

When I move directories with rsync, I get some extra data to the right of the progress bar right after each file has been copied: $ rsync -aP assembly /media/andreas/backup sending incremental file ...
5
votes
3answers
8k views

Can rsync resume after being interrupted?

I used rsync to copy a large number of files, but my OS (Ubuntu) restarted unexpectedly. After reboot, I ran rsync again, but from the output on the terminal, I found that rsync still copied those ...
1
vote
1answer
43 views

Linux command to copy as hard links, while deleting unwanted files?

I'm looking for a command that behaves both like cp -al in only creating hard links rather than copying file contents, and rsync -a --delete in removing files from the destination that are not ...
1
vote
2answers
40 views

Can rsync be configured to avoid modifying subdirectories not found in the source folder?

I am having a hard time figuring out exactly how to run rsync to get it to do what I need it to do. Basically what I need is as follows given a single source folder with multiple sub-directories: ...
9
votes
2answers
12k views

“rsync: failed to set permissions on …” error with rsync -a or -p option

When I use the -a option as is asked and answered in Preserve the permissions with rsync, I got a lot of "rsync: failed to set permissions on" errors. rsync: failed to set permissions on ...
1
vote
1answer
20 views

communicate with rsync daemon without sockets

According to the manpage, rsync --daemon will either: try to communicate using the rsync protocol using stdin/out, if it detects that the stdin/out are a socket, open a TCP socket for listening and ...
7
votes
3answers
13k views

Using rsync to move (not copy) files between directories?

I have been using rsync to copy files for some time. My understanding is that rsync is faster than cp when some of the files to transfer are already in the destination directory, transferring only the ...
0
votes
2answers
28 views

How to Copy Only the Directories with a specific File in that directory

Main_Directory | Event_Subdirectories | *.mcp .otherfiles I want to copy all Event_Subdirectories to another Main_Directory that have the *.mcp file within the Event_subdirectory, but I'm ...
1
vote
0answers
10 views

Using rsync, how can I know what attribute of source file differed from the dest which caused the trasfer

I heavily depend on rsync for remote data transfer and backup purposes, occasionally on different filesystem types. AFAIK rsync by default compares file size and modification timestamps to find out ...
0
votes
1answer
42 views

File tranfer from the server

I want move (not copy with scp) my file from the server to the local repository and finally delete it on the server after transfer. I use next command from the repository, where I want have the file: ...
2
votes
0answers
38 views

SSH Tunnel with autossh

I can't seem to find a close enough example but here it goes. I'm trying to in the end setup rsync from one server to another through an ssh tunnel. Local (my machine) will run the rsync to pull ...
1
vote
1answer
22 views

copy symlinks with rsync

When I'm trying to backup a disk with rsync, symbolic links are not resolved correctly. For example: media └disk1 ├folder1 │ └folder2 (symlink to /media/disk1/folder2) └folder2 After rsync ...
4
votes
2answers
3k views

How to see the total progress while copying the files

We know that if we give --progress parameter to rsync it will show the progress of files copied. But issue is that is shows the progress for each single file not total or overall progress. So how to ...
2
votes
2answers
37 views

rsync with colons in filenames

I have a fairly large directory that I need to sync to an external hard drive for both backup and portability reasons. /work I try to run the following rsync command in order to copy this folder to ...
13
votes
1answer
435 views

What happens when you rsync without a destination?

To make the story short, I did an rsync: rsync -avP root@exampleserver.com:/tmp/ And I forgot to put in my source directory... :( I really meant to run: rsync -avP /tmp/ ...
2
votes
1answer
84 views

Using rsync to copy from local to remote server with cronjob, asking for password

I want to copy files from a local machine to a remote machine. I have the command all set up and it looks like this: rsync -a project root@123.456.789.0:~ However, when running this command, I'm ...
17
votes
4answers
9k views

Resume transfer of a single file by rsync

In Ubuntu, I want to copy a big file from my hard drive to a removable drive by rsync. For some other reason, the operation cannot complete in a single run. So I am trying to figure out how to use ...
1
vote
1answer
38 views

Wildcards in exclude-filelist for duplicity

I am trying to exclude a "bulk" folder in each home directory from the backup. For this purpose, I have a line - /data/home/*/bulk in my exclude-filelist file. However, this doesn't seem to be ...
1
vote
2answers
104 views

Moving files older than one year to parent archive directory

I want to move the photos of my collection into an "/home/Bruno/Archiv/Bilder" directory, which is parent to the "/home/Bruno/Bilder" Directory. I started of with: find -ctime +365 -exec echo mv ...
5
votes
3answers
450 views

Two-way rsync results in oscillating content

I am trying to sync content between two servers. The servers are identical builds (Ubuntu 12.04LTS) and have this cron job running to sync the content: rsync -arzc --update --delete ...
0
votes
0answers
257 views

@ERROR: chdir failed but directory exists

I have a D-Link DNS-320 and I've installed FFP and I'm trying to get rsync running on it. So far I've got the daemon up and running and I've defined a module in my rsyncd.conf like so: max ...
2
votes
2answers
32 views

In rsync, can I add exceptions to --delete using an external file?

I want rsync to: Copy all files from source to destination If a file does not exist anymore in the source, delete it from the destination, EXCEPT for some specific files And I need to list the ...
1
vote
3answers
97 views

What should I include and exclude with rsync to back up my system?

I have spent all day experimenting with rsync exclude-from and include-from, no success and completely lost. None of the examples or help I can find answer my exact, but quite simple requirement, and, ...
2
votes
2answers
2k views

How to copy large files over the network

I need to copy large files over the network, but I am not sure about the command line to use for it. I have been using rsync, but I feel maybe I could zip the files first? I am a Unix beginner, so ...
1
vote
2answers
45 views

rsync dir-merge affected by filters on local AND remote

I'm using rsync with --delete to upload files to a webserver. There are files I want to exclude because they're configuration files. I'm using the "dir-merge" filter so I can have .rsync-filter files ...
1
vote
1answer
49 views

Replace cp function by rsync [duplicate]

I'm trying to replace my cp function by an rsync function My cp function is the following find /home/odroid/USBHD/Movies/ -iname "*.mkv" -mtime '-1' -exec cp -n {} /home/odroid/NASVD/Movies \; do ...
-1
votes
1answer
30 views

Can rsync mirror a directory, without following symlinks linking outside the tree?

I want to mirror some home directories to a remote location, but don't want to follow links that point outside the tree. Links pointing with the directories themselves are okay. I also want the links ...
0
votes
1answer
119 views

Rsync connection reset by peer

rsync --protocol=29 -rav -e ssh --include '*/' --include='*_en*.xml.gz' --exclude='*' user@server:/path/ Content is downloading from remote server but after while I get this error: Write failed: ...
0
votes
2answers
32 views

Rsync'ing system, exclude doesn't seem to work

I'm trying to make a full filesystem backup of a server through rsync, following this guide. I'm using the following command: rsync -aAXH --progress --delete --stats --exclude={\ "/dev/*",\ ...
2
votes
1answer
50 views

Is rsync really bidirectional or more unidirectional?

So I understand that rsync works by using a checksum algorithm that updates files according to file size and date. But isn't this synchronization dependent on how source and destination are called? ...
1
vote
0answers
21 views

How can I limit the bandwith to a davfs-mounted cloud storage?

I need to copy approx 400 files of approx. 25 MB each to a davfs-mounted cloud storage. I have tried the following commands to limit the CPU-load and IO-load: nice -n 15 ionice -c 3 rsync -avhW ...