rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
1answer
208 views

I can't get rsync --exclude-from to work with a file

Here's the command : rsync -avAX --exclude-from=/home/vco/bin/wip-files-learning/backup_tests/rsyncexclude.txt ./some_tests/ ./back_to_me/ Here's the contents of the exclude file : ...
1
vote
1answer
146 views

rsync: Copy speed decreases while syncing two directories

I am using rsync on fedora 20 to sync my directories. I am using the command below:- $ rsync --progress -a srcDir DestDir But, as rsync copies files, copy speed decreases significantly. Here is my ...
1
vote
1answer
52 views

Chunked transfer contents of block device over bad network

/dev/sda is the only disk on system. I want to save it to a raw image on another server. I can't do it in one shot, because network disconnects often. Is it possible with e.g. torrent?
3
votes
1answer
90 views

rsync causing errors after sync

When I run the rsync command to push my files to production, sometimes - not always, and it's very rare - after the sync has completed, we are getting errors within our production environment. The ...
8
votes
3answers
2k views

Transfering millions of files from one server to another

I have two servers. One of them has 15 million text files (about 40 GB). I am trying to transfer them to another server. I considered zipping them and transferring the archive. But I realized that ...
4
votes
1answer
286 views

What does all this extra data from rsync mean?

When I move directories with rsync, I get some extra data to the right of the progress bar right after each file has been copied: $ rsync -aP assembly /media/andreas/backup sending incremental file ...
1
vote
1answer
154 views

Linux command to copy as hard links, while deleting unwanted files?

I'm looking for a command that behaves both like cp -al in only creating hard links rather than copying file contents, and rsync -a --delete in removing files from the destination that are not ...
1
vote
2answers
53 views

Can rsync be configured to avoid modifying subdirectories not found in the source folder?

I am having a hard time figuring out exactly how to run rsync to get it to do what I need it to do. Basically what I need is as follows given a single source folder with multiple sub-directories: ...
1
vote
1answer
115 views

communicate with rsync daemon without sockets

According to the manpage, rsync --daemon will either: try to communicate using the rsync protocol using stdin/out, if it detects that the stdin/out are a socket, open a TCP socket for listening and ...
0
votes
2answers
47 views

How to Copy Only the Directories with a specific File in that directory

Main_Directory | Event_Subdirectories | *.mcp .otherfiles I want to copy all Event_Subdirectories to another Main_Directory that have the *.mcp file within the Event_subdirectory, but I'm ...
1
vote
0answers
25 views

Using rsync, how can I know what attribute of source file differed from the dest which caused the trasfer

I heavily depend on rsync for remote data transfer and backup purposes, occasionally on different filesystem types. AFAIK rsync by default compares file size and modification timestamps to find out ...
0
votes
1answer
45 views

File tranfer from the server

I want move (not copy with scp) my file from the server to the local repository and finally delete it on the server after transfer. I use next command from the repository, where I want have the file: ...
1
vote
1answer
51 views

copy symlinks with rsync

When I'm trying to backup a disk with rsync, symbolic links are not resolved correctly. For example: media └disk1 ├folder1 │ └folder2 (symlink to /media/disk1/folder2) └folder2 After rsync ...
4
votes
2answers
6k views

How to see the total progress while copying the files

We know that if we give --progress parameter to rsync it will show the progress of files copied. But issue is that is shows the progress for each single file not total or overall progress. So how to ...
2
votes
2answers
214 views

rsync with colons in filenames

I have a fairly large directory that I need to sync to an external hard drive for both backup and portability reasons. /work I try to run the following rsync command in order to copy this folder to ...
2
votes
1answer
205 views

Using rsync to copy from local to remote server with cronjob, asking for password

I want to copy files from a local machine to a remote machine. I have the command all set up and it looks like this: rsync -a project root@123.456.789.0:~ However, when running this command, I'm ...
1
vote
1answer
248 views

Wildcards in exclude-filelist for duplicity

I am trying to exclude a "bulk" folder in each home directory from the backup. For this purpose, I have a line - /data/home/*/bulk in my exclude-filelist file. However, this doesn't seem to be ...
1
vote
2answers
779 views

Moving files older than one year to parent archive directory

I want to move the photos of my collection into an "/home/Bruno/Archiv/Bilder" directory, which is parent to the "/home/Bruno/Bilder" Directory. I started of with: find -ctime +365 -exec echo mv ...
5
votes
3answers
814 views

Two-way rsync results in oscillating content

I am trying to sync content between two servers. The servers are identical builds (Ubuntu 12.04LTS) and have this cron job running to sync the content: rsync -arzc --update --delete ...
1
vote
0answers
2k views

@ERROR: chdir failed but directory exists

I have a D-Link DNS-320 and I've installed FFP and I'm trying to get rsync running on it. So far I've got the daemon up and running and I've defined a module in my rsyncd.conf like so: max ...
2
votes
2answers
65 views

In rsync, can I add exceptions to --delete using an external file?

I want rsync to: Copy all files from source to destination If a file does not exist anymore in the source, delete it from the destination, EXCEPT for some specific files And I need to list the ...
2
votes
3answers
500 views

What should I include and exclude with rsync to back up my system?

I have spent all day experimenting with rsync exclude-from and include-from, no success and completely lost. None of the examples or help I can find answer my exact, but quite simple requirement, and, ...
2
votes
2answers
3k views

How to copy large files over the network

I need to copy large files over the network, but I am not sure about the command line to use for it. I have been using rsync, but I feel maybe I could zip the files first? I am a Unix beginner, so ...
1
vote
2answers
164 views

rsync dir-merge affected by filters on local AND remote

I'm using rsync with --delete to upload files to a webserver. There are files I want to exclude because they're configuration files. I'm using the "dir-merge" filter so I can have .rsync-filter files ...
1
vote
1answer
147 views

Replace cp function by rsync [duplicate]

I'm trying to replace my cp function by an rsync function My cp function is the following find /home/odroid/USBHD/Movies/ -iname "*.mkv" -mtime '-1' -exec cp -n {} /home/odroid/NASVD/Movies \; do ...
-1
votes
1answer
74 views

Can rsync mirror a directory, without following symlinks linking outside the tree?

I want to mirror some home directories to a remote location, but don't want to follow links that point outside the tree. Links pointing with the directories themselves are okay. I also want the links ...
0
votes
2answers
59 views

Rsync'ing system, exclude doesn't seem to work

I'm trying to make a full filesystem backup of a server through rsync, following this guide. I'm using the following command: rsync -aAXH --progress --delete --stats --exclude={\ "/dev/*",\ ...
2
votes
1answer
367 views

Is rsync really bidirectional or more unidirectional?

So I understand that rsync works by using a checksum algorithm that updates files according to file size and date. But isn't this synchronization dependent on how source and destination are called? ...
1
vote
0answers
52 views

How can I limit the bandwith to a davfs-mounted cloud storage?

I need to copy approx 400 files of approx. 25 MB each to a davfs-mounted cloud storage. I have tried the following commands to limit the CPU-load and IO-load: nice -n 15 ionice -c 3 rsync -avhW ...
23
votes
3answers
37k views

How to rsync only new files

I am trying to set up rsync to syncronize my main web server to the remote server by adding newly generated file to the later. Here is the command that I use: rsync -avh --update -e "ssh -i ...
2
votes
1answer
826 views

rsync is deleting excluded file

I'm having trouble excluding a file from rsync. The file in question is a configuration file that is specific to the machine it's on, so I have one version on my dev machine, and another on the ...
0
votes
3answers
71 views

Backup using rsync

Last time I backed up my data by copying and pasting my home directory into my external hard drive. Since then, I have added and deleted files from my home directory. I want to update that directory ...
0
votes
2answers
187 views

How does rsync encode filenames?

By using strace on the active rsync process, I can see output like: read(4, "9\0\0\7\1\10\0\1\10\0\1\10\0\1\10\0\1\10\0\1\10\0\1\10\0\1\10\0\1\10\0\1"..., 16384) = 61 write(3, ...
1
vote
3answers
1k views

rsync: samba vs ftp for backup

I need to back up ~0.5 TB of files (about 600,000 of them) from a Windows Server 2003 machine to a CentOS 6.4 machine across a 100MB network, and update them once a night. The backup script would be ...
2
votes
1answer
103 views

rsync only missing directories

Is there a way to tell rsync to sync only source directories that are missing on a destination (whole directories, not just any missing file)? Considering S as the set of source directories, and D ...
5
votes
2answers
80 views

mv with rsync functionality

I'm trying to merge two directory trees that have many common elements but also each have elements that are only present in one of the two trees. The main issue I am having is that when mv encounters ...
23
votes
5answers
24k views

rsync all files of remote machine over SSH without root user?

I have this command to backup a remote machine. The problem is that I need root rights to read and copy all files. I have no root user enabled for security reasons and use sudo the Ubuntu way. Would I ...
2
votes
0answers
249 views

rsync 3.1.0 is creating empty backup directories

I just noticed that there is a discrepancy between version 3.0.9 and 3.1.0 of rsync. Running the command $ rsync -a --delete --backup --backup-dir=../old source/ dest/ with version 3.1.0 gives the ...
1
vote
0answers
23 views

After restoring a backup my permissions seem to be borked

I made a complete backup of the system with "rsync -aAXv", and set up my encryption. After restoring everything, and booting up and trying to login, openbox didn't want to start, and "startx" didn't ...
2
votes
3answers
662 views

How do you fire a sequence of commands at the command tool?

I had a previous question (deleted it) and I still don't understand why it is so hard to understand what I'm trying to ask, but I'll try once again and more clearly. So I'm copying over several ...
0
votes
0answers
197 views

Script to compare directories and move files (like rsync)

I use rsync to sync data between two servers. If I completely rebuild the directory structure, rsync cannot understand this and will attempt to recopy everything. I am aware that Unison is capable ...
1
vote
1answer
143 views

rsync OpenIndiana repository on local server

I was looking for a repository from OpenIndiana but everything what I found is this: http://wiki.openindiana.org/oi/Making+a+LAN+mirror+of+global+package+repositories. I would like to sync ...
1
vote
0answers
312 views

Run multiple rsync's at once?

I'm moving over about a million of files (800GB, containing) multiple system backups. And it's only running at ~9MB at a time, often. Enough bandwidth, since it can run up to about 50MB/s. However, ...
3
votes
2answers
87 views

Delete the files on the destination which are found in the source using rsync

I was wondering is there any way to delete all the files in the destination using rsync which are found in source. I have 30+ dir in source and 100+ files on the destination I want only the 30+ in ...
2
votes
1answer
282 views

Would this LUKS LVM rsync restore method work?

I have an Ubuntu installation using LVM and LUKS encryption. LVM and encryption were chosen during the install process). While logged into it, I backup the full live system using rsync to another ...
1
vote
1answer
117 views

get rsync to dereference symlinked dirs presented on cmdline like find -H

I'd love rsync to copy symlinks to dirs specified on the cmdline as dirs but leave all symlinks in the copied tree as is - like find -H, but the only way is a nasty hack of rsync -aR --rsync-path='cd ...
43
votes
5answers
42k views

scp without replacing existing files in the destination

How do I copy an entire directory into a directory of the same name without replacing the content in the destination directory? (instead, I would like to add to the contents of the destination folder) ...
1
vote
2answers
229 views

Apply given rsync exclude patterns on given directory

I have a setup where I use rsync to mirror some source directory to a (remote) destination except for some files and locations defined witch rsync exclude patterns: # Useless files - thumbs.db - *.~ ...
17
votes
5answers
14k views

view stdout for another pts

Here is the situation. I left my pc at home doing an rsync from a 2TB hard drive to another 2TB hard drive (it's going to take a while since they are both USB 2.0). I am now at work and I have ssh-ed ...
-1
votes
1answer
73 views

Why doesn't rsync take advantage of the mv command when --remove-source-files is specified?

Assume I want to move a tree in the filesystem, e.g. /path/to/a a.txt b.txt to another location with rsync (3.0.9 protocol version 30), e.g. with rsync -a --remove-source-files /path/to/a/ ...