rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.

learn more… | top users | synonyms

1
vote
2answers
459 views

rsync and SMB share

If I'm performing an rsync copy operation on a file that is on an SMB (Samba) share, is the file actually being pulled down from the network onto my client, pieces at a time, and then copied back onto ...
0
votes
1answer
1k views

What is the effect of rsync --block-size on large files?

I want to backup a few terabytes of large files (500mb to 1500mb each) to a backup server (BULK storage) via rsync. For this I use the following command (updated with suggestions from @Gilles): ...
0
votes
2answers
184 views

How to setup a rsync server and client?

I have worked on rsync for the whole afternoon. I have set a rsync server,but I don't know how to use it. I have two machines:66 and 12. 66 is the server,I want to back 66's data to 12,so I use ...
1
vote
1answer
2k views

Logging only transferred files with rsync

I've created a backup script with rsync and I have it running every 10 minutes. I have it logging using --progress but to make reading the log easier I only want to include files that are transferred. ...
3
votes
2answers
140 views

Rsync won't Give Up Writing to an Unmounted Remote Drive

I've been having issues with a external hard drive staying mounted to a mount point. That's not the topic of this question, but background info. The issue is with rsync. It doesn't seem to recognize ...
2
votes
2answers
121 views

Basic rsync command for bit-identical copies

As far as I undstand, the following command: sudo rsync --delete -azvr /home/oshiro/Desktop/source/ /home/oshiro/Desktop/destination Is this all I need to create a simple synchronisation of files ...
0
votes
2answers
125 views

Help with using rsync or cpio to do an incremental backup [duplicate]

I'm trying to do an incremental backup of all files on my NAS box that where modified in the last 24 hours (or so, can be more flexible). I'm using PuTTY to connect through SSH to a ReadyNAS 102 ...
2
votes
2answers
676 views

Rsync --bwlimit not working

I am currently using rsync to transfert large file from a host to another. I would like to limit the debit for this transfert. After reading the man page I found the option --bwlimit which is ...
1
vote
2answers
102 views

How can i keep the mtime of files and directories in bash when I use rsync or cp? For use in Backup/Incremental Backup

I have a new NAS box and after looking through numerous backup solutions I've found doing it manually through PuTTy to work the best. After logging in to the box through PuTTy as root, I first need ...
2
votes
3answers
824 views

Rsync over SSH with authorized keys..but run 2 rsync commands

I just figured out how to automate my rsync backups using authorized_keys and the command= parameter so that my rsync script can't be modified by the user. So my authorized key file looks like this: ...
3
votes
1answer
373 views

Best way to sync files - copy only EXISTING files and only if NEWER than target

I'm doing this sync locally on Ubuntu 12.04. The files are generally small text files (code). I want to copy (preserving mtime stamp) from source directory to target but I only want to copy if the ...
2
votes
1answer
51 views

Is monitoring rsync with a pts device possible?

I have a rsync backup script, and I was wondering about methods of monitoring it as it runs. I could have it save a log and use watch and tail, but I had a more elegant solution in mind that might be ...
5
votes
2answers
2k views

How to copy directory structure without removing symlinks?

I need to "install" a bunch of files to another directory keeping the directory structure of the source files intact. For example, if I have ./foo/bar/baz.txt going to /var/www/localhost/webroot/ I ...
0
votes
0answers
669 views

rsync multiple files to multiple directories

I need to move a large number of files that need to go to different directories i.e. file1.mpg to /mnt/s3/directory1/file1.mpg file2.mpg to /mnt/s3/directorya/file2.mpg file3.mpg to ...
2
votes
1answer
260 views

Analyse the performance of an rsync command from FreeNAS to a USB drive

I infrequently run a task where I rsync my photos (~30 directories with 10-100 files in each) from my FreeNAS machine to an external USB hard drive (500GB WD) as a redundant backup. I execute the ...
1
vote
1answer
175 views

Track down process that has notty

I have a Linux server (Red Hat 2.6 kernel) which had a spike in load due to an Rsync process which seems to have forked many times, but the process was run by rsyncuser@notty I didnt see any cron job ...
0
votes
0answers
23 views

How to allow user to only rsync/download only one directory through SSH [duplicate]

What I want to do is to give to user a simple script to run, that will sync some directory from my VPS to their machine, authentication would be done by using pubkey, and I would like to have control ...
6
votes
2answers
12k views

Using rsync to move (not copy) files between directories?

I have been using rsync to copy files for some time. My understanding is that rsync is faster than cp when some of the files to transfer are already in the destination directory, transferring only the ...
0
votes
1answer
54 views

Find total file size of a disk

I have a corrupted NTFS volume. I ran rsync to copy everything from it, which reported a total # bytes transferred at the end. What's another tool I can use to verify the total # bytes on the disk ...
0
votes
1answer
2k views

Rsync Error 23: Can I tell which files were not transfered?

I ran sudo rsync -va --progress from the root of one ext. drive to a folder on another ext. drive. The reason is that the source drive has an error-ful NTFS and I don't have access to a Windows PC to ...
1
vote
2answers
163 views

Uncompress files when rsync'in

I have 22,000 gzip files on a remote server, which I would like to trasnfer to my machine. I would also like to uncompress these files before/while transferring. Is it possible? My rsync command ...
-1
votes
2answers
66 views

rsync options to include only simple files

We intend to use a cron task to rsync files from one machine to another. Requirements are simple: File source is exactly one directory, and destination is one directory on the target machine Must ...
2
votes
2answers
192 views

rsync on a very large directory

I'm trying to rsync a partial clone of mavencentral using rsync. The problem is, due to ridiculous network policies, I can only have the copy running during business hours. The process will be cut ...
0
votes
0answers
173 views

Why I can't pass ip to rsync script?

I am writing script were rsync should be called and ask for password. However I cannot pass IP as argument. I think I am missing something simple. Any ideas? Even trivial script like this just outputs ...
0
votes
0answers
47 views

rsync include-from exlcude-from with including subdir but excluding dirs above

I try to use rsync with --include-from and --exclude-from options. I have a directory structure like: /docs/domain-[a-z]/templates Now I want to sync templates only if something is in there. Further ...
0
votes
0answers
440 views

rsync error: error in rsync protocol data stream (code 12) at token.c(288)

When I attempt rsync from one server to another server, I get this error: [root@192.168.2.22 ~]# rsync -avzp -e ssh root@192.168.2.77:/system/data /system/data/ deflate on token returned 0 (88936 ...
0
votes
1answer
77 views

How to backup all my data?

I need to backup all my data from a server (in 10 minutes), preferably keeping the symlinks. Any suggestions?
4
votes
1answer
1k views

Do any Linux distributions have a folder sync option (like briefcase in windows)?

I want to keep my local folder synchronized with a network folder. Is there any folder synchronization utility or feature in Linux?
2
votes
2answers
7k views

rsync without prompt for password

I need to execute rsync, without it prompting me for password. I've seen in rsync manpage that it doesn't allow specifying the password as command line argument. But I noticed that it allows ...
2
votes
3answers
1k views

Alternative to diff with progress for massive directory compare?

I just rsync-ed 2,000,000 files (3TB) from one RAID to another. I want to make sure my data is intact. rsync -c takes a really long time. diff doesn't show me what it's doing. Is there an ...
4
votes
3answers
521 views

Help Shell script to pass variables to rsync

I'm trying to create a simple wrapper shell script for rsync. When I send file names to my script, rsync can never seem to identify the correct location. The file names have spaces in them. I've tried ...
2
votes
1answer
445 views

How to properly setup web server directory permissions

I'm lost with this, hopefully I can find some help here: I have Ubuntu 12.04 LTS webserver. For example I have user "myuser". There is a public directory which is my web root. I chowned it and all ...
3
votes
2answers
613 views

Reasons for rsync NOT transfering all files?

Does anyone know common reasons for such a large deficit difference in the number of files transfered when backing up my LARGE home directory using rsync on a ubuntu 10.04 LTS setup.. machine is ...
1
vote
1answer
91 views

rsyncing from ext3 on mac: file has vanished

I am on Os X and I am rsyncing from a ext3 volume (that I read with osxfuse 2.6.2) to a HFS+ volume. The data I am backupping are ~ 500GB. Sometimes rsync gives the following message: file has ...
3
votes
2answers
605 views

How to force overwrite non-empty directories using `mv`

I am wanting to move (not just copy) a group of files/directories to a different directory some of which have name clashes with files/directories in the target directory. My main objective is to move ...
2
votes
2answers
478 views

Meaning of Crossing filesystem boundaries, --one-file-system, etc

I'm planning to use rsnapshot to backup my whole Linux system, though I'm confused by -x option (same of one_fs in rsnapshot.conf). The man page says: -x one filesystem, don't cross partitions ...
7
votes
2answers
5k views

rsync not using --files-from option?

I'm trying to run rsync -a --files-from=~/.rsync_file_list ~/destination and it tells me: rsync error: syntax or usage error (code 1) at options.c(1652) [client=3.0.7]. Can anyone enlighten me as to ...
3
votes
3answers
607 views

Is setting a higher nice level for a process an effective way to reduce its impact on system load/CPU time?

I have an rsync cron job which is pushing the server load and triggering monitor alerts. If I set the job to be run with a high nice level, would that effectively reduce the impact it has on system ...
1
vote
2answers
7k views

rsync error: some files/attrs were not transferred

I'm trying to move my emails Maildir from an old centos server to a new debian server. rsync -avz /home/me/Maildir ssh root@ipaddress:/var/vmail/me/Maildir I tried to copy an 8gb account, didn't ...
1
vote
4answers
1k views

rsync timed out

I need to sync a directory to a directory on a remote server. at the moment i use rsync -ca to do this but the directory is quite large and the whole process fails with a timeout error. Now i'm ...
0
votes
1answer
227 views

rsync vs mtime and ctime

I've been using rsync for Android to backup my phone to a remote NTFS filesystem on a Linux system for a while. Recently, the HDD containing the NTFS filesystem has started to fail (or throw "I/O ...
0
votes
1answer
308 views

rsync giving “Directory has vanished” when there are multiple (existing) source directories

This is happening to me: $ rsync -av ./foo ./bar $DEST sending incremental file list directory has vanished: "/path/to/foo" foo exists and is regular a regular dir, and rsync -av ./foo $DEST works, ...
2
votes
4answers
73 views

Why would I use a rsync mirror?

Most Linux distributions offer mirrors that use rsync. I know that rsync is best used on mirrors because it only copies the delta between the local file and the remote one. What benefits do I get as ...
0
votes
0answers
145 views

rsync dry-run not writing all information to log file

I am trying to get a log file for a dry-run of an rsync, but the actual file transfers are not showing up in the log file. My command is rsync -aruzv --delete src/ usr@me.com:dest/ ...
3
votes
1answer
114 views

rsync move files, leave directories?

I'm using rsync to copy data between my internal and external hard drives. It's done what I need, but I'm running out of room on my internal hard drive. So, is there any way to get rsync to function ...
0
votes
2answers
159 views

How to backup /etc/{,g}shadow files with 0000 permission?

I am trying to backup several servers' /etc by using rsync from another server. Here's a relevant snippet: PRIVKEY=/path/to/private.key RSYNC_OPTS="--archive --inplace --no-whole-file --quiet" ssh -n ...
0
votes
1answer
54 views

rsync directory and contents to new location and owner

I have access to 2 group accounts: ops_user and test_user. Is it possible to copy a directory and all subdirectory owned by ops_user to a new directory owned by the test_user? I.e I want to copy ...
8
votes
3answers
433 views

rsync most recent x GB

I'm looking for a command/script to allow the most recently modified files (up to) 10GB be copied to another computer. So if there are 4 files 4 GB each, only 2 of them should be transferred by the ...
9
votes
5answers
12k views

Syncing directories in both directions with rsync

I happen to know about rsyn, and I use rsync to sync between my mac and a linux server as follows. rsync -r -t -v MAC LINUX rsync -r -t -v LINUX MAC I expected to run the first command to sync, but ...
1
vote
1answer
82 views

rsync only leaves partial files?

I am trying to copy files from my hard drive to a networked external disk (WDMyCloud). I have enabled the FTP access to the hard drive and mounted it to a local directory using curlftpf to a local ...