rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.
2
votes
1answer
510 views
How to examine the fast output of rsync
I am using rsync for backup about 100GB files and directories. My command is
sudo rsync -azvv /home/path/folder1/ /home/path/folder2
However, the output for each file goes up so quickly and there ...
2
votes
3answers
2k views
How do I backup via rsync to a remote machine, preserving permissions and ownership?
Drive A is 2TB in a closet at home.
Drive B is 2TB in my office at work.
I'd like drive A to be the one I use regularly and
to have rsync mirror A to B nightly/weekly.
The problem I have with this ...
3
votes
1answer
66 views
start rsync download before upload completes
I'm uploading a file via rsync from my local machine to a server so that a colleague can download it to his machine. Normally I would notify him to start downloading when the upload is complete, but ...
1
vote
2answers
341 views
rsync: how to include files with name ending in a specific string [duplicate]
Possible Duplicate:
Rsync filter: copying one pattern only
I would like to use rsync to transfer all files from a server (or server-via-ssh) which have a specific ending string, such as a ...
1
vote
1answer
279 views
rsync error: Time value of file truncated on receiver
I run the following rsync command to back up my data. I am on Ubuntu 12.04.
rsync -rt --delete --links --exclude-from '/home/john/rsync-exclude.txt' /media/data/ server:/backup/data
The data ...
2
votes
3answers
396 views
Copy/backup all dirs containing files matching a regexp
I would like to do a backup where I recursively go through a dir structure and only get directories with files whose names matching a particular regexp. I would like to keep the directory structure, ...
1
vote
1answer
136 views
rsync hardlink attempt copies
I've tried setting up a script to hardlink my files to my box.com account (as it's a backup of my music library). As I want to run it automatically to sync my music across several devices, I wanted to ...
3
votes
2answers
1k views
rsync “skipping non-regular file” when cloning my Aperture library
I am trying to use rsync to maintain a backup copy of my Aperture library. When I run the sync command to see what would happen this is the outcome:
rsync --dry-run -r "/Volumes/Data/Aperture ...
3
votes
3answers
241 views
from a sparse file to a block device over the network
If I have a sparse file representing a block device, then how can I efficiently restore the file over a network? Ideally, I'd use rsync -S host:file /dev/sdb, but rsync won't write to block devices. ...
1
vote
1answer
364 views
Rsync keeps writing
I just recently updated my macbook pro to Mountain Lion. I use rsync to make backups of certain directories on my macbook pro my timecapsule wireless router with build-in harddisk.
rsync -avzm ...
1
vote
2answers
930 views
How to copy large files over the network
I need to copy large files over the network, but I am not sure about the command line to use for it. I have been using rsync, but I feel maybe I could zip the files first? I am a Unix beginner, so ...
5
votes
3answers
1k views
cp or rsync, is cp really worth it?
I hope this does not count as a question without a real answer, as I can't seem to find a good reason to use cp(1) over rsync(1) in virtually all circumstances. Should one typically favour rsync over ...
0
votes
0answers
336 views
Logging only transferred files with rsync
I've created a backup script with rsync and I have it running every 10 minutes. I have it logging using --progress but to make reading the log easier I only want to include files that are transferred. ...
3
votes
2answers
3k views
Using rsync to move (not copy) files between directories?
I have been using rsync to copy files for some time. My understanding is that rsync is faster than cp when some of the files to transfer are already in the destination directory, transferring only the ...
2
votes
1answer
1k views
What is the interaction of the rsync --size-only and --sparse options?
If I use rsync with the --size-only and --sparse options together, if a file already exists at the destination as a full file (otherwise the same) it's not overwritten.
If I omit the --size-only ...
1
vote
1answer
317 views
How should I check to see if the remote smb serv is mounted?
I'm pretty new to mount. Basically, I have a remote SMB serv on the local network that I want copy images from a directory on, then repeat every 5 min.
I think what I need to do is make a script that ...
5
votes
1answer
423 views
What keeps one side of an rsync so busy?
I've got a debian machine in my lan serving as a backup server for the others. It has four HDDs combined into a software RAID 5 md device, on that an lvm, and on that a btrfs. Backups are made using ...
4
votes
2answers
277 views
How to use rsync with a remote remote host
I am a happy user of rsync -e ssh and use it to synchronize data between my machine and a remote host using
rsync -avz -e ssh me@hostA:~/folder ~/folder
And this did what I needed until now.
I am ...
6
votes
1answer
609 views
rsync: how to exclude the topmost directory
So, I have a seemingly simple issue, but so far I haven't found a solution: I want to exclude the topmost directory from an rsync, while still syncing all its children. The particular issue is that I ...
0
votes
1answer
173 views
How do I escape a dot character for an rsync command? [closed]
I'm trying to do...
ssh -av -e deploy@domain.com:/var/www/domain.com /Users/user/workspace/domain
But it's outputting this (I presume because of the period character):
OpenSSH_5.6p1, OpenSSL ...
3
votes
1answer
956 views
How should I rsync files in /var/www if I want them to be owned by www-data?
I have set up a new ec2 ubuntu box and installed apache and php5. By default you log onto the box with the ubuntu user who has sudo privileges.
I believe apache runs as root and php5 runs as ...
1
vote
1answer
315 views
Synchronize directory tree with deduplication?
I have two Linux servers that have a large amount of data (1TB+) that need to be synchronized over a slow connection (100 KB/s).
A lot of the data overlaps, but are in different locations.
I would ...
8
votes
3answers
10k views
Sync a local directory with a remote directory in Linux
I have a folder with a few files in it, and some space on a web server. I want to do a bi-directional sync between the local folder and the remote one in linux, just on modification time. How do I ...
2
votes
2answers
504 views
Sync local files to remote git repository
I have my git repository on a linux located on the company server. I ssh into my linux machine and edit files there.
Problem
This method is great until I have a good connection to the server. in ...
0
votes
1answer
815 views
How to sync two directories?
I have an "A" HDD (1,5TB) next to me (on a netbook running OpenBSD 5.1, it's a fileserver)
And I have a "B" HDD (1,5TB) 200km's away from me on an OpenWrt 10.04 router (also "fileserver").
I always ...
4
votes
3answers
233 views
Monitor directory and if a file is requested then rsync on demand
Is there a tool that monitors a certain directory and if a program tries to access a file in that directory, the program loads that file from another place transparent for any application that tries ...
0
votes
1answer
352 views
rsync with absolute paths and excluding subpaths
Say I have the following structure on path origin_path
origin_path/X=1/A/...
origin_path/X=1/B/...
origin_path/X=1/C/...
...
origin_path/X=2/A/...
origin_path/X=2/B/...
origin_path/X=2/C/...
...
...
...
7
votes
3answers
3k views
Give user permissions to all files and folders
I want to have a user who has access to all the files and folders on the system. This is for the purpose of using RSYNC on a local machine to backup a remote machine.
At the moment we are using the ...
1
vote
1answer
517 views
Trying to create a cron to Rsync then tar the folder
I'm stuck at the first hurdle!
I want to run a couple of commands from a bash script. First something like this to rsync some directories:
rsync -e ssh -az user-whatever@website.com:/home ...
1
vote
1answer
246 views
Asking rsync to transfer files without connecting to the remote rsync server?
If I understand correctly, rsync tries to connect to a remote rsync server when transferring files via -e ssh. This worked well for me most of the time, but I am having problems rsyncing with a ...
1
vote
0answers
345 views
ssh: “Error reading response length from authentication socket”
I have a Makefile with some ssh and rsync commands. All of them are executed correctly, but give the following error message:
Error reading response length from authentication socket.
I don't like ...
0
votes
0answers
140 views
rsync giving “Directory has vanished” when there are multiple (existing) source directories
This is happening to me:
$ rsync -av ./foo ./bar $DEST
sending incremental file list
directory has vanished: "/path/to/foo"
foo exists and is regular a regular dir, and rsync -av ./foo $DEST works, ...
1
vote
3answers
437 views
Decreasing hard drive sync time with Unison
I'm using Unison to synchronize my music collection to a few different sources, namely a couple computers over SSH and a hard drive.
One thing I've noticed is that SSH updates are incredibly fast in ...
3
votes
1answer
313 views
Export a m3u playlist to a directory in order they appear in the playlist
There is a way to rsync a m3u playlist into a destination directory.
How can I process the list and number the output so it orders the files to match the playlist order?
For example the m3u:
...
3
votes
2answers
757 views
Setting nice and ionice for rsync via xinetd
I am attempting to set nice and ionice for rsync via xinetd. I am running Fedora 16. The reason I would like to use these values is to reduce the rsync process to an idle state so other processes run ...
1
vote
1answer
3k views
Real Time Local File Sync
How can I set up an instant file sync for two local directories? The catch is I need it in real time (15, 10 or even 5 seconds is too slow), and I don't want the target root directory created.
For ...
10
votes
3answers
4k views
Resume transfer of a single file by rsync
In Ubuntu, I want to copy a big file from my hard drive to a removable drive by rsync. For some other reason, the operation cannot complete in a single run. So I am trying to figure out how to use ...
5
votes
3answers
294 views
Copying large tree from one machine to another, maintaining ownership
I am trying to copy a large folder structure between machines. I want to maintain the ownership/rights during the copy as it is not reasonable to 'fix' the privs afterwards.
Therefore, I am using the ...
6
votes
2answers
463 views
sync files recursively between two folders where files are less than 24 hours old
I want to find all the files under a directory which are within 24 hours then rsync those files with another server.
There are some old files that I do not want to transfer, however if those old ...
0
votes
1answer
668 views
How to copy files nested in directories that match a pattern?
I'm looking to copy files from subdirectories that match this pattern
vendor/plugin/*/tasks/*.rake
into a folder
lib/tasks
I think that this could be done several ways, but wanted to see if a ...
3
votes
2answers
11k views
Why do I get an “rsync: failed to set times on … : Operation not permitted (1)” error on Ubuntu 10.10 with SME Server 7.4?
I am trying to cron an rsync via ssh between two fileservers that are running SME Server 7.4 and Ubuntu 10.10, respectively. The first rsync worked just fine (for reasons that I do not know), but now, ...
2
votes
1answer
274 views
rsync an mpd playlist
An mpd playlist looks like this:
syncrel.m3u
Bob Dylan - The Times They Are A-Changin' [V0]/04. One Too Many Mornings.mp3
Bob Dylan - The Times They Are A-Changin' [V0]/01. The Times They Are ...
0
votes
1answer
176 views
What is the scope of using rsync in sync-ing my target root file system from my host?
I have a target and host setup with Linux as the OS on both.
I have a root file system(RFS) in my target. I have a setup in which my RFS is in development state so it will undergo changes on the ...
3
votes
1answer
337 views
Rsync ssh include & exclude
Here is my current rsync shell script
upload.sh
SOURCEDIR=/Users/thomas/sites/dreamhost/
DESTDIR=******@reggi.com:/home/thomasreggi/sites/
##rsync -avzL --delete --include '*/' ...
4
votes
2answers
4k views
rsync gives “chown <…> failed: Invalid argument (22)” with nfs share
I'm trying to back up my entire system to an external disk using rsync, via a shell script which is run as root:
#!/bin/bash
rsync -vSHPhhaX --numeric-ids --delete ...
13
votes
5answers
2k views
What is the need for rsync server in daemon mode
I don't understand the need for an rsync server in daemon mode. What are the benefits from it if I can use rsync with SSH or telnet?
3
votes
2answers
329 views
How to implement a rotation scheme with rsync
I have an ever growing remote directory of files that I'd like to sort and filter before I rsync them, with the goal of always keeping only the latest N files in my destination directory (i.e. a ...
3
votes
1answer
307 views
Using rsync + cron to sync a machine behind a firewall with my dropbox
I have a machine (A) behind a firewall with no access to the Internet, on this machine I can NFS mount directories on another machine (B) which can access internet, and is accessible from Internet, ...
4
votes
1answer
244 views
Only use mtime comparison with rsync?
Is it possible to sync files via rsync and let rsync only compare mtime informations?
Or is there another tool for this job?
That means that such a tool only copies src to destination if the src is ...
5
votes
2answers
1k views
How do I save changed files?
I have two folders:
ORIGINAL/
ORIGINAL_AND_MY_CHANGES/
My friend has a copy of ORIGINAL/. I would like to generate MY_CHANGES.tgz -- it should contain only new/changed files from ...
