rsync is a tool to efficiently copy directory hierarchies, locally or remotely, with powerful filters to decide what gets copied.
0
votes
1answer
51 views
Rsync adding a “?” at the beginning of directories
I currently have many of these commands running in a .sh file that looks like this:
rsync -avz -e ssh --rsh='ssh -p1337' --bwlimit=10000 root@DestinationIP:/home/backup /home/localbackup
rsync -avz ...
3
votes
1answer
47 views
Bash remote autocompletion : change the 'starting' directory
I'm regularly downloading files from a remote server, always from the same directory. So I wrote a custom function that I put in my bashrc:
download_from_myserver () {
for file in "$@"
do
...
2
votes
2answers
59 views
rsync certain files, excluding the rest, ignoring .svn/ directory, recursively
I'm using rsync to copy some files from a share to another.
Recursively, I need to:
Delete files at destination that were removed from the origin
Only sync php and js files
Exclude every other file ...
4
votes
2answers
289 views
Can't share an ssh connection with rsync
In my .ssh/config file I have the following:
Host xxx
User yyy
HostName zzzz
ControlMaster auto
ControlPath ~/.ssh/%r@%h:%p
This works great for multiplexing my ssh connections (i.e. login once, ...
3
votes
2answers
71 views
Any ideas to simplify the awkward rsync expression below?
Here is expression:
rsync -avz --progress -e "ssh -i /where/is/my/id_dsa" vivek@some.host:`ssh -i /where/is/my/id_dsa vivek@some.host "find /remote/source/dir -type f -name '*.sql' | sort -nr | head ...
5
votes
3answers
69 views
rsync, delete files on receiving side that were deleted on sending side. (But don't delete everything)
I'd like to use rsync to...
delete files on the receiving side that were also deleted on the sending side
not delete other files that are in the rsynced directory on the receiving side
For ...
2
votes
1answer
40 views
`mv` has failed because of insufficient disk space, what now?
I have tried to move a folder A from partition a to partition b as folder B with mv. Now the target file system was not big enough for all the data (I know I should have checked this first).
Anyway, ...
2
votes
3answers
424 views
rsync list of files in sub-directories to remote server and delete extraneous
I haven't been able to find the answer to this one. I have tried all kinds of combinations of --include, --exclude, -r, --delete-excluded, and source directory.
This is what I'm trying to accomplish:
...
4
votes
3answers
356 views
How can I exclude files by default with rsync?
How can I exclude files by default with rsync? Here is how my normal rsync syntax starts out:
rsync --exclude ".ht*" --exclude "error_log" --exclude ".DS*" --exclude "old" ...
I've seen a lot of ...
2
votes
2answers
27 views
How do I rsync only some files in some directories
I'm trying to sync all *.jpg files from /var/www/data/models/days/ + some other directories from /var/www/data root.
I do:
rsync -az --delete --include='/models' --include='*.jpg' --exclude='*' ...
1
vote
2answers
79 views
Cancel and resume a duplicity backup
Is there a way to cancel duplicity (running over rsync and symmetric gpg encryption) without messing up the running backup and resume it later (for example after rebooting the laptop) without ...
2
votes
1answer
32 views
ssh/scp works but rsync just constantly says “no”
Hi I have a windows 2003 server that I need to back up onto a linux client so I install cygwin on the Win2k3. On the Win2k3 I have enabled ssh, scp but (because the Win2k3 server uses an customised ...
-1
votes
1answer
63 views
rsync: failed to connect to host: Connection timed out (110) [closed]
I am not able to list drectories through rsync:
from Host2:
user@host2#sudo rsync user@host1::share
rsync: failed to connect to host1: Connection timed out (110)
rsync error: error in socket IO ...
2
votes
3answers
43 views
Get files on remote copy but not local
I have a folder.
I have one copy of this folder locally and one on a server. I edited my local folder as I wanted and then rsync it to the server.
Is there any way of comparing those two copies, ...
1
vote
1answer
35 views
Getting back rsync's deleted files [duplicate]
I accidentally rsync-ed to a server using the delete attribute when I shouldn't have.
Is there any chance of getting the data on the server that rsync removed.. back?
11
votes
4answers
3k views
Does rsync verify files copied between two local drives?
I want to make a fresh new copy of a large number of files from one local drive to another.
I've read that rsync does a checksum comparison of files when sending them to a remote machine over a ...
0
votes
2answers
241 views
rsync error: some files/attrs were not transferred
I'm trying to move my emails Maildir from an old centos server to a new debian server.
rsync -avz /home/me/Maildir ssh root@ipaddress:/var/vmail/me/Maildir
I tried to copy an 8gb account, didn't ...
4
votes
2answers
58 views
Two-way rsync results in oscillating content
I am trying to sync content between two servers. The servers are identical builds (Ubuntu 12.04LTS) and have this cron job running to sync the content:
rsync -arzc --update --delete ...
12
votes
3answers
6k views
scp without replacing existing files in the destination
How do I copy an entire directory into a directory of the same name without replacing the content in the destination directory? (instead, I would like to add to the contents of the destination folder)
...
4
votes
1answer
306 views
Rsync — Itemized List of Changes
I've learned that with the -i option, I can get rsync to list all the changes it makes. I've been using it along with the -n or --dry-run options so that I can always learn about all expected changes ...
6
votes
3answers
242 views
Why does rsync fail to copy files from /sys in Linux?
I have a bash script which uses rsync to backup files in Archlinux. I noticed that rsync failed to copy a file from /sys, while cp worked just fine:
# rsync /sys/class/net/enp3s1/address /tmp
...
1
vote
1answer
40 views
Why does rsync look for DSA instead of RSA key when run from cron job?
I want to backup files from a server to my local computer using rsync. I can only log-in to the server with an RSA ssh key.
I have stored the passphrase to the key in Seahorse Passwords and Keys, ...
0
votes
0answers
44 views
Rsync seems to back up files that haven't been opened or changed
I have started using rsync to back some data on my mac to an external HD. It works really well, but I have noticed something odd. Every time I run the command, I get a list of files that haven't been ...
2
votes
1answer
136 views
rsync: failed to set permissions on “/path/to/file.txt”: Operation not permitted (1)
I encountered the error when attempting to transfer source files from a remote Linux web server to a local HP dt1000i Desktop Hard Drive connected to an Ubuntu 12.10 box via USB.
A Samba share is ...
1
vote
0answers
76 views
Rsync daemon intrepreting parameters as command in rsync.conf
I meshed up with my rsync on linux. When I am restating it, its showing me following error:
sudo /etc/init.d/rsync restart
/etc/rsyncd.conf: line 13: [ftp]: command not found
/etc/rsyncd.conf: line ...
1
vote
1answer
93 views
rsync: error starting client-server protocol
I have rsyncd running on both the systems . When I am trying to check the connection it giving me following error:
From host2:
user@host2#rsync username@host1::share
password: [password]
...
1
vote
2answers
1k views
Using cygwin and rsync — “password file must not be other-accessible”
I've finally got an old computer of mine running as a backup server with Ubuntu 11.10. I'm planning on using it to backup my Windows 7 machine weekly using rsync. I've got cygwin installed, and rsync ...
3
votes
2answers
112 views
Rsyncing files with special characters to USB FAT32
I want to copy a large number of files to a USB drive that is formatted FAT32 (and cannot be formatted anything else, unfortunately).
Many of these files have names with characters such as : and ? ...
2
votes
2answers
100 views
`cp -al` snapshot whose hard links get directed to a new file when edited
I am trying to take snapshots of a massive folder regularly.
I have read here: http://www.mikerubel.org/computers/rsync_snapshots/#Incremental
that cp -al takes a snapshot of a folder by simply ...
0
votes
0answers
34 views
rsync a mac on linux box, --delete not working
I have a mac Darwin Kernel Version 10.8.0. One of its folders is called source. I want to back it up on a remote linux folder called destination.
My problem: whatever I try, I cannot make the rsync ...
1
vote
1answer
52 views
backup / on ntfs filesystem encrypted
I was about to backup my archlinux, following this guide to my FritzBox, (which enforces a NTFS system that I mounted via samba) as I remembered, that NTFS is not capable to keep permissions and other ...
2
votes
1answer
93 views
rsync and backup and changing timezone
I back up my pictures from my camera using rsync, using:
rsync -vzrtl --progress --stats --timeout=0 host destination
Now I was in a different timezone when I did my first backup then I moved to a ...
1
vote
1answer
451 views
IO Error in rsync while doing everyday backup
I have a sample NAS server (QNAP TS-210), with very limited Linux on-board (although a bit reinforced with Optware/IPKG). I'm a Linux newbie. After digging through Internet I was able to write my own ...
0
votes
3answers
85 views
rsync timed out
I need to sync a directory to a directory on a remote server.
at the moment i use rsync -ca to do this but the directory is quite large and the whole process fails with a timeout error.
Now i'm ...
0
votes
0answers
19 views
Using rsync without adding ssh user [duplicate]
How to give an user access to rsync (as www-data user), without giving him an ssh user (because i afraid that he could do something with my computer), how can i do this?
3
votes
1answer
124 views
How to see the total progress while copying the files
We know that if we give --progress parameter to rsync it will show the progress of files copied. But issue is that is shows the progress for each single file not total or overall progress.
So how to ...
11
votes
1answer
1k views
Making a progressbar with “dialog” from rsync output
I'm looking for a way to filter/redirect rsync output in a manner where it can be fed to the "dialog --gauge" command, so I can get a nice looking progressbar during file sync.
Currently I have only ...
1
vote
0answers
58 views
BackupPC can't finish backup
I'm trying to backup /etc/ directory on CentOS 5.2 using BackupPC.
It takes several hours and then aborted by signal ALRM.
There is a partial backup created with all data from /etc
But BackupPC thinks ...
5
votes
2answers
130 views
Rsync different behavior when syncing folders HDD-HDD or HDD-Ext HD
When I sync two folders between two HDDs, rsync only lists the changes made at the end.
However if I sync a folder between a HDD and an external HD, while the sync is running it is listing each ...
3
votes
1answer
157 views
Having an rsync job complete after closing SSH connection
I am transferring a large amount of files from one computer to another using rsync. I am doing this by SSHing into the source computer and executing a command like this:
sudo rsync ssh ...
2
votes
0answers
124 views
Rsync --bwlimit not working
I am currently using rsync to transfert large file from a host to another.
I would like to limit the debit for this transfert. After reading the man page I found the option --bwlimit which is ...
2
votes
1answer
255 views
How to rsync only new files
I am trying to set up rsync to syncronize my main web server to the remote server by adding newly generated file to the later.
Here is the command that I use:
rsync -avh --update -e "ssh -i ...
2
votes
1answer
179 views
rsync server and client issue
I am new to rsync server so please bear with me.
I just configured an rsync server that is hosting the files I would like to replicate to a remote machine. Here is the rsyncd.conf file:
max ...
9
votes
6answers
4k views
tar + rsync + untar. Any speed benefit over just rsync?
I often find myself sending folders with 10K - 100K of files to a remote machine (within the same network on-campus).
I was just wondering if there are reasons to believe that,
tar + rsync + ...
0
votes
2answers
83 views
How to detect particular system call called or not in a whole workflow?
EDIT No. 1
My task is mirroring , i.e., copying updated data from master server to all mirrors, by using rsync and rsh. But during rsync and rsh, I found some delay. My thinking is , the reason for ...
0
votes
2answers
208 views
Synchronizing same files with different filenames using rsync [duplicate]
I have a directory ~/music that contains all my music files and a directory /media/backup/music that I wish to synchronize with the first one using rsync. Initially, I did a rsync -a ~/music ...
0
votes
1answer
73 views
rsync is changing my directory permissions
I have an rsync setup that transfers files from my local development machine to my production web server. On the production server, the storage directory needs to be 775.
When the rsync completes, it ...
13
votes
1answer
6k views
Delete extraneous files from dest dir via rsync?
Say I have
SRC
001.jpg
002.jpg
001.txt
a.zip
DEST
hello.jpg
rsync -d --delete SRC:{*.jpg,*.txt} DEST
It doesn't remove hello.jpg from DEST, any idea how to archive this?
3
votes
4answers
124 views
Most Efficient way to back up/sync large directories over SSH
I'm looking to back up some large directories on a Dedicated Server to another Server on a daily basis using minimal bandwidth
RSync looks like its up to the task but I'm unsure of the best command ...
1
vote
0answers
105 views
Cannot get rsync to keep source file ownership, tried many tricks
I'm trying to rsync some directories from a webserver running RHEL5 to a system running Xubuntu. I have rsync, ssh, and keys setup for the machines. I've tried everything so that when i backup from ...
