Take the 2-minute tour ×
Unix & Linux Stack Exchange is a question and answer site for users of Linux, FreeBSD and other Un*x-like operating systems.. It's 100% free, no registration required.

For a while I used Dirvish to do incremental backups of my machines, but it is slightly cumbersome to configure, and if you do not carry a copy of your configuration it can be hard to reproduce elsewhere.

I am looking for backup programs for Unix, Linux that could:

  • Incrementally update my backup
  • Create "mirror" trees like dirvish did using hardlinks (to save space)
  • Ideally with a decent UI
share|improve this question

9 Answers 9

This crude -but functional- script will backup everything under the sun to your external hard drive under a hard link farm. The directory name is a timestamp, and it maintains a symlink to the latest sucessful backup. Think of it as a Time Machine sans the fancy GUI.

#!/bin/sh
DATE=`/bin/date +%Y%m%d%H%M%S`
RSYNC=/usr/bin/rsync
BASE=/mnt/externalhd
TARGET=$BASE/daily
$RSYNC -av --exclude $TARGET --exclude-from=/etc/backup/rsync.exclude --link-dest=$TARGET/latest/ / $TARGET/$DATE/
touch $TARGET/$DATE/
rm $TARGET/latest
ln -s $TARGET/$DATE $TARGET/latest

Set it up creating an empty $TARGET and symlink a dummy $TARGET/latest to it. Populate /etc/backup/rsync.exclude with lost+found, tmp, var/run and everything else you need to skip during backup, or go for --include-from if it fits you better; man rsync is your friend.

Proper sanity checks, error control, remote backup and pretty GNOME GUI are left as an exercise to the reader ;-)

share|improve this answer
    
+1 I do something very similar to this. --link-dest for the win. –  kbyrd Aug 17 '10 at 19:37

Lars Wirzenius's obnam:

  • Does deduplication when it backs up things, which means that backups are likely to take little space, potentially a lot more than simply hardlinking files.
  • As the backups are with deduplication, every backup is "full", with no need of having incremental backups. It simply detects that not many things have changed and only does what is needed.
  • Each backup is, effectively, a snapshot of your system, without the need to recover the last full backup and each incremental backup in turn to get the system to be restored.
  • Contrary to bup (which is another strong contender with deduplication), obnam is able to delete previous backups to save space of unnecessary backups.
  • It is under active development and has a mailing list with knowledgeable people.
  • Besides using the regular recovery methods of a backup program, there is a fuse filesystem that provides a view of obnam's backups as a plain filesystem and that can choose which snapshot/backup/generation to mount, which is super handy, as far as "user" interfaces go (given that we are in a Unix-related site, a flexible command line interface is highly valued).
  • It supports encryption as an integral part of the backups (and not as an afterthought).
  • It was written with support for remote backups in mind.

In my opinion, one serious contender for the Backup World Day (and not only that day).

share|improve this answer

Try rsnapshot. It uses rsync and hardlinks and is incremental.

share|improve this answer
2  
I should mention that I have no idea what Dirvish is or how it works. –  xenoterracide Aug 17 '10 at 3:24
    
I think it might be GUI-less so I miss that bonus... but since you said 'Ideally' –  xenoterracide Aug 17 '10 at 3:27
1  
A GUI does not a good UI make. –  Eli Frey Aug 17 '10 at 3:32
2  
i've been using rsnapshot for years –  Casey Aug 17 '10 at 19:35

The Backup-Comparison of backup tools at the Ubuntu-Stackexchange is not really Ubuntu-specific. Perhaps you get some suggestions there.

I recommend DAR - the Disk ARchive program. It does not come with a GUI, but its config is easy to reproduce. It has great incremental backup support. It does not use hardlink mirror trees, but it has a convenient shell for navigating the filesystem view of different snapshots.

share|improve this answer

I use backintime, which is primarily targeted towards Gnome/KDE desktops. However, it can work from the commandline as well.

I describe backintime as a backup system with "poor man's deduplication".

If you were to write your own backup script to use rsync and hardlinks, you would end up with something similar to backintime.

  • I use cron to kick off the backintime job once per night.
  • As the documentation says: The real magic is done by rsync (take snapshots and restore), diff (check if somethind changed) and cp (make hardlinks).
  • backintime can be configured with different schedules. I keep monthly backups for 1 year, weeklies for 1 month, and dailies for 1 week.
  • backintime uses hardlinks. I have 130GB worth of data, and I back this up nightly. It only uses 160GB worth of space on the second drive because of the magic of hardlinks.
  • Restoring data from the backup location is as simple as running cp /u1/backintime/20100818-000002/backup/etc/rsyslog.conf /etc/rsyslog.conf. You don't need to use the GUI.
  • On the second drive, the initial copy was expensive (since you can't do hardlinks between two different filesystems), but subsequent copies are fast.
  • I copy data from my primary filesystems to a second filesystem onto a second hot-swappable drive, and periodically rotate the secondary drive.
share|improve this answer
    
Surely you want the initial copy to be expensive, otherwise you don't have a backup, just another link to a single file? Of course, it's also possible that I'm missing some crucial point which makes this comment pointless :-) –  dr-jan Aug 25 '10 at 13:05
    
@Dr-jan : I agree with you. However, I think some users expect the initial copy to be fast. –  Stefan Lasiewski Aug 26 '10 at 17:11

Rdiff Backup is really good http://rdiff-backup.nongnu.org/

share|improve this answer

BackupPC sounds like it fits the bill. It manages a tree of hard links for dedupe and can backup many machines, or just the local machine.

share|improve this answer
    
+1 for BackupPC I use it to backup a group of servers regularly. It also has a good web-based UI. –  dr-jan Aug 25 '10 at 13:00

I've had some success with RIBS (Rsync Incremental Backup System)

It uses rsync so hardlinks are supported and can do incremental backups hourly, daily, weekly and monthly.

However, it is a script only. To set up you need to edit the settings and then set up related cronjobs. It works, but it's not the most user friendly.

share|improve this answer

I've been using epitome for about a year now for deduplicated backups of my personal data . It has a tar like interface so it's quite comfortable for a unix user and setup is a breeze, at least, on OpenBSD. You can easily cron it to backup your directories on a daily basis, and it takes care of the deduplication of your data. You basically are left with a meta-file that you can use to restore your snapshot at a later date. As I said the interface is tar-like so doing a backup is as easy as:

# epitomize -cvRf 2010-08-16-home.md /home
share|improve this answer
    
It's currently experimental but, works quite well. I've been able to do full restores from arbitrary meta files and recover information that I needed, and have had 0 problems with it in ~1 year of use. –  gabe. Aug 17 '10 at 5:01

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.