Backing up is the process of making copies (a backup) of data which may be used to restore the original after a data loss event.

learn more… | top users | synonyms (1)

93
votes
19answers
16k views

What is the fastest way to send massive amounts of data between two computers?

This is a situation I am frequently in: I have a source server with a 320GB hard-drive inside of it, and 16GB of ram (exact specs available here, but as this is an issue I run into frequently on ...
73
votes
1answer
214k views

Compress a folder with tar?

I'm trying to compress a folder (/var/www/) to ~/www_backups/$time.tar where $time is the current date. This is what I have: cd /var/www && sudo tar -czf ~/www_backups $time" I am ...
48
votes
8answers
51k views

Rsync filter: copying one pattern only

I am trying to create a directory that will house all and only my PDFs compiled from LaTeX. I like keeping each project in a separate folder, all housed in a big folder called LaTeX. So I tried ...
45
votes
7answers
19k views

Recovering accidentally deleted files

I accidentally deleted a file from my laptop. I'm using Fedora. Is it possible to recover the file?
40
votes
9answers
13k views

Easy incremental backups to an external hard drive

For a while I used Dirvish to do incremental backups of my machines, but it is slightly cumbersome to configure, and if you do not carry a copy of your configuration it can be hard to reproduce ...
38
votes
5answers
30k views

Is it possible to mount a gzip compressed dd image on the fly?

I like create an image backup for the first time I'm backing up a system. After this first time I use rsync to do incremental backups. My usual image backup is as follows: Mount and zero out the ...
31
votes
5answers
30k views

Clear unused space with zeros (ext3,ext4)

How to clear unused space with zeros ? (ext3,ext4) I'm looking for something smarter than cat /dev/zero > /mnt/X/big_zero ; sync; rm /mnt/X/big_zero Like FSArchiver is looking for "used space" ...
29
votes
6answers
32k views

rsync all files of remote machine over SSH without root user?

I have this command to backup a remote machine. The problem is that I need root rights to read and copy all files. I have no root user enabled for security reasons and use sudo the Ubuntu way. Would I ...
26
votes
9answers
4k views

How to keep track of changes in /etc/

I would like to keep track of changes in /etc/ Basically I'd like to know if a file was changed, by yum update or by a user and roll it back if I don't like the chage. I thought of using a VCS like ...
19
votes
3answers
33k views

Create a tar archive split into blocks of a maximum size

I need to backup a fairly large directory, but I am limited by the size of individual files. I'd like to essentially create a tar.(gz|bz2) archive which is split into 200MB maximum archives. ...
16
votes
7answers
12k views

What to use to backup files, preserving ACLs?

When using the tar utility to store files in backups one loses the extended ACLs. Is there some commonly used and not hackish solution (like: create a script that will recrate the ACLs from scratch) ...
14
votes
4answers
4k views

Rock-stable filesystem for large files (backups) for linux

What filesystem would be best for backups? I'm interested primary in stability (especially uncorruptability of files during hard reboots etc.) but how efficiently it handles large (>5GB) files is also ...
13
votes
2answers
8k views

Fastest way combine many files into one (tar czf is too slow)

Currently I'm running tar czf to combine backup files. The files are in a specific directory. But the number of files is growing. Using tzr czf takes too much time (more than 20 minutes and ...
12
votes
4answers
538 views

rolling diffs for storage of highly similar files?

At work we do a nightly dump of our mysql databases. From day to day, I would guestimate that close to 90-95% of the data is duplicate, increasing as time goes on. ( Heck at this point some are ...
12
votes
6answers
6k views

SSH automatic remote back ups

I have two machines, A and B. Machine A can ssh into B. A has a lot of free space. B's data is in a sort of risky situation. How do I back up all of B's data to A automatically. It does not have to ...
11
votes
4answers
7k views

What directories do I need to back up?

What are the directories one should back up, in order to have a backup of all user-generated files? From a vanilla debian install, I can do enough apt to get the packages that I want. So if I don't ...
11
votes
1answer
23k views

force rsync to overwrite files at destination even if they're newer

I have an rsync backup script I run, which also restores files back where they came from when I ask. But if the files at the destination are newer than those in the backup when I try to restore, it ...
11
votes
1answer
5k views

Is using rsync while source is being updated safe?

Is it safe to use rsync when the source filesystem is mounted and writeable, assuming that it may very well be modified while rsync is running? I presume that under race conditions I may not get the ...
11
votes
1answer
4k views

How to create a read-only snapshot in LVM, and then rollback to it after some work?

What are the commands to use in LVM in case I want to: create a read-only snapshot of a volume; (do some experiments in the volume); and then rollback the volume to the snapshot?
11
votes
1answer
6k views

ZFS Snapshot to file as Backup with rotation

I have a local FreeNAS system and want to use ZFS snapshots for backups. FreeNAS has the built-in Replication Tasks which use zfs send snapshot_name to send a snapshot to a remote system. But this ...
10
votes
4answers
4k views

How to run a command when a directory's contents are updated?

There is a directory A whose contents are changed frequently by other people. I have made a personal directory B where I keep all the files that have ever been in A. Currently I just occasionally ...
10
votes
5answers
709 views

Is it safe to take the drive image of the current working drive?

I have to backup my hard disk. I want to use dd and put the image on an external hdd. Can I do this using dd from the OS that resides on the hdd itself or do I have to boot from another device, for ...
10
votes
7answers
24k views

System image of running Debian system?

Is it possible to backup a running Debian system to some kind of image file, that could simply be written back to another hard disk using dd in case of failures of the original (backed up) Debian ...
10
votes
2answers
737 views

How to list files and folders that are not maintained by any DEB package

I am in the process of moving my files from one Debian machine to another so that I can use the old machine for a different purpose. I do not want to miss any file because I will be formatting the ...
10
votes
5answers
492 views

What Windows-related files are valueless to *nix users?

I have accumulated, from my time using Windows a good quantity of held-over filesystem copies and archives of system and data drives. I am trying to distill them down to the usable parts while ...
10
votes
1answer
24k views

how to tell rsync to preserve time stamp on files when source tree has a mounted point

Related to this question Short description of the problem: When source tree has a mounted point inside it, then time stamps on files inside that mounted point when copied to target tree are not ...
9
votes
4answers
679 views

filesystem for archiving

I have some complex read-only data in my file system. It contains thousands of snapshots of certain revisions of a svn repository, and the output of regression tests. Identical files between snapshots ...
9
votes
1answer
9k views

Best way to sync files - copy only EXISTING files and only if NEWER than target

I'm doing this sync locally on Ubuntu 12.04. The files are generally small text files (code). I want to copy (preserving mtime stamp) from source directory to target but I only want to copy if the ...
9
votes
3answers
2k views

Entries I can safely exclude doing backups

I'm planning a backup strategy based on rsnapshot. I want to do a full system backup excluding files and directories that would be useless for the restore to have a working system again. I already ...
9
votes
2answers
6k views

How to create a snapshot in btrfs, and then rollback to it after some work?

What are the commands to use in btrfs in case I want to: create a (read-only) snapshot of a volume; (do some experiments in the volume); and then rollback the volume to the snapshot?
8
votes
1answer
231 views

Does rsync delete files on the destination that were deleted from the sending side?

Does rsync delete files from the destination if they were deleted from the source? For example, say in the source /home/me I have three files: a.txt b.txt c.txt Now, I run the command rsync -v ...
8
votes
1answer
386 views

cp says it's removing files, but shouldn't be

Making a quick backup: root@guilmon:/mnt/backup/guilmon/home# cp -uvfrx --preserve=all /home/rena/ . The output is surprising - some files are said to be removed! removed ...
8
votes
3answers
2k views

Run Script once a day with systemd

I want to run a backup script 10 minutes after booting up my machine but only once a day. Is it possible to build up such scenarios with systemd?
8
votes
2answers
280 views

Re-installing apps after a fresh install?

I'm on Debian and I want to re-partition my drive and reinstall. Is there an easy way to restore all currently installed packages after a fresh installation? I'm thinking of doing it by making a ...
8
votes
7answers
5k views

Splitting large directory tree into specified-size chunks?

I have a directory tree that I would like to back up to optical disks. Unfortunately, it exceeds the size of any one disk (it's about 60GB). I am looking for a script that would split this tree into ...
8
votes
2answers
2k views

How to use btrfs send/receive for transmitting backup snapshots over a slow and unreliable network connection?

I'd like to use btrfs' send/receive feature for transmitting backup snapshots over a rather slow (initial seed of about 50-100GB, upstream bandwith ~1-2MBit/s) and unreliable (daily forced ...
8
votes
1answer
4k views

Is NTFS under linux able to save a linux file, with its chown and chmod settings?

I'm having some doubts about how to install and allow linux to correctly read/write to a NTFS formated harddrive used as backup of various machines (windows included, that's how I need NTFS). For now ...
8
votes
2answers
2k views

real time backup if file changed?

Are there any linux/unix console applications similar to Yadis that would allow me to: be set up from the console backup multiple directories backup / sync in real time after the files (text files) ...
8
votes
2answers
1k views

How to create a list of all applications which were manually installed?

I use Fedora and I'd like to have all the package names in a list, but only the ones I installed myself, not the default ones.
8
votes
3answers
8k views

Howto read SMS stored on a SIM card?

I have an old phone with a telephone card (SIM card) inside. The telephone has an infrared interface on the side. I want to read out my contacts and stored SMS messages from the phone, either via ...
8
votes
1answer
776 views

Cleanup of temporary file ~/.cache/duplicity/temp failed

Often when I run Duplicity I see an error message like this at the end of the run: Cleanup of temporary file ...
7
votes
4answers
6k views

`cp -al` snapshot whose hard links get directed to a new file when edited

I am trying to take snapshots of a massive folder regularly. I have read here: http://www.mikerubel.org/computers/rsync_snapshots/#Incremental that cp -al takes a snapshot of a folder by simply ...
7
votes
2answers
6k views

Can I automate tar's multi-volume-feature?

Ok, so I've just had a read through this page after a way to improve my current backup solution on my Debian server. Tar seems to be offering a quite nice multi-volume feature, although when I try it ...
7
votes
2answers
2k views

Should I be backing up my SSH host keys?

In my automated backups, I'm not sure if I should be doing this. If the hard drive fails or if I wipe the hard disk and start over, what will be the effect of starting with a new SSH host key to my ...
7
votes
3answers
13k views

speed up gzip compression

Is it possible to speed up the gzip process? I'm using mysqldump "$database_name" | gzip > $BACKUP_DIR/$database_name.sql.gz to backup a database into a directory, $BACKUP_DIR. the manpage ...
7
votes
5answers
6k views

Backup whole hard disk Linux

I am looking for a method to backup a whole disk in case something is screwed up... I don't even know what to install on some special devices of the server, and every time it is not the same. ...
7
votes
1answer
139 views

How can I put some comment in yum installation list?

Lets say I made a List of installed packages by: rpm -qa > list I want to use this list to re-install those Packages on another System, For Example By: yum -y install $(cat list) But I need ...
7
votes
3answers
7k views

Give user permissions to all files and folders

I want to have a user who has access to all the files and folders on the system. This is for the purpose of using RSYNC on a local machine to backup a remote machine. At the moment we are using the ...
7
votes
2answers
9k views

How to copy qemu raw images?

I want to backup kvm virtual machines and copy machine's images another path or usb disk? How to copy " qemu raw images"?
7
votes
5answers
2k views

force copying a corrupted home directory

I have a home directory in a disk that has a lot of corrupted files. I am trying to save most files as possible. I am trying to create a backup of my home directory on an external drive using tar ...