Questions tagged [duplicity]
Duplicity backs directories by producing encrypted tar-format volumes and uploading them to a remote or local file server.
71
questions
0
votes
0
answers
40
views
Duplicity encrypting to a strange key?
I'm trying to get duplicity working with gpg keys, but it's behaving a bit strange (on the actual machine that I want backed up, it seems better in virtual machines). Here's a complete set of commands ...
0
votes
1
answer
55
views
Does Duplicity incremental backup overwrites amended files?
What I never understood in incremental backup, via duplicity, is whether amended local files are overwritten in the backup storage, i.e., is it possible with incremental backup to restore an old ...
1
vote
1
answer
177
views
How and when to use duplicity verify?
I'm making daily incremental backups and monthly full backups, both with duplicity
Daily backup script (in /etc/cron.daily/)
#!/bin/sh
adddate() {
while IFS= read -r line; do
printf '%s %...
0
votes
1
answer
153
views
Duplicity: Exclude files from verification
I use duplicity to backup a set of directories, using a daily cron job. I have another daily cron job to duplicity verify --compare-data the backup, as a sanity check, which runs shortly after the ...
- 101
0
votes
1
answer
283
views
using deja dup with rsync server
I used Deja Dup on Ubuntu since years with an remote NFS share. Now I have a new home server, which also runs an rsync daemon. How can I connect deja Dup to this daemon instead of NFS?
I found out how ...
- 1
0
votes
0
answers
83
views
duplicity: how to prevent malicious user from messing with backups
I'm using duplicity on almost every host I'm maintaining for creating backups to a remote location (calling it "backup host").
How often and when to do full or incremental backups depends on ...
- 23
0
votes
1
answer
50
views
Conversion of files into directories, and the possibility of changing them back
Basically what happened is due to a known bug with duplicity I had to manually extract the difftar archives (Difftarchives?) Imagine my shock and slight horror when I saw that many files that ought to ...
0
votes
1
answer
447
views
excluding relative paths in duplicity
The duplicity documentation doesn't appear to fully document its behaviour when relative paths (or bare filenames) are passed to the --exclude option. If I pass the option --exclude foo, for example, ...
- 3,498
0
votes
1
answer
185
views
SSH connection to know host still needs authorization
I am trying to setup a backup server using duply and a secure connection.
I have created the ~/.ssh/config file with the following content:
Host backup
IdentityFile ~/.ssh/id_ed25519_backup
...
- 123
2
votes
2
answers
347
views
Duplicity gives InvalidBackendURL error when setting up Backblaze B2
When running Duplicity with Backblaze's B2 as outlined in some articles:
duplicity ~ b2://[keyID]:[application key]@[B2 bucket name]
Real values hidden, but provided though the Backblaze B2 UI.
I ...
- 571
1
vote
1
answer
235
views
duplicity resends all the data if filename is renamed
Let's create a test/ directory containing a random 1 GB file: head -c 1G </dev/urandom >test/1GBfile,
and let's do a backup with duplicity:
duplicity test/ file:///home/www/backup/
Then /home/...
- 2,351
1
vote
1
answer
602
views
Specify which version of python duplicity should use
I've got a backup script that utilizes duplicity to upload to Dropbox. It's erroring out because the dropbox-python-sdk version required, 6.9.0, uses the keyword async which is now reserved in python3....
- 151
0
votes
0
answers
217
views
Running out of space restoring a file with Duplicity
I'm trying to restore a VDI file for VirtualBox from a Duplicity backup. The VDI file is about 40 GB. I have 189 GB (including ~/.cache/duplicity that is fully synced) of free space when I start the ...
- 113
0
votes
1
answer
75
views
duplicity Exclude Globbing ** Asterisk not working as expected
I try to backup all Maildir of all users with duplicity. But for some reason it excludes the largest one. Some background information:
/Users/userA/Maildir has >5GB in Maildir
/Users/userB/Maildir ...
0
votes
1
answer
103
views
duplicity - what does 'full backup' mean?
I'm thinking about using duplicity to have my offsite backup encrypted. Until now, I'm using a script which runs rsync, pretty straightforward. I've done some reading on duplicity, but I can't seem to ...
- 33
0
votes
1
answer
266
views
"Backups" (deja-dup): after installing duplicity 0.8 from source, "Backups" can't find it
When using "Backups" (a.k.a. deja-dup) - it doesn't find duplicity, although it's installed:
I have been trying to backup using "Backups" (a.k.a. deja-dup), and it turns out that the current ...
- 133
1
vote
2
answers
357
views
duplicity suddenly fails with Python tuple error
I have been using duplicity in a cron job for a year now, has worked just fine. Starting from last week I got the following message:
Ausdruckbasierte Dateiliste wird gelesen /home/mu/.config/exclude-...
- 2,692
1
vote
1
answer
4k
views
How can I fix this gpg error with Backup (deja-dup, duplicity)?
Every day when I have a scheduled backup running, I see this error:
Error processing remote manifest (duplicity-inc.20190724T191929Z.to.20190726T191408Z.manifest.gpg): GPG Failed, see log below:
====...
- 1,220
2
votes
0
answers
314
views
backup privileged data on remote servers without root ssh
I'm sufficiently new to Linux that I don't understand how to do what I think I want. If you think you know what I actually want, please tell me.
I would like to use Duplicity to backup privileged ...
- 292
1
vote
0
answers
457
views
Secure use of a passphrase in environment variable
I'm trying to understand environment variables and the security implications from the command line and from a script or cron job. Duplicity expects (and requires for automation) that there be a ...
- 292
0
votes
1
answer
1k
views
server backup rsync pull or push or Duplicity
I saw this:
Big rsync -- push or pull?
and this:
Rsync backup script for multiple servers
and finally this:
https://serverfault.com/questions/543039/backup-a-remote-directory-with-duplicity
I ...
- 292
1
vote
0
answers
506
views
Duplicity full volume restore, missing some files and services
I'm using duplicity on Ubuntu Xenial for creating and encrypting backups and storing them on an S3 bucket (Scaleway).
This is the backup script I'm using:
#!/bin/bash
source ./.scw-configrc
HOST=`...
- 43
1
vote
0
answers
604
views
What does it mean when Duplicity exits with exit status 23?
I'm running Duplicity for backup of my desktop to a remote storage. Everything has been working fine, but now I see in my log that Duplicity has been exiting with exit status 23 for a couple of runs. ...
- 1,227
0
votes
1
answer
378
views
Duplicity 'No Such file or Directory'
I am trying to run duplicity to backup our dataserver to an external server over sftp.
My command is as follows:
duplicity --no-encryption /home/dataserver sftp://user@host --ssh-askpass
When i run ...
1
vote
1
answer
157
views
Anacron: Run daily scripts except when monthly script runs
I'm trying to setup some backup strategy using anacron and I'm running into a small issue.
I'm using duplicity as a backup utility, which has 2 types of backups: full and incremental. I want a ...
- 111
0
votes
1
answer
534
views
Duplicity: Restarting backup, but current encryption settings do not match original settings
I use duplicity to create a backup on my files to Backblaze B2. This has worked rather well until a few days ago. I had erased my local Python libraries but reinstalled. Also I extracted the ...
- 2,692
1
vote
2
answers
417
views
Does Duplicity modify atime when backing up?
My data resides on a SSD and — thanks to re-writes and Write Amplification — any modification of an atime will result in not only the inode being modified, but the whole block that it resides on being ...
- 722
1
vote
1
answer
2k
views
Backing up to a local SSD taking a lot longer than expected
On a fresh Ubuntu 18.04 system I decided to give Deja-Dup a go. It's just a GUI for Duplicity (which uses rsync). About 850GB of data needed to be backed up. Source SSD was NVMe. Destination SSD ...
- 722
1
vote
1
answer
1k
views
Duplicity - save backup to multiple destinations
Is it possible to configure duplicity to save the generated backup to multiple destinations without doing the whole backup process twice?
Something like duplicty --full --volsize 1024 -v5 sftp://user@...
- 113
2
votes
1
answer
931
views
Resume interrupted duplicity backup without reading directory from scratch
I'm performing a full backup of a directory with duplicity 0.7.17. Slow I/O is the bottleneck (less than 20 MiB/s read) and the directory is large (~5 TiB).
The full backup was interrupted before it ...
- 522
1
vote
1
answer
585
views
Duplicity Error 5 & 22 in /proc/
I've been having some problems with duplicity to backup my root folder to an external drive. The code using is:
sudo duplicity full -v4 --no-encryption --exclude /mnt/ / file:///run/media/jjonker/...
- 11
3
votes
1
answer
3k
views
How to verify a deja-dup backup using duplicity
This evening, I had to hard shut down my computer after some kind of kernel panic.
When I rebooted, I noticed my ~/.ssh/id_rsa had been replaced with an empty file.
Rebooting to a USB and running ...
- 206
3
votes
1
answer
999
views
duplicity exclude directories while restoring
How can I restore some files from my duplicity backup excluding some directories/files ?
Does --include --exclude work along with restore ?
- 131
1
vote
2
answers
1k
views
Backup only hidden (dot) files with duplicity
I would like to backup config files (hidden, starting with a dot) with duplicity. Only files, no directories. The following command
duplicity --include '/home/foo/.*' --exclude '/home/foo/**' /home/...
- 13
1
vote
1
answer
2k
views
Unable to exclude .cache from duplicity backup
I wish to backup with duplicity (I use it often, usually without issues) /etc and /root. I wish to exclude .cache from the /root directory. I try:
duplicity incremental --full-if-older-than 30W --...
- 280
4
votes
1
answer
545
views
duply fails on all command with, assert filecount == len(self.files_changed) AssertionError
No matter which command I try on this duply profile it always errors out.
duply database status
duply database bkp
duply database purge
They all return a trace similar to the following
Start duply ...
- 1,333
4
votes
1
answer
87
views
What does the A, D and Ms mean when running Duplicity with high verbosity?
When I run duplicity with the -v8 switch I get the following output:
M home/user/Documents/test.txt
D home/user/VirtualBox VMs/win10/Logs/VBox.log.2
A home/user/.config/VirtualBox/example.log
What ...
- 1,227
0
votes
1
answer
437
views
Why is duply unable to restore a backup due to signing error?
I manage my backups with duply. Today I wanted to fetch some backuped files from an old machine that got lost on my current machine. Unfortunately I got the error that the storage was signed with ...
- 581
1
vote
0
answers
199
views
duplicity include-list excludes wrong files
I have a duplicity --include-list, which looks like this:
+ /data/something
+ /data/**/somethingselse
- /data
- /foo
which matches other files (less files) than the include-list
+ /data/something
+ ...
- 916
2
votes
1
answer
1k
views
duplicity with ssh tunneling
I'm relatively new to posting here, so please pardon infelicities.
I'm trying to set up a duplicity backup through a 2-step ssh tunnel that I set up in config with one alias - call that alias "...
2
votes
1
answer
2k
views
How can I keep permissions on original files when restoring backups with Duplicity?
When restoring files backed up by Duplicity, is there a way to keep the original permissions on the files extracted? I need to run the restore as root, and it seems that makes all the files restored ...
- 1,227
1
vote
1
answer
854
views
Backup to Amazon Cloud drive
Amazon Cloud Drive (acd) offers "unlimited" storage for a very affordable price.
I wonder, if there are any backup solutions under linux that are usable with it.
I am aware of acd_cli. With this it ...
- 11
3
votes
1
answer
1k
views
Duplicity: switch to "secondary backup chain"
I ran duplicity when my backup drive wasn't connected, and it deleted lots of cached sigtar and manifest files:
Synchronizing remote metadata to local cache...
Deleting local /Users/justin/.cache/...
- 163
0
votes
1
answer
611
views
Configure Duplicity to use pinentry?
Duplicity by default asks for passwords to GnuPG keys on start up and caches them in memory throughout process lifetime. Is there a way to have it use /usr/bin/pinentry instead so I know I'm not ...
- 38.7k
4
votes
2
answers
2k
views
Duplicity backup via sftp finishes without errors but no files transferred to remote host, why?
I want to use the following command to do a remote backup of /home:
duplicity full /home sftp://[email protected]/home/user/backup
When the command is run I get the following output:
Local and ...
- 1,227
5
votes
1
answer
3k
views
Duplicity + Amazon S3 Glacier. How Much "Unfreezing" to Resume Backup
It's been a couple of months since I last did a Duplicity backup [to Amazon S3] and, in the meantime thanks to an automatic 30-day rule I have on my Amazon buckets, my S3 backup has been moved from ...
- 51
1
vote
1
answer
245
views
Compound Docker Entrypoint?
I need to backup a docker volume to a specific directory within another docker volume using Duplicity. So I need to run a command like this within the container performing the backup:
mkdir -p /...
- 687
1
vote
1
answer
1k
views
Exporting a Shell Variable From the Command Line
I'm playing around with duplicity via a script that looks like this:
export PASSPHRASE=SomeLongGeneratedHardToCrackKey
duplicity /etc scp://FtpUserID@ftp.domain.com/etc
unset PASSPHRASE
Here's a ...
- 687
3
votes
1
answer
1k
views
How to reset a corrupted backuped file with Duplicity?
When a Duplicity incremental backup is interrupted, some backup files may be corrupted, and cannot be recovered later on (even if new incremental backups are done after the interrupted one).
Those ...
- 1,221
2
votes
1
answer
20k
views
SSH Protocol mismatch
I have a very strange problem. I have two servers, namely daytona, which serves as a storage server with a raid array. I WOL it when I want to back up to it. The second server is testarossa which runs ...
