Skip to main content

Questions tagged [duplicity]

Duplicity backs directories by producing encrypted tar-format volumes and uploading them to a remote or local file server.

Filter by
Sorted by
Tagged with
0 votes
1 answer
119 views

Duplicity does not start new chains with full-if-older-than

I want to use duplicity to backup most of my home folder to Backblaze. I'm trying to set it up so that it does a full backup every month. For this I'm using the following commands which are run daily: ...
werenike's user avatar
0 votes
0 answers
104 views

Duplicity encrypting to a strange key?

I'm trying to get duplicity working with gpg keys, but it's behaving a bit strange (on the actual machine that I want backed up, it seems better in virtual machines). Here's a complete set of commands ...
Henrik supports the community's user avatar
0 votes
1 answer
142 views

Does Duplicity incremental backup overwrites amended files?

What I never understood in incremental backup, via duplicity, is whether amended local files are overwritten in the backup storage, i.e., is it possible with incremental backup to restore an old ...
João Pimentel Ferreira's user avatar
1 vote
1 answer
448 views

How and when to use duplicity verify?

I'm making daily incremental backups and monthly full backups, both with duplicity Daily backup script (in /etc/cron.daily/) #!/bin/sh adddate() { while IFS= read -r line; do printf '%s %...
João Pimentel Ferreira's user avatar
0 votes
1 answer
182 views

Duplicity: Exclude files from verification

I use duplicity to backup a set of directories, using a daily cron job. I have another daily cron job to duplicity verify --compare-data the backup, as a sanity check, which runs shortly after the ...
nmatt's user avatar
  • 101
0 votes
1 answer
405 views

using deja dup with rsync server

I used Deja Dup on Ubuntu since years with an remote NFS share. Now I have a new home server, which also runs an rsync daemon. How can I connect deja Dup to this daemon instead of NFS? I found out how ...
PeterK's user avatar
  • 1
0 votes
0 answers
105 views

duplicity: how to prevent malicious user from messing with backups

I'm using duplicity on almost every host I'm maintaining for creating backups to a remote location (calling it "backup host"). How often and when to do full or incremental backups depends on ...
daten's user avatar
  • 23
0 votes
1 answer
53 views

Conversion of files into directories, and the possibility of changing them back

Basically what happened is due to a known bug with duplicity I had to manually extract the difftar archives (Difftarchives?) Imagine my shock and slight horror when I saw that many files that ought to ...
NTibbitts's user avatar
0 votes
1 answer
596 views

excluding relative paths in duplicity

The duplicity documentation doesn't appear to fully document its behaviour when relative paths (or bare filenames) are passed to the --exclude option. If I pass the option --exclude foo, for example, ...
intuited's user avatar
  • 3,538
0 votes
1 answer
245 views

SSH connection to know host still needs authorization

I am trying to setup a backup server using duply and a secure connection. I have created the ~/.ssh/config file with the following content: Host backup IdentityFile ~/.ssh/id_ed25519_backup ...
rudicangiotti's user avatar
2 votes
2 answers
417 views

Duplicity gives InvalidBackendURL error when setting up Backblaze B2

When running Duplicity with Backblaze's B2 as outlined in some articles: duplicity ~ b2://[keyID]:[application key]@[B2 bucket name] Real values hidden, but provided though the Backblaze B2 UI. I ...
Matt Copperwaite's user avatar
2 votes
1 answer
281 views

duplicity resends all the data if filename is renamed

Let's create a test/ directory containing a random 1 GB file: head -c 1G </dev/urandom >test/1GBfile, and let's do a backup with duplicity: duplicity test/ file:///home/www/backup/ Then /home/...
Basj's user avatar
  • 2,549
1 vote
1 answer
639 views

Specify which version of python duplicity should use

I've got a backup script that utilizes duplicity to upload to Dropbox. It's erroring out because the dropbox-python-sdk version required, 6.9.0, uses the keyword async which is now reserved in python3....
JacobTheDev's user avatar
0 votes
0 answers
274 views

Running out of space restoring a file with Duplicity

I'm trying to restore a VDI file for VirtualBox from a Duplicity backup. The VDI file is about 40 GB. I have 189 GB (including ~/.cache/duplicity that is fully synced) of free space when I start the ...
g3blv's user avatar
  • 113
0 votes
1 answer
86 views

duplicity Exclude Globbing ** Asterisk not working as expected

I try to backup all Maildir of all users with duplicity. But for some reason it excludes the largest one. Some background information: /Users/userA/Maildir has >5GB in Maildir /Users/userB/Maildir ...
CptLeChuck70's user avatar
0 votes
1 answer
195 views

duplicity - what does 'full backup' mean?

I'm thinking about using duplicity to have my offsite backup encrypted. Until now, I'm using a script which runs rsync, pretty straightforward. I've done some reading on duplicity, but I can't seem to ...
Beres's user avatar
  • 33
0 votes
1 answer
318 views

"Backups" (deja-dup): after installing duplicity 0.8 from source, "Backups" can't find it

When using "Backups" (a.k.a. deja-dup) - it doesn't find duplicity, although it's installed: I have been trying to backup using "Backups" (a.k.a. deja-dup), and it turns out that the current ...
Helen Craigman's user avatar
1 vote
2 answers
370 views

duplicity suddenly fails with Python tuple error

I have been using duplicity in a cron job for a year now, has worked just fine. Starting from last week I got the following message: Ausdruckbasierte Dateiliste wird gelesen /home/mu/.config/exclude-...
Martin Ueding's user avatar
1 vote
1 answer
4k views

How can I fix this gpg error with Backup (deja-dup, duplicity)?

Every day when I have a scheduled backup running, I see this error: Error processing remote manifest (duplicity-inc.20190724T191929Z.to.20190726T191408Z.manifest.gpg): GPG Failed, see log below: ====...
Jonathan's user avatar
  • 1,290
2 votes
0 answers
326 views

backup privileged data on remote servers without root ssh

I'm sufficiently new to Linux that I don't understand how to do what I think I want. If you think you know what I actually want, please tell me. I would like to use Duplicity to backup privileged ...
Brian's user avatar
  • 292
1 vote
0 answers
521 views

Secure use of a passphrase in environment variable

I'm trying to understand environment variables and the security implications from the command line and from a script or cron job. Duplicity expects (and requires for automation) that there be a ...
Brian's user avatar
  • 292
0 votes
1 answer
1k views

server backup rsync pull or push or Duplicity

I saw this: Big rsync -- push or pull? and this: Rsync backup script for multiple servers and finally this: https://serverfault.com/questions/543039/backup-a-remote-directory-with-duplicity I ...
Brian's user avatar
  • 292
1 vote
0 answers
537 views

Duplicity full volume restore, missing some files and services

I'm using duplicity on Ubuntu Xenial for creating and encrypting backups and storing them on an S3 bucket (Scaleway). This is the backup script I'm using: #!/bin/bash source ./.scw-configrc HOST=`...
n3onis's user avatar
  • 43
1 vote
0 answers
681 views

What does it mean when Duplicity exits with exit status 23?

I'm running Duplicity for backup of my desktop to a remote storage. Everything has been working fine, but now I see in my log that Duplicity has been exiting with exit status 23 for a couple of runs. ...
PetaspeedBeaver's user avatar
0 votes
1 answer
408 views

Duplicity 'No Such file or Directory'

I am trying to run duplicity to backup our dataserver to an external server over sftp. My command is as follows: duplicity --no-encryption /home/dataserver sftp://user@host --ssh-askpass When i run ...
Jooshalicious's user avatar
1 vote
1 answer
167 views

Anacron: Run daily scripts except when monthly script runs

I'm trying to setup some backup strategy using anacron and I'm running into a small issue. I'm using duplicity as a backup utility, which has 2 types of backups: full and incremental. I want a ...
Scaum's user avatar
  • 111
0 votes
1 answer
566 views

Duplicity: Restarting backup, but current encryption settings do not match original settings

I use duplicity to create a backup on my files to Backblaze B2. This has worked rather well until a few days ago. I had erased my local Python libraries but reinstalled. Also I extracted the ...
Martin Ueding's user avatar
1 vote
2 answers
450 views

Does Duplicity modify atime when backing up?

My data resides on a SSD and — thanks to re-writes and Write Amplification — any modification of an atime will result in not only the inode being modified, but the whole block that it resides on being ...
Tim's user avatar
  • 742
1 vote
1 answer
2k views

Backing up to a local SSD taking a lot longer than expected

On a fresh Ubuntu 18.04 system I decided to give Deja-Dup a go. It's just a GUI for Duplicity (which uses rsync). About 850GB of data needed to be backed up. Source SSD was NVMe. Destination SSD ...
Tim's user avatar
  • 742
1 vote
1 answer
2k views

Duplicity - save backup to multiple destinations

Is it possible to configure duplicity to save the generated backup to multiple destinations without doing the whole backup process twice? Something like duplicty --full --volsize 1024 -v5 sftp://user@...
koseduhemak's user avatar
2 votes
1 answer
1k views

Resume interrupted duplicity backup without reading directory from scratch

I'm performing a full backup of a directory with duplicity 0.7.17. Slow I/O is the bottleneck (less than 20 MiB/s read) and the directory is large (~5 TiB). The full backup was interrupted before it ...
Nemo's user avatar
  • 584
1 vote
1 answer
638 views

Duplicity Error 5 & 22 in /proc/

I've been having some problems with duplicity to backup my root folder to an external drive. The code using is: sudo duplicity full -v4 --no-encryption --exclude /mnt/ / file:///run/media/jjonker/...
Jasper's user avatar
  • 11
2 votes
1 answer
4k views

How to verify a deja-dup backup using duplicity

This evening, I had to hard shut down my computer after some kind of kernel panic. When I rebooted, I noticed my ~/.ssh/id_rsa had been replaced with an empty file. Rebooting to a USB and running ...
Sompom's user avatar
  • 186
3 votes
1 answer
1k views

duplicity exclude directories while restoring

How can I restore some files from my duplicity backup excluding some directories/files ? Does --include --exclude work along with restore ?
Vikas Tiwari's user avatar
1 vote
2 answers
1k views

Backup only hidden (dot) files with duplicity

I would like to backup config files (hidden, starting with a dot) with duplicity. Only files, no directories. The following command duplicity --include '/home/foo/.*' --exclude '/home/foo/**' /home/...
katonag's user avatar
  • 13
1 vote
1 answer
2k views

Unable to exclude .cache from duplicity backup

I wish to backup with duplicity (I use it often, usually without issues) /etc and /root. I wish to exclude .cache from the /root directory. I try: duplicity incremental --full-if-older-than 30W --...
Tilia's user avatar
  • 290
4 votes
1 answer
573 views

duply fails on all command with, assert filecount == len(self.files_changed) AssertionError

No matter which command I try on this duply profile it always errors out. duply database status duply database bkp duply database purge They all return a trace similar to the following Start duply ...
nelaaro's user avatar
  • 1,331
4 votes
1 answer
93 views

What does the A, D and Ms mean when running Duplicity with high verbosity?

When I run duplicity with the -v8 switch I get the following output: M home/user/Documents/test.txt D home/user/VirtualBox VMs/win10/Logs/VBox.log.2 A home/user/.config/VirtualBox/example.log What ...
PetaspeedBeaver's user avatar
0 votes
1 answer
451 views

Why is duply unable to restore a backup due to signing error?

I manage my backups with duply. Today I wanted to fetch some backuped files from an old machine that got lost on my current machine. Unfortunately I got the error that the storage was signed with ...
Cutú Chiqueño's user avatar
1 vote
0 answers
203 views

duplicity include-list excludes wrong files

I have a duplicity --include-list, which looks like this: + /data/something + /data/**/somethingselse - /data - /foo which matches other files (less files) than the include-list + /data/something + ...
allo's user avatar
  • 944
2 votes
1 answer
1k views

duplicity with ssh tunneling

I'm relatively new to posting here, so please pardon infelicities. I'm trying to set up a duplicity backup through a 2-step ssh tunnel that I set up in config with one alias - call that alias "...
Steve Petersen's user avatar
2 votes
1 answer
2k views

How can I keep permissions on original files when restoring backups with Duplicity?

When restoring files backed up by Duplicity, is there a way to keep the original permissions on the files extracted? I need to run the restore as root, and it seems that makes all the files restored ...
PetaspeedBeaver's user avatar
1 vote
1 answer
862 views

Backup to Amazon Cloud drive

Amazon Cloud Drive (acd) offers "unlimited" storage for a very affordable price. I wonder, if there are any backup solutions under linux that are usable with it. I am aware of acd_cli. With this it ...
henfri's user avatar
  • 11
3 votes
1 answer
1k views

Duplicity: switch to "secondary backup chain"

I ran duplicity when my backup drive wasn't connected, and it deleted lots of cached sigtar and manifest files: Synchronizing remote metadata to local cache... Deleting local /Users/justin/.cache/...
ConvexMartian's user avatar
0 votes
1 answer
632 views

Configure Duplicity to use pinentry?

Duplicity by default asks for passwords to GnuPG keys on start up and caches them in memory throughout process lifetime. Is there a way to have it use /usr/bin/pinentry instead so I know I'm not ...
Naftuli Kay's user avatar
  • 40.2k
4 votes
2 answers
2k views

Duplicity backup via sftp finishes without errors but no files transferred to remote host, why?

I want to use the following command to do a remote backup of /home: duplicity full /home sftp://[email protected]/home/user/backup When the command is run I get the following output: Local and ...
PetaspeedBeaver's user avatar
5 votes
1 answer
3k views

Duplicity + Amazon S3 Glacier. How Much "Unfreezing" to Resume Backup

It's been a couple of months since I last did a Duplicity backup [to Amazon S3] and, in the meantime thanks to an automatic 30-day rule I have on my Amazon buckets, my S3 backup has been moved from ...
stíobhart's user avatar
1 vote
1 answer
250 views

Compound Docker Entrypoint?

I need to backup a docker volume to a specific directory within another docker volume using Duplicity. So I need to run a command like this within the container performing the backup: mkdir -p /...
Ole's user avatar
  • 727
1 vote
1 answer
1k views

Exporting a Shell Variable From the Command Line

I'm playing around with duplicity via a script that looks like this: export PASSPHRASE=SomeLongGeneratedHardToCrackKey duplicity /etc scp://[email protected]/etc unset PASSPHRASE Here's a ...
Ole's user avatar
  • 727
3 votes
1 answer
1k views

How to reset a corrupted backuped file with Duplicity?

When a Duplicity incremental backup is interrupted, some backup files may be corrupted, and cannot be recovered later on (even if new incremental backups are done after the interrupted one). Those ...
Martin Monperrus's user avatar