I'm trying to upload some big files (around 10GB) with a slow upload speed (200kb/s) on a often disconnected SSH connection (due to poor network conditions).
I'm trying to use scp
, but if there is a best way over SSH, I'm ok with it.
What is the best way to do it ?
I've tried to split it up in several parts using split
, but it's not really efficient as it require a lot of manual work before and after it is transfered.
rsync
is better. It is restartable - meaning you can continue where you left off if your connection disconnects. You'll probably want to use the--partial
flag. And by default it runs over ssh. You could combine with an aggressive compression program like 7z, but you'll need plenty of memory, and it will still take a while.rsync -abvz --partial
. Can you show an example session?scp
. It's possible to resume an upload withrsync --partial
. It's not possible to resume an upload withsftp
. For the other direction, i.e. resuming downloads, you can usersync --partial
,sftp reget
orsftp get -a
.