I'm a bit of a hoarder and my NAS is kinda the envy of my friends. But sharing my collection is a pain with everyone spread out many KMs across my city and Canada having garbage internet. I've had this idea of making "mini" disposable NAS units for them from random old PCs or rpi's, whatever is handy and dirt cheap. A single 1tb disk TOPS. To this end I've been trying to find a way to download files only once.
--download-archive option in like
wget. I don't really care what the tool is as long as it's "popular" and packaged in most distros. If a transport is mandatory that doesn't bother me much but http or ssh would be preferred. Assuming a download is successful I don't want the file replaced if the dest file (disposable NAS copy) is deleted.
I've been googling for a bit and the closest I've come is using
lftp and then processing the
--log= output before feeding it back into
This seems like a lot of almost manual effort for something that I can't imagine I'm the first person to want. Has anyone ever done this before and can you share what tools you have used?