I have a list of 900 URLs. Each page contains one image. Some images are duplicates (with same URL). I want to download 900 images, including duplicates.
I was able to download all pages and the embedded images (and ignored all other file types) with wget. But it seems to me that wget "ignores" an image when it was already downloaded before. So I had 900 pages, but only around 850 images.
(How) can I tell wget to download duplicates, too? It could append
_2, … at the file name.
My wget command:
wget --input-file=urls.txt --output-file=log.txt --wait 1 --random-wait --page-requisites --exclude-domains code.jquery.com --span-hosts --reject thumbnail*.png -P downloadfolder