I need to create a mirror of a directory shared over HTTP. Source server uses apache index module. Here is an example of a similar directory: http://apache.mirrors.pair.com/httpd/
The content is not available over FTP.
I can use wget to download the mirror recursively. The side effect is that in this case there are index.html?....
files created.
I wonder if there is an utility which can do this easily, without need to cleanup destination directory manually?
lftp
has amirror
command, and I have used to it mirror the Arch Linux repos. But you should see if there's some custom solution, likeapt-mirror
, before turning to options likelftp
.