Back to basics. I have a static web where the links are typically relative.
All works fine in browsers and in Google Crawler, but
wget --spider resolve relative links against the site root.
That is, in a page at
/foo/bar.html, a link
<a href="test.html"> is resolved as
/test.html, instead of
My question is: Did I forget/overlook something basic in how HTML links work, or is
wget --spider resolving the URIs wrong?
The HTML specification says that if there is no
base element, then the current document is the base.
There's this wget issue but it should be fixed in my version.
$ wget --version GNU Wget 1.19.4 built on linux-gnu. -cares +digest -gpgme +https +ipv6 +iri +large-file -metalink +nls +ntlm +opie +psl +ssl/openssl
My command is:
wget --spider --convert-links -r -p --level 1 -E --user-agent=crawlerTest http://www.zizka.ch/