I need to get a local copy of a website which requires confirming one's age before displaying content. No complex forms, just a checkbox and a button, "yes, I'm adult". I tried to use
wget but with no success, it only downloads this initial screen and nothing more. Httrack failed, too.
I believe the confirmation info is stored in a cookie file, and I think I found out which one it is. So I copied it using the cookie.txt export chromium extension, then saved it to .txt and tried
wget once again with
--load-cookies option, but it still doesn't work.
How do I download website such as this one? Am I misusing
wget or maybe there's a better way to do this?
OK, DownThemAll seems to do the work. Finally, I succeeded with
wget as well, using
wget -mpkrl 0 http://example.com
-rl 0 was what I was missing previously.
After investigating the page source I found that there's no reloading/redirecting involved, subpages are downloaded correctly and the confirmation screen is just an
iframe on top of the page, so I can get rid of it with some simple script.
(In this particular case messing with cookies eventually was not necessary, so I'm not posting this as an answer.)