1

The following web page on the Wayback Machine (archive.org) has an asterick * in its URL: https://web.archive.org/web/*/https://www.nasa.gov/

Neither CURL nor wget will allow me to grab the page. I am using the latest version of Linux Mint (2018).

How do I use wget or CURL in php to grab a snapshot of a web page with an asterick * in its URL, specifically https://web.archive.org/web/*/https://www.nasa.gov/?

Thanks! Might httrack work?

EDIT: Open the site web.archive.org/web/%2A/https://www.nasa.gov in a browser. Then compare it with what you see with the wget command. Are they the same? For me the wget command just returns a generic page.

  • Works for me. What are you trying to run, and what happens when you do? You can edit your question. – Michael Homer Feb 5 '18 at 21:12
  • @MichaelHomer Open the site web.archive.org/web/%2A/nasa.gov in a browser. Then compare it with what you see with the wget command you used above. Are they the same? For me the wget just returns a generic page. – gamedesigner Feb 5 '18 at 21:26
  • I don't think that's the asterisk's doing, just that they don't want you crawling it. – Michael Homer Feb 5 '18 at 21:28
  • @MichaelHomer I don't want to crawl it. I just want a single snapshot of that page. – gamedesigner Feb 5 '18 at 21:33
1

It seems to work fine for me, as long as the URL is enclosed in quotation marks.

If you want to avoid the message "Warning: wildcards not supported in HTTP", the easiest thing to do is to replace the asterisk with its percent-encoded equivalent:

wget "https://web.archive.org/web/%2A/https://www.nasa.gov"

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.