1

The following web page on the Wayback Machine (archive.org) has an asterick * in its URL: https://web.archive.org/web/*/https://www.nasa.gov/

Neither CURL nor wget will allow me to grab the page. I am using the latest version of Linux Mint (2018).

How do I use wget or CURL in php to grab a snapshot of a web page with an asterick * in its URL, specifically https://web.archive.org/web/*/https://www.nasa.gov/?

Thanks! Might httrack work?

EDIT: Open the site web.archive.org/web/%2A/https://www.nasa.gov in a browser. Then compare it with what you see with the wget command. Are they the same? For me the wget command just returns a generic page.

4
  • Works for me. What are you trying to run, and what happens when you do? You can edit your question.
    – Michael Homer
    Feb 5, 2018 at 21:12
  • @MichaelHomer Open the site web.archive.org/web/%2A/nasa.gov in a browser. Then compare it with what you see with the wget command you used above. Are they the same? For me the wget just returns a generic page.
    – gamedesigner
    Feb 5, 2018 at 21:26
  • I don't think that's the asterisk's doing, just that they don't want you crawling it.
    – Michael Homer
    Feb 5, 2018 at 21:28
  • @MichaelHomer I don't want to crawl it. I just want a single snapshot of that page.
    – gamedesigner
    Feb 5, 2018 at 21:33

1 Answer 1

Reset to default
1

It seems to work fine for me, as long as the URL is enclosed in quotation marks.

If you want to avoid the message "Warning: wildcards not supported in HTTP", the easiest thing to do is to replace the asterisk with its percent-encoded equivalent:

wget "https://web.archive.org/web/%2A/https://www.nasa.gov"
1

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .