Tag Info

New answers tagged

1

First you should copy your current working directory to a test directory for dry-run and try this below. You should then run: this should convert file to an html response from an asp page (getting webserver response with -O command and put the page to a filename.html file after fetching) sudo wget -O filename.html ...


1

Even though the files are named .asp they're actually HTML files. Look at their content to confirm this, but the use of the extension .asp is because that's the technology that was used to implement that particular site. That's the name that the browser uses when it downloads the files, and hence the name that's used when the files are written to disk, but ...


0

No. The file extensions you mentioned are script files. These are files that are executed like programs. They are executed when you click on them on a webpage to cause the effect that you get when you're browsing the site.


-2

This may be an short answer and hopefully it'll help. I would wget the .asp file and then rename it to an file with a .html extension. This will take the .asp html output and open the file as .html in a browser.


5

I would use an appropriate tool such as httrack and not waste my time in trying to coax this out of a tool such as wget or curl. Here's how you can download the URL that you're asking about, I did it myself and it even works just fine in Chrome! $ httrack http://www.w3schools.com/sql/default.asp Mirror launched on Sat, 13 Sep 2014 22:50:32 by HTTrack ...


0

Try to : wget -r http://www.w3schools.com/sql Yes i got result I have the following dirs and files: mohsen@debian:~/offline docs/www.w3schools.com$ ls about angular aspnet bootstrap css default.asp favicon.ico forum html index.html jquery js php robots.txt sitemap sql stdtheme.css xml


2

POSIXly: tr -cs '[:alnum:]_' '[\n*]' | grep -xiF 'cart shop buy order store shipping products price' | sort -fu | wc -l You can also have the list of words in a file and use: tr -cs '[:alnum:]_' '[\n*]' | grep -xiFf word.list | sort -fu | wc -l You can possibly make it more efficient by doing: tr -cs '[:alnum:]_' '[\n*]' | awk ' {$0=tolower($0)} ...


0

The answer of Volker Siegel, is very useful. However if you want the output to be a number between 0 and 8 you should add a grep to count the lines. $ wget -O - -q ix.de | grep -Eoi '(cart|shop|buy|order|store|shipping|products|price)' | sort -i | uniq -i | grep -c '' 2 Note that now the flag -c of uniq is not necessary.


4

With GNU grep: wget -O - -q http_url_goes_here | grep -wEoi 'cart|shop|buy|order|store|shipping|products|price' | sort -fu | wc -l I added the -w to your grep command so that you don't count, for example, bishop as a hit for shop.


0

In my case, it worked by chaining two wgets: $ wget -O - -o /dev/null http://site.to.get.urls.from | grep -o 'some_regex' | wget -i - The first wget will produce a list of URLs with files, which is used as input "file" for the second wget. Note that this is a simplified version to show you the technique behind it. The pipe between the grep and the second ...


0

2 years later I will throw this tidbit in, while wget and curl are not interactive, at least wget (and possibly curl but i do not know for sure) has the -c switch. So if you need to change your speed in the middle of a download and you presumably used the -c switch with the --limit-rate=x (which stands for continue from where I left off downloading earlier, ...


0

Please make sure that file should be in .html format containing URL please refer wget man page . -i file --input-file=file Read URLs from file, in which case no URLs need to be on the command line. If there are URLs both on the command line and in an input file, those on the command lines will be the first ones to be retrieved. The file need not be an HTML ...


1

It seems to be caused by a bug in wget that makes it fail on long URLs, or on writing to file names it had derived from long ursl. See wget starts downloading then stops “cannot write to” This but looks related, for example: bug #21714: File name too long The problem may be solved already in the current version of wget - let us know the version you use ...


1

You should give your URLs with http:// Your url.txt should have http://www.google.com http://www.yahoo.com If you don't have the protocol included you'll get messages stating the following: $ wget --content-disposition -i url.txt url.txt: Invalid URL www.google.com: Scheme missing url.txt: Invalid URL www.yahoo.com: Scheme missing


0

You can use the curl command to download curl -O https://github.com/downloads/SpiderLabs/ModSecurity/modsecurity-apache_2.7.1.tar.gz


25

Usually, we see that when we have stopped a download and the continued/resumed with it again. That way, we are downloading only portion which has not been downloaded already. This happens when you use the -c switch. For example $ wget https://help.ubuntu.com/10.04/serverguide/serverguide.pdf 53% [=======================> ] 531,834 ...



Top 50 recent answers are included