Tag Info

New answers tagged

1

With GNU Parallel this ought to work: parallel --halt 1 wget ::: 'http://www.iqandreas.com/sample-images/100-100-color/'{90..110}'.jpg'


1

If I'am not mistake you mean this repo. Try to get URL form Releases. This case work for me: $ wget https://github.com/SpiderLabs/ModSecurity/archive/v2.8.0.tar.gz P.S.: I also have the same error message when try to run your case; $ wget https://github.com/downloads/SpiderLabs/ModSecurity/modsecurity-apache_2.7.1.tar.gz


1

Another way that might possibly work is by using this command: wget -O nameOfTar.tar "http://www.ncbi.nlm.nih.gov/geo/download/?acc=GSE48191&format=file" The -O command will specify the name to download to. Of course, your initial problem is because the "&" was being interpreted by the shell, surrounding the URL with double quotes fixes the issue. ...


8

I think your ? gets interpreted by shell (Correction by vinc17: more likely, it's the & which gets interpreted). Just try with simple quotes around your URL: wget 'http://www.ncbi.nlm.nih.gov/geo/download/?acc=GSE48191&format=file' Note that the file you are requesting is a .tar file but the above command will save it as ...


5

You could use the $? variable to get the return code of wget. If it's non-zero then it means an error occured and you tally it up until it reached a threshold, then it could break out of the loop. Something like this off the top of my head #!/bin/bash threshold=0 for x in {90..110}; do wget ...


4

If you're happy with a loop: for url in 'http://www.iqandreas.com/sample-images/100-100-color/'{90..110}'.jpg' do wget "$url" || break done That will run wget for each URL in your expansion until it fails, and then break out of the loop. If you want two failures in a row it gets a bit more complicated: for url in ...


0

-A "Sample" kind of acts like a Sample* would in bash Not by my reading of man wget: -A acclist --accept acclist -R rejlist --reject rejlist Specify comma-separated lists of file name suffixes or patterns to accept or reject. Note that if any of the wildcard characters, *, ?, [ or ], appear in an element of acclist or ...


0

What happens when you connect to the page with your browser? If you browse the pages without any problem, then there might be a couple of things you're missing. The page might be checking your browser, and Mozilla is not the correct answer, pick one of the browser strings from here (the whole string, not just Mozilla) and try to see if it works. If it ...


5

Use the --trust-server-names option: --trust-server-names: If this is set to on, on a redirect the last component of the redirection URL will be used as the local file name. By default it is used the last component in the original URL. Note that in some cases this can be a security risk: you have no way of knowing what the created filename will be ...


0

Have your tried the following $ wget -i downloadaddreslist.txt where downloadaddresslist.txt is the file of the addresses?


0

curl "http://www.google.com/" >> /Users/name/desktop/temp.txt


2

Example using wget (for downloading), bfr (for buffering), and growisofs for burning: wget -q -O - http://somewhere/image.iso \ | bfr -b 512m -p -i 100% -m 10% -t 120 -T 95% \ | growisofs -dvd-compat -Z /dev/cdrom=/dev/fd/0 The buffering part is optional, but without it you will have to rely on your drive to cope with buffer underruns. That doesn't work ...


3

Just want to add to the above answers that you could use the "Copy as cURL" feature present in Chrome developer tools (since v26.0) and Firebug (since v1.12). You can access this feature right-clicking the request row in the Network tab.


4

Depending on what you're asking for, it could be a cookie. With Firefox, you can do a right-click when you're on the page in question, "View Page Info". Choose "Security" icon, and then click "View Cookies" button. For puzzling out cookies, the Firefox "Live HTTP Headers" plug-in is essential. You can see what cookies get set, and what cookies get sent ...


18

A HTTP request may contain more headers that are not set by curl or wget. For example: Cookie: this is the most likely reason why a request would be rejected, I have seen this happen on download sites. Given a cookie key=val, you can set it with the -b key=val (or --cookie key=val) option for curl. Referer (sic): when clicking a link on a web page, most ...



Top 50 recent answers are included