Tagged Questions
1
vote
1answer
68 views
Method to perform DNS lookup step very quickly during wget
When I download any document from internet using wget. It shows maximum amount of time consumed in getaddrinfo().
I know getaddrinfo() used for DNS lookup.
Tell me any method, so that this time is ...
0
votes
1answer
230 views
Bash While loops
I have a loop set up like the following
#!/bin/bash
cat $1|while read line;do
wget --limit-rate=50k http://url/$line.json -O got-$line;
if [ "$?" -ne "0" ]; then
rm got-$line;
fi
...
3
votes
2answers
190 views
Download from dynamically changing urls via script
I want to write a script to download all Walter Lewin lectures from this page in wmv format: http://videolectures.net/mit801f99_physics_classical_mechanics/
However the links to the wmv file for ...
0
votes
1answer
166 views
What is wget idiom for curl -o?
So I use code in some function like
if [ ! -e $DOWNLOADS/$1 ]; then
echo_run curl -L http://$4/$5/$1 -o $DOWNLOADS/$1
fi
I wonder how to acheive same thing with out curl?
3
votes
2answers
4k views
Set a network range in the no_proxy environment variable
I'm in a network using a proxy. I've got machines using lots of scripts here and there accessing each other over HTTP.
The network is 10.0.0.0/8.
My proxy is 10.1.1.1:81, so I set it up accordingly:
...
0
votes
1answer
353 views
Force wget to download only from HTTPS?
wget https://skype.com -O - > /dev/null
isn't good. I just want to create a short bash script to check that an HTTPS cert is valid or no. i think wget doesn't connects if the cert is invalid. i ...
