New answers tagged

1

wget -r -nd -A jpg --accept-regex "https://alwaysSamePart.com/.*.jpg" https://whatever_domain.com -r allows to go recursively through website (you can specify -l to limit depth) -nd prevents directories creation -A limits download files to jpg images only --accept-regex limits images to needed pattern only


0

did you try -A or equivalent --accept options as given below ? wget "https://alwaysSamePart.com/" -A "*.jpg"


0

error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac Since it works for me (albeit very slow) and since it worked for others there is probably a problem with your connection only. There might be some broken middlebox (i.e. router, firewall...) in between which corrupts packets.


0

As for workaround, if you trust the host try specifying --no-check-certificate or add: check_certificate = off into your ~/.wgetrc (not recommended). In some rare cases, it's caused by your system time which could be out-of-sync therefore invalidating the certificates which was working before.


2

wget (at least 1.16.3) does not allow a user to specify custom attributes. There has been a suggestion to extend the the --follow-tags option with a syntax like --follow-tags=a/href, but nobody followed up on that. If you do not mind applying a quick hack to wget to support your scenario, see this commit for the work needed to add custom tags or attributes. ...


1

just to add another tool. I prefer w3m, which is a lynx like console browser. You may want to check out whats already available on your system. w3m -dump website.html


0

This script will get 1000 quotes from the web-site www.quotedb.com. It will first store the quote in the file named 'quotes' and then append the new quote to the file named 'final.txt'. It is probably designed to collect quotes for a program such as 'fortune' which some people used to print on their screen when they login or open a shell. It will still ...


0

This is a shell script. You will need to create a file with extension .sh. In linux terminal you will need to run the command as below. sh script.sh


1

google and most other publicly accessed sites are configured to NOT RESPOND to ICMP requests, as it is an attack vector for denial of service type of attacks. But wget is a web browser for all intents and purposes. Hence the website will respond to http and https requests, and probably nothing else. And there is nothing you can do about it.


0

After a bit of Googling, I found an answer with the discovery an app called Screen. After installation on the server (sudo apt-get install screen), you SSH into the server and open a screen session on the server with screen -S SESSION_NAME (replacing SESSION_NAME with any name you like). Then you run WGET and once the download is running, exit the session ...


0

I'm assuming what you mean is you want to parse the HTML contained in the HTTP response. If you are familiar with PHP you could use curl to retrieve the page then parse the string into its DOM structure using PHP's DOMDocument class, then you can retrieve the innerHTML of interest by querying the DOMDocument instance. As a commandline PHP script ...



Top 50 recent answers are included