I want to "scan" a website content, recursively, and pipe it to another program.
When I run:
wget -r -O - $SITE
WARNING: combining -O with -r or -p will mean that all downloaded content will be placed in the single file you specified.
Then, "download" process starts, but hangs after the first page is done. By "hangs" I mean, nothing seems to be going on, nor do I get back the command prompt until I hit
I would prefer avoiding the option outputting
wget to a temporary folder and scan file by file, as well as writing my own scrapper which seems to be the most redundant act one can think of at the end of 2012.