This is driving me insane, as I'm sure there must be some program doing the job but I just can't find it.
To be noted, I'd be on ARM/Raspberry so unfortunately
Xidel is not an option here, unless someone is kind enough to point me in the right direction for compiling it myself (if possible at all). I also tried
w3m but I'm not quite sure dumping the page to another to-be-formatted file would truly help, but then again please prove me wrong!
Basically I need to read an https url, then parse the html to something easily accessible from within Bash, and finally store some values in a db.
I'm already doing most of the job simply with
grep, but as soon as the data I need is not exactly how it should be formatted I'm stuck. See example:
<h1>Title</h1> #easy to extract Title only with grep | sed <h1> Title </h1> #no way
So you can see the catch here, what I need is a script solution that reads the whole page and gives me an array of the contents, rather than the 'randomly' formatted output I currently have.