Is there any command-line Linux tool for downloading user favourites (including subfolders), selected users galleries, groups ? (Preferably with ability to run in incremental mode, to update rip from time to time with new entries without reloading all currently loaded stuff)

I mean tool with DenvianArt web page parsing (web scraping) capabilities. So result will be a tree of direcotries with picture files in maximum available resolution:


Or something like that.


Either wget or curl should do what you want. You will need to provide the right URLs to either tools. To get the parsing, you could do that yourself via either picking the right file extensions or post-parsing of the files.

  • Ok, what you propose it about downloading web page or all related pages. Downloading gallery involves going thru many pages of gallery and into each of picture and selecting download of big version if available, if not downloading biggest available. – Grzegorz Wierzowiecki Jan 24 '12 at 12:53
  • 2
    I understand what you are asking. I am telling you how to make such a tool: wget, find, and file should get you most of the way there. I am 99% sure that such a tool does not exist and that you will have to write it yourself. – Sardathrion Jan 24 '12 at 13:02
  • there are a lot of web_scrappers (like BeautifulSoup or SeleniumHQ) as framweworks for crawling web pages. My point is not to reinvent the wheel, but to use working tool or base on similar. – Grzegorz Wierzowiecki Jan 24 '12 at 21:07
  • BeautifulSoup is not a web scraper. – ixtmixilix Sep 19 '12 at 21:08

You can use HTTrack. There are both command line and GUI interfaces.



  • Whilst this may theoretically answer the question, it would be preferable to include the essential parts of the answer here, and provide the link for reference. – Renan Oct 20 '12 at 3:50

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.