Unix & Linux Stack Exchange is a question and answer site for users of Linux, FreeBSD and other Un*x-like operating systems. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Is there any command-line Linux tool for downloading user favourites (including subfolders), selected users galleries, groups ? (Preferably with ability to run in incremental mode, to update rip from time to time with new entries without reloading all currently loaded stuff)

I mean tool with DenvianArt web page parsing (web scraping) capabilities. So result will be a tree of direcotries with picture files in maximum available resolution:


Or something like that.

share|improve this question
Example gallery full of Arch64 screenshots: crimesaucer.deviantart.com/gallery – Grzegorz Wierzowiecki Jan 24 '12 at 12:55

Either wget or curl should do what you want. You will need to provide the right URLs to either tools. To get the parsing, you could do that yourself via either picking the right file extensions or post-parsing of the files.

share|improve this answer
Ok, what you propose it about downloading web page or all related pages. Downloading gallery involves going thru many pages of gallery and into each of picture and selecting download of big version if available, if not downloading biggest available. – Grzegorz Wierzowiecki Jan 24 '12 at 12:53
I understand what you are asking. I am telling you how to make such a tool: wget, find, and file should get you most of the way there. I am 99% sure that such a tool does not exist and that you will have to write it yourself. – Sardathrion Jan 24 '12 at 13:02
there are a lot of web_scrappers (like BeautifulSoup or SeleniumHQ) as framweworks for crawling web pages. My point is not to reinvent the wheel, but to use working tool or base on similar. – Grzegorz Wierzowiecki Jan 24 '12 at 21:07
BeautifulSoup is not a web scraper. – ixtmixilix Sep 19 '12 at 21:08

You can use HTTrack. There are both command line and GUI interfaces.



share|improve this answer
Whilst this may theoretically answer the question, it would be preferable to include the essential parts of the answer here, and provide the link for reference. – Renan Oct 20 '12 at 3:50

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.