Tell me more ×
Unix & Linux Stack Exchange is a question and answer site for users of Linux, FreeBSD and other Un*x-like operating systems.. It's 100% free, no registration required.
up vote -1 down vote favorite

Is there any command-line Linux tool for downloading user favourites (including subfolders), selected users galleries, groups ? (Preferably with ability to run in incremental mode, to update rip from time to time with new entries without reloading all currently loaded stuff)

I mean tool with DenvianArt web page parsing (web scraping) capabilities. So result will be a tree of direcotries with picture files in maximum available resolution:

userX_galleries/
    gallery1/
      pic_1_PICNAME.jpg
      pic_2_PICNAME.png
      (...)
      pic_n_PICNAME.jpg
    gallery2/
      pic_1_PICNAME.jpg
      pic_1_PICNAME.png
      (...)
      pic_n_PICNAME.png
    (...)

Or something like that.

share|improve this question
Example gallery full of Arch64 screenshots: crimesaucer.deviantart.com/gallery – Grzegorz Wierzowiecki Jan 24 '12 at 12:55

2 Answers

up vote 1 down vote

Either wget or curl should do what you want. You will need to provide the right URLs to either tools. To get the parsing, you could do that yourself via either picking the right file extensions or post-parsing of the files.

share|improve this answer
Ok, what you propose it about downloading web page or all related pages. Downloading gallery involves going thru many pages of gallery and into each of picture and selecting download of big version if available, if not downloading biggest available. – Grzegorz Wierzowiecki Jan 24 '12 at 12:53
2  
I understand what you are asking. I am telling you how to make such a tool: wget, find, and file should get you most of the way there. I am 99% sure that such a tool does not exist and that you will have to write it yourself. – Sardathrion Jan 24 '12 at 13:02
there are a lot of web_scrappers (like BeautifulSoup or SeleniumHQ) as framweworks for crawling web pages. My point is not to reinvent the wheel, but to use working tool or base on similar. – Grzegorz Wierzowiecki Jan 24 '12 at 21:07
BeautifulSoup is not a web scraper. – ixtmixilix Sep 19 '12 at 21:08
up vote 0 down vote

You can use HTTrack. There are both command line and GUI interfaces.

http://en.wikipedia.org/wiki/Httrack

http://www.httrack.com

share|improve this answer
Whilst this may theoretically answer the question, it would be preferable to include the essential parts of the answer here, and provide the link for reference. – Renan Oct 20 '12 at 3:50

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.