Questions tagged [download]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
3
votes
3answers
2k views

recursively download from a website

I am trying to get images from a website url "www.example.com/products" in this products folder lots of subfolders there I need to download the products folder. In the www.example.com/products, www....
3
votes
2answers
3k views

Filter hyperlinks from web page and download all that match a certain pattern

I wanted to download all graphic files from our organisation's graphics repository web page. They are Illustrator (.ai) format and Corel Draw (.cdr) format. They are directly hyperlinked (i.e. <a ...
3
votes
3answers
1k views

Accessing each line in .txt file, download and rename links

Let's say I have a .txt file where I have a list of image links that I want to download. example: image.jpg image2.jpg image3.jpg I use: cat images.txt | xargs wget and it works just fine What I ...
3
votes
2answers
572 views

Extract compressed file by it's header as it is piped from stdout (locally or from remote location)?

I am sending compressed file with piping either local or from a network location. And on the receiving end, I would like to detect the type of compression and use the appropriate decompression utility ...
3
votes
1answer
6k views

Periodically download attachments from mail box

Is there a preferably CLI based program I can use to regularly (through cron for example) use to check a mailbox, and download the attachments into a folder? I have a mailbox called photos@doamin.com,...
3
votes
2answers
11k views

Download an article with cURL given a dynamic download link

I'm trying to download this published journal article using cURL. It's the main page of an open access, so there should be not problems for anyone to see/download the article. I then extract the ...
3
votes
1answer
950 views

Is there a command-line method to tell if all current downloads in Chromium have finished?

Is there a command-line way to determine if all current downloads in Chromium have finished? By downloads, I mean downloading videos from Youtube. I don't want to just rely on looking at Chromium's ...
3
votes
2answers
537 views

How to burn an iso while downloading it

I'm in a real hurry so I thought there is a way to do that but I don't know how. I thought about piping wget -c cdimage.ubuntu.com/daily-live/current/utopic-desktop-amd64.iso | BurningApp but I don't ...
3
votes
1answer
794 views

How to wget website with same page and content names?

I'm trying mirror a website where it has page: http://www.site.com/news and contents: http://www.site.com/news/36-news/news-one http://www.site.com/news/37-news/news-two http://www.site.com/news/38-...
3
votes
1answer
79 views

Why is my computer sluggish after downloading a lot?

When I download a lot of data (e.g. 3GB) in one go, using a program such as Transmission or Wget, progressively during the downloading, and after it has has finished, the computer always seems ...
3
votes
1answer
375 views

How to download Debian testing i386 without GUI?

I had an old computer in which I want to install Debian, but it is so old that I thought that I should install Debian without any desktop environment. I tried out their latest stable version, which is ...
3
votes
1answer
2k views

checksum failed on workstation live fedora 22 64bit download

I downloaded the iso from https://getfedora.org/en/workstation/download/ Next, I attempted to follow the instructions at https://getfedora.org/en/verify I downloaded the checksum file from the ...
3
votes
1answer
816 views

Lynx is trying to unzip my downloads

I am having a problem with the Lynx text browser. When I try to download a some tar.gz files, Lynx is not downloading it. It is putting it in a tmp directory and then trying to unpack it with the ...
3
votes
1answer
2k views

Recover the content of a Firefox .part file?

The question says it all, I have a <filename>.zip.part file in my Firefox download directory which is ~150MB and I'd like to recover its content. The original file was a very large zip archive ...
3
votes
1answer
336 views

wget on the fly to extract specific info from file without downloading the entire file

I have some files (which are in .bam format(binary)) to download from a location. I can download them using wget and then want to extract some specific information from them only. For that I use ...
3
votes
0answers
747 views

How to setup QoS on router (prioritize VOIP and web browsing over downloading)?

I've got Asus WL500GP-v2 router with renewed Oleg's firmware installed (http://code.google.com/p/wl500g/ , the stable version). I would like to setup some Quality of Service to ensure all users are ...
3
votes
0answers
76 views

Use command line to download file which is accessible only in a given session [duplicate]

Possible Duplicate: Does anybody here have experience in automating some tasks in web applications using curl? Sorry for the lengthy title. I am trying use command line to download a file,which ...
2
votes
2answers
4k views

How to get wget to use the direct URL file name as output file name for a shortened URL

I'm trying to download all the books from a URL list in bulk. The list is in a text file in http://ligman.me/W3TuLr. I'm trying to use wget on linux for this. All these URLs seem to be created using a ...
2
votes
5answers
2k views

How do I install downloaded software using package managers? (Ubuntu Linux)

I recently learned that linux does not have any installation wizards. I needed the following software, so I downloaded them and put them in a folder. As you can see, I've extracted one of them. Now, ...
2
votes
1answer
3k views

Anyway to use HTTP Authentication with Axel Downloader?

Is there anyway to use http authentication with axel downloader? I don't want to use another solution such as aria2c because they don't support more than 16 concurrent connections.
2
votes
1answer
289 views

How to transfer a part of a file from remote system via SCP?

I am trying to fetch a log file which is repeatedly updated. I want that updated file, but don't want to download the entire file again and again from the remote system via SCP. Any idea to achieve ...
2
votes
1answer
350 views

Alert when a process exits

I often download files using wget and cURL. Is there anyway I can make my Linux box give a visual alert when either of those processes exit (i.e: the download completes) PS : I am using Ubuntu ...
2
votes
1answer
285 views

Can I use wget to download all files recursively, but not their actual content?

Sometimes, I wish to only get the directory structure of a website, but the files themselves are not important. I only want their name. Sort of like a mirror where every entry is just an empty dummy ...
2
votes
2answers
1k views

Check in pure bash that the download is complete

short story is, I probably need a simple loop in bash which checks periodically whether the size of a given file has changed or not since last checked. Long story, I will be downloading a file ...
2
votes
2answers
3k views

grab git repo from multiple sources in Yocto recipe

I am trying to retrieve sources from multiple git repos in a Yocto recipe. I used SRC_URI = "git://<git_repo_uri>;protocol=ssh;rev=<revision> \ git://<git_repo_uri>;...
2
votes
2answers
380 views

downloading a file once and playing it multiple times

I want to play youtube videos on a loop from my terminal using mplayer, and for that I've written the following code taking pieces from here and there: #!/bin/bash if [[ $(echo $*) ]]; then ...
2
votes
1answer
2k views

Download attachments in a URL redirect via Axel

Axel is not resolving URLs that redirect to another URL that has the file as an attachment. As you see, I'm getting 404 when I try to download this URL. (original site is replaced with example.com) ~...
2
votes
1answer
2k views

Why is wget skipping files while trying to mirror a site

I ran wget on this site: http://demo.codestag.com/geeklove/ but it only returns a single index.html wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-...
2
votes
1answer
152 views

What permission am I missing here?

I am trying to download the ffmpeg package and all of its dependencies into a directory on my computer. I use this code to do it sudo apt-get download $(apt-rdepends ffmpeg|grep -v "^ ") It works ...
2
votes
1answer
1k views

HTTPS Authentication with Axel Downloader

Is there a way to use https authentication with Axel to download files? I have gone through this answer and tried what was written, but to no extent. I got HTTP/1.1 401 Unauthorized as the output ...
2
votes
2answers
146 views

treating web page like directory

I'm a Mac user and I want to cd to a web page and then cp some files onto a local directory. Is there a way to do this? This is the page I'm referring to: http://www0.cs.ucl.ac.uk/staff/M.Herbster/...
2
votes
1answer
2k views

For Loop for Google Image Downloading Bash Script

I have a bash script which downloads images from Google Images. This is the command I use: bash getimages.sh 3 rocky%20mountains That command will download the 3rd picture in Google Images. To ...
2
votes
1answer
94 views

I need to download Leonard Suskind video Lectures

Is there a way to download the physics video lectures using curl, mget, or wget. accessing youtube and selecting download method (MP4) takes too long. Any command line example would help greatly.
2
votes
1answer
404 views

Is it possible to dynamically change the --limit-rate parameter of curl?

As a followup question to this one: I am using the --limit-rate parameter to limit the download speed on computers whose internet is being used: curl --limit-rate 10k -r 104857601-209715200 -o ...
2
votes
2answers
4k views

download multiple files from sourceforge

Is there any way to download / mirror a folder structure with many files from sourceforge using wget/curl/similar tool? I've seen some examples using rsync or scp but I think that works only for SF ...
2
votes
3answers
6k views

wget grabbing empty files that actually exist

I have a script that's meant to download a certain number of files from a remote server. It only needs to do this every 24 hours, since they are JSON sources for a database on my server. The files are ...
2
votes
1answer
857 views

How to download an entire directory from a webserver?

I want to download the contents of this page for study purposes. How can I download only this directory?
2
votes
1answer
382 views

How to download multiple files from website with wget and perform functions on downloaded file before next file is downloaded

I am using wget to download a number of json files from a website. However, I want to perform some sort of function on these files to reduce their size before downloading the next file. Is there a ...
2
votes
1answer
595 views

wget doesn't download images of a website?

I'm trying to download threads of a web forum which contains many images with wget. These images are hosted in a separate domain, so I used the -H flag to allow downloading them. The complete wget ...
2
votes
1answer
2k views

wget mirror site + resources from other domain

I'm trying to download a website so it can be browsed offline, so I want the html, images, css, javascript, etc. The problem is that the images are not all hosted on the same domain as the website, ...
2
votes
1answer
2k views

How do I securely download files in shell scripting?

I am writing some shell scripts to automatically download software packages off my server and set them up on customer servers. At some point within the script, the download command is wget http://...
2
votes
2answers
447 views

Download all pages linked on a page in a certain region

I would like to download my users activity page of this Unix&Linux with wget and all pages that are linked in the activity list. I tried wget -m -l 2 which should mirror the site recursively ...
2
votes
1answer
442 views

How to find out how much of internet bandwidth is used by all processes except one specific process?

As a followup question to this one: I am downloading a file on multiple remote computers using curl command and am using the --limit-rate parameter to limit the download speed on the ones whose ...
2
votes
1answer
5k views

ffmpeg and libmp3lame produces bad audio quality?

when I get a flash video from YouTube, why is the quality of the audio much worse than the origin video on YouTube? When I downloaded the flash movie, I convert it to avi like this: ffmpeg -i ~/"$...
2
votes
1answer
245 views

Where to find a PKG or RPM of fsarchiver?

I want to download the latest version of fsarchiver (I need a PKG file or RPM). Where can I find that?
2
votes
1answer
151 views

Download/Sync files in one direction only once

I'm a bit of a hoarder and my NAS is kinda the envy of my friends. But sharing my collection is a pain with everyone spread out many KMs across my city and Canada having garbage internet. I've had ...
2
votes
0answers
1k views

wget resume download from dropbox gives can't write error

I want to resume download from dropbox using wget. I was downloading a file wget -O SQLyog.exe "https://www.dropbox.com/s/dfv2z0le0c2bo7z/SQLyog-9.3.3-0Trial.exe?dl=1" .......... Length: 15775640 (...
2
votes
1answer
893 views

Using wget to download images in facebook conversations

This looks a bit harder than usual. I'm a new wget user and I was thinking that maybe it's possible to login into Facebook and download images from a specific conversation. I mean, I'd like to tell ...
1
vote
2answers
2k views

curl -O : Why it's not possible to download file specific directory? [closed]

The man curl entry for curl -O says: If you want the file saved in a different directory, make sure you change cur‐ rent working directory before you invoke curl with the -O, --...
1
vote
2answers
336 views

Can I download tar.gz file while it is being compressed?

I am compressing a huge directory which could be more than 10 GB, It takes time to compress it. But at the same time, I have to download this to another new server. So while the compressing is going ...