Questions tagged [download]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
2answers
148 views

treating web page like directory

I'm a Mac user and I want to cd to a web page and then cp some files onto a local directory. Is there a way to do this? This is the page I'm referring to: http://www0.cs.ucl.ac.uk/staff/M.Herbster/...
5
votes
1answer
5k views

Why wget is not willing to download recursively?

The command $ wget -r http://www.comp.brad.ac.uk/research/GIP/tutorials/index.html only downloads index.html and robots.txt for me, even though there are links in it to further pages in the same ...
1
vote
2answers
337 views

Can I download tar.gz file while it is being compressed?

I am compressing a huge directory which could be more than 10 GB, It takes time to compress it. But at the same time, I have to download this to another new server. So while the compressing is going ...
0
votes
1answer
966 views

Download files from the file with same path directory

I need a simple command/script which allows me to download hundreds of files from the file in the same path structure as on the remote server. For example: http://download.com/path/to/the/folder/...
1
vote
2answers
130 views

How do I quickly transfer a large archive (~16GB)

How do I quickly transfer a large archive (~16GB) from one mount point to another on 80 servers? The mount points are on separate partitions. I tried ansible (with the -f 100 option) and a bash script ...
3
votes
2answers
574 views

Extract compressed file by it's header as it is piped from stdout (locally or from remote location)?

I am sending compressed file with piping either local or from a network location. And on the receiving end, I would like to detect the type of compression and use the appropriate decompression utility ...
1
vote
3answers
188 views

Downloading a few thousand files - how?

I want to download a few thousand files one by one. The average size of each one is 5-10Mb. Each has a name of "name_{i}", where "i" is a counter. What's the easiest and best way to do that? Note ...
2
votes
2answers
383 views

downloading a file once and playing it multiple times

I want to play youtube videos on a loop from my terminal using mplayer, and for that I've written the following code taking pieces from here and there: #!/bin/bash if [[ $(echo $*) ]]; then ...
1
vote
1answer
135 views

Linux Gateway as Download Accelerator like IPCop's

We're running dnsmasq on a linux box inside our network for DHCP and DNS. I would like to add a download accelerator like IPCop's (http://blockouttraffic.de/ua_index.php) but without having IPCop as ...
-1
votes
1answer
177 views

Create Automate Task to download and search in PDF and notify

I want to create an Automate Task to hourly download a PDF from a specific URL and then search for certain text like "6256896" and then if there was the text inside the PDF,notifies me for example ...
0
votes
2answers
1k views

How do I download log4j on ec2 instance?

The link to download log4j is here. However I have logged into the my EC2 instance. Whats the command line to download this log4j ?
0
votes
1answer
110 views

Calculate the correct MBit/s in my speedtest

I know wget is usually showing the speed in a summary. But in my small OpenWRT shell, I want to test how long it takes to download 100MB with t=$(date +"%s") wget http://speedtest.netcologne.de/...
1
vote
1answer
759 views

Continuing an interrupted `wget` session?

Is it possible to continue an interrupted wget session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget store additional information to disk (like it's list over ...
1
vote
1answer
182 views

Iceweasel doesn't open downloads correctly

When I try to open a tarball from the downloads directory with iceweasel it opens it with the VLC-Player. Can I change this behavior?
17
votes
4answers
30k views

How to download files and folders from Onedrive using wget?

How to use wget to download files from Onedrive? (and batch files and entire folders, if possible)
0
votes
1answer
174 views

Can I check a suspect .zip file without downloading it?

I am using Linux Fedora 20 and BT Yahoo mail. I have received an email with an attached .zip file, but I suspect that it might be malicious and dangerous even to download the attachment -- it might ...
1
vote
1answer
55 views

Is there a conventional place in Unix to store downloaded packages?

Working in a Unixy system, I am often confused by where to store downloaded packages. For example, I'm trying to install Spark on OSX, following these instructions. When I get to tar -xvzf spark-1....
0
votes
1answer
39 views

Is it okay to partition my drive while I'm downloading a huge file (4gb)

I'm downloading a huge file using a torrent client and I was wondering if I can use GParted to partition around 100gb of my 1tb to save time because I plan to dual boot this computer right after the ...
1
vote
0answers
408 views

How to download thousands of files quickly?

I need to download thousands of files (approximately 2-12 MB each) - Currently I am using the following command wget --reject "index.html*" -A *.gz -N -r -l1 -nd --no-check-certificate --user ...
0
votes
0answers
236 views

Download Hotlinked Images from Forum from Command Line

From the command line, is it possible to download linked images posted on forums? I want to enter the forum thread url and maybe stipulate which image hosts to detect. Also some threads will have ...
1
vote
0answers
196 views

Download a webpage by putting everything it needs in a dedicated directory?

To download a webpage ( its html file and other files needed by it), wget seems to mirror the directory structure of the files of the webpage on the website server When in a web browser (e.g. Firefox ...
4
votes
3answers
41k views

download file from Internet to server using SSH

Recently because of some problem, I lost all my server files and requested the hosting team to provide me my files from a backup. They will provide me a link from which I have to download a compressed ...
3
votes
1answer
2k views

checksum failed on workstation live fedora 22 64bit download

I downloaded the iso from https://getfedora.org/en/workstation/download/ Next, I attempted to follow the instructions at https://getfedora.org/en/verify I downloaded the checksum file from the ...
1
vote
1answer
2k views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
2
votes
1answer
2k views

For Loop for Google Image Downloading Bash Script

I have a bash script which downloads images from Google Images. This is the command I use: bash getimages.sh 3 rocky%20mountains That command will download the 3rd picture in Google Images. To ...
3
votes
1answer
337 views

wget on the fly to extract specific info from file without downloading the entire file

I have some files (which are in .bam format(binary)) to download from a location. I can download them using wget and then want to extract some specific information from them only. For that I use ...
16
votes
7answers
17k views

command-line tool for a single download of a torrent (like wget or curl)

I'm interested in a single command that would download the contents of a torrent (and perhaps participate as a seed following the download, until I stop it). Usually, there is a torrent-client daemon ...
7
votes
1answer
16k views

Tar and download in one step over ssh / scp [duplicate]

(This seems like an obvious / common question, but I couldn't find it when searching - maybe I wasn't using the correct terminology...) I want to login over ssh to a remote machine, tar a directory, ...
3
votes
2answers
11k views

Download an article with cURL given a dynamic download link

I'm trying to download this published journal article using cURL. It's the main page of an open access, so there should be not problems for anyone to see/download the article. I then extract the ...
1
vote
2answers
3k views

FTP: get the latest file in sever

This is really really pain in the ass. I have a ftp server running, and it irregularly generates the latest file. The file is store as: Home->T22:30:10->new.txt, and the latest one would be (a new ...
1
vote
0answers
449 views

FTP: Removing an entire directory

Is there any way to delete a non-empty directory in Linux using FTP? I am using client, and I wish to delete the directory in a remote server. I have looked into wget and curl. What do you guys ...
3
votes
2answers
3k views

Filter hyperlinks from web page and download all that match a certain pattern

I wanted to download all graphic files from our organisation's graphics repository web page. They are Illustrator (.ai) format and Corel Draw (.cdr) format. They are directly hyperlinked (i.e. <a ...
0
votes
1answer
548 views

Re-download Corrupted Part of ISO

I have download an ISO file from one of the public FTP server. It took a lot of time to download the file because of my Internet Connection Issues. I used the wget command to download the ISO in Linux....
0
votes
2answers
72 views

How do I set up a .deb file?

I am trying to set up a .deb package I have downloaded. I need to know how to set it up. I do have root privileges, and I am currently running BasilOS Linux(Trinity).
3
votes
1answer
966 views

Is there a command-line method to tell if all current downloads in Chromium have finished?

Is there a command-line way to determine if all current downloads in Chromium have finished? By downloads, I mean downloading videos from Youtube. I don't want to just rely on looking at Chromium's ...
0
votes
1answer
1k views

Download Forum Attachments

Is there a way to download forum jpeg image attachments, possibly using Wget or Curl or some other tool? I would like to download jpeg attachments from specific pages on forums. I'm not interested in ...
2
votes
1answer
2k views

How do I securely download files in shell scripting?

I am writing some shell scripts to automatically download software packages off my server and set them up on customer servers. At some point within the script, the download command is wget http://...
1
vote
2answers
6k views

youtube-dl problems, can't download private videos

I want to download all my private videos, but I when try it I get errors. This is the command line arguments that I'm using: youtube-dl -u "Username" -p "Password" https://youtube.com/watch?v=...
1
vote
0answers
191 views

Is there a download manager which can retrieve automatically an URL from a RSS feed?

Is there a download manager which can retrieve automatically a URL from an RSS feed, or an XML file, or even a text or HTML file (any of these options is fine)? If yes how can I configure it? I (or ...
13
votes
1answer
2k views

Wget: convert-links and avoid redownloading already fetched files?

I am downloading data spread among multiple files that don't change once published. Therefore --timestamping is not good enough, because it is constantly checking whatever resource is changed, which ...
7
votes
2answers
14k views

How to move completed torrent downloads to another folder without breaking the torrent link?

I'm using Transmission on EOs and I've downloaded a bunch of torrent files which ended up my Download folder in my /home. I'd like now to move the files to my external hard drive without breaking the ...
2
votes
1answer
95 views

I need to download Leonard Suskind video Lectures

Is there a way to download the physics video lectures using curl, mget, or wget. accessing youtube and selecting download method (MP4) takes too long. Any command line example would help greatly.
2
votes
0answers
1k views

wget resume download from dropbox gives can't write error

I want to resume download from dropbox using wget. I was downloading a file wget -O SQLyog.exe "https://www.dropbox.com/s/dfv2z0le0c2bo7z/SQLyog-9.3.3-0Trial.exe?dl=1" .......... Length: 15775640 (...
0
votes
2answers
12k views

What options does wget --report-speed take?

When I do this command: wget --report-speed=type they only type it accepts is bits. It won't have numbers, kilobits / kilobytes or bytes. The help page (wget --help) says: --report-speed=TYPE ...
3
votes
1answer
80 views

Why is my computer sluggish after downloading a lot?

When I download a lot of data (e.g. 3GB) in one go, using a program such as Transmission or Wget, progressively during the downloading, and after it has has finished, the computer always seems ...
4
votes
2answers
2k views

Bash Script - Wget Graphical Download Progress

I'm trying to port this code from wget + zenity to wget + kdialog. The code with zenity: #!/bin/bash # Start wget | zenity # Note the & at the end of the pipe, this allows the script to continue ...
1
vote
1answer
723 views

Server reports incorrect file size when downloading a large file

I have a large tarball file on an OS X web server that I uploaded via sshfs. The file on my computer prior to uploading is 5345834658 bytes. The file after copying is 5345834658 bytes on the server so ...
2
votes
2answers
451 views

Download all pages linked on a page in a certain region

I would like to download my users activity page of this Unix&Linux with wget and all pages that are linked in the activity list. I tried wget -m -l 2 which should mirror the site recursively ...
34
votes
2answers
34k views

Resume failed download using Linux command line tool

How do I resume a partially downloaded file using a Linux commandline tool? I downloaded a large file partially, i.e. 400 MB out of 900 MB due to power interruption, but when I start downloading ...
5
votes
3answers
14k views

wget downloading tar.gz file as html?

I need to download this file http://download.oracle.com/otn-pub/java/jdk/7u67-b01/jdk-7u67-linux-x64.tar.gz using wget. I use the command wget http://download.oracle.com/otn-pub/java/jdk/7u67-b01/...