Questions tagged [download]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
1k views

Can I make curl or wget restart if disconnected?

I'd like to download a file through curl - the problem is that my connection is very slow, and by unknown means, stops receiving data after ~180 kilobytes. Unless there's a better method to fix it, I'...
1
vote
3answers
185 views

Downloading a few thousand files - how?

I want to download a few thousand files one by one. The average size of each one is 5-10Mb. Each has a name of "name_{i}", where "i" is a counter. What's the easiest and best way to do that? Note ...
1
vote
2answers
1k views

How do I download PDFs from PubMed, given their IDs?

I have PubMed IDs for files I need to download from the PubMed site in .pdf format. I tried this script: #!/usr/bin/env bash Link="http://www.ncbi.nlm.nih.gov/pubmed/" ID=(10021369 ...
1
vote
1answer
58 views

PureOS verification of download

PureOS has SHA256 verification of download, but I've heard that SHA isn't so secure. Do they sign their files or provide associated .sig files? And is it true that that would be more secure?
1
vote
1answer
435 views

wget using -i with -O

I have a db of files to download containing fields for filename and download_url with the format: "foo-1.23.4.jar", "http://example.com/files/12345678/download" "bar-5.67.8.jar", "http://example.com/...
1
vote
2answers
184 views

Looking for a terminal download manager

I am looking for a download manager running in CLI (terminal). Tool should solve the following purpose. Take a list of YouTube URL as input / take a URL-list from a file. Should pause and resume ...
1
vote
1answer
704 views

Server reports incorrect file size when downloading a large file

I have a large tarball file on an OS X web server that I uploaded via sshfs. The file on my computer prior to uploading is 5345834658 bytes. The file after copying is 5345834658 bytes on the server so ...
1
vote
2answers
430 views

wget download files from a file list, how to specify names for each of the downloaded file?

When downloading a single file, we can use wget's -O option to specify the file name. When I'm downloading Urls in a file using wget -i filelist.txt (filelist.txt contains list Of Urls I want to ...
1
vote
1answer
295 views

A file on AkamaiGlobalHost downloads with a browser but not with curl

When I download the following file on my browsers (firefox & waterfox): https://launcher-public-service-prod06.ol.epicgames.com/launcher/api/installer/download/EpicGamesLauncherInstaller.msi?...
1
vote
1answer
319 views

Debian script to download source of installed packages fails

I used the next script from askububtu to automate the download of all installed packages in a fresh debian 9.3 LXDE installation. From here: #!/bin/bash dpkg --get-selections | while read line do ...
1
vote
1answer
353 views

Where is the OpenSuSE server ISO for download?

Which download is the "server" version for OpenSuSE? Index of download.opensuse.org/distribution/openSUSE-current/iso/ [ICO] Name Last modified Size Metadata [DIR] Parent Directory ...
1
vote
1answer
373 views

Can not download curl

I was trying to download "curl", but could not do so. As far as I could tell, I did not have the problem last time. $ wget https://curl.haxx.se/download/curl-7.52.1.tar.gz --2017-02-18 16:32:21-- ...
1
vote
1answer
217 views

How to downloaded HTML file with obfuscated text

I use Firefox and I don't have any issues viewing and reading English text on the loaded websites. If I click Save in Firefox and save the web page in question as a text file I can read everything in ...
1
vote
1answer
7k views

Download pdf files using wget [closed]

I tried use wget typing this command wget -P -e robots=off -A.pdf -r -l1 http://concours-maths-cpge.fr/ but I didn't succeed. I don't know the reason but perhaps because we need to click buttons to ...
1
vote
3answers
2k views

Why use Wget instead of a browser? [closed]

When should I use Wget rather than a browser? I heard that Stallman uses it instead of a browser for anonymity reasons. What does the server think/see when you get its files using Wget?
1
vote
1answer
723 views

How do you make apt-get install faster? [closed]

I just installed Debian for the first time in a virtual-machine (I have used centos/RHEL/fedora for the last 11 years so I have some Linux experience). I did an apt-get install gcc... the command took ...
1
vote
2answers
129 views

How do I quickly transfer a large archive (~16GB)

How do I quickly transfer a large archive (~16GB) from one mount point to another on 80 servers? The mount points are on separate partitions. I tried ansible (with the -f 100 option) and a bash script ...
1
vote
1answer
180 views

Iceweasel doesn't open downloads correctly

When I try to open a tarball from the downloads directory with iceweasel it opens it with the VLC-Player. Can I change this behavior?
1
vote
1answer
55 views

Is there a conventional place in Unix to store downloaded packages?

Working in a Unixy system, I am often confused by where to store downloaded packages. For example, I'm trying to install Spark on OSX, following these instructions. When I get to tar -xvzf spark-1....
1
vote
2answers
3k views

FTP: get the latest file in sever

This is really really pain in the ass. I have a ftp server running, and it irregularly generates the latest file. The file is store as: Home->T22:30:10->new.txt, and the latest one would be (a new ...
1
vote
2answers
6k views

youtube-dl problems, can't download private videos

I want to download all my private videos, but I when try it I get errors. This is the command line arguments that I'm using: youtube-dl -u "Username" -p "Password" https://youtube.com/watch?v=...
1
vote
2answers
3k views

Get the file list in an HTML directory listing

I can get all files on the bash patches site by downloading them in a sequence: SEQ=$(seq -f "%03g" 1 30) for i in $SEQ; do wget http://ftp.gnu.org/gnu/bash/bash-4.3-patches/bash43-$i; done But ...
1
vote
2answers
2k views

After downloading an .asp or .php file, can it be converted to a .html file? [closed]

I wonder if downloading files via wget and having them named .asp or .php means that I download the webpage? Aren't these executable files? If so, after downloading an .asp or .php file, can it be ...
1
vote
1answer
117 views

Firefox on Arch Linux always asks about download destination

I, actualy, don't know where to ask this, but this can be related to Linux. Firefox on Arch Linux always asks about download destination, even if there's a default download destination folder set up ...
1
vote
1answer
66 views

cclive: what kind of regexes are allowed?

Is there a place where I can look, what kind of regexes I can use with the --tr option from cclive?
1
vote
1answer
683 views

How do I create a local copy of a complete website section from OSX using curl?

I'm trying to download Mathematics of the Discrete Fourier Transform so that I can read through it off-line on my iPad (which doesn't have an Internet connection) I have used wget in Linux. It seems ...
1
vote
1answer
28 views

Download Accelerator for Unix using MobaXterm SSH [closed]

I am using MobaXterm in Windows to SSH into a Unix Server. I am trying to download a large file (>30GB) using MobaXterm and it just times out and then stops. My question: Is there a download ...
1
vote
1answer
24 views

Get current download speed as a number

nload is handy when it comes to live monitoring of bandwidth consumption. It displays an ongoing process window and you can look at it. While this is useful for humans, it isn't useful for scripts. I'...
1
vote
1answer
288 views

Downloading File Using Telnet

I'm trying to download a file, https://the.earth.li/~sgtatham/putty/latest/w64/putty.exe or https://www.7-zip.org/a/7z1806-x64.exe, without using curl or wget; rather, I want to download the file by ...
1
vote
2answers
248 views

Download just one port from the Ports Collection of FreeBSD

On a fresh FreeBSD 11.2 machine, my /usr/ports folder is empty. Running: portsnap fetch extract …as discussed in the Handbook results in filling my /usr/ports with a gig of content. If I only ...
1
vote
1answer
3k views

Why doesn't this wget download script work? [duplicate]

I have the following lines in a .sh shell script: wget -O discord.deb https://discordapp.com/api/download?platform=linux&format=deb sudo dpkg -i discord.deb rm -f discord.deb For some reason, ...
1
vote
1answer
10k views

Package has no installation candidate [closed]

I have an Ubuntu 15.04 and every time I try to download something (using sudo apt-get install), it says: Reading package lists... Done Building dependency tree Reading state information... ...
1
vote
1answer
629 views

Download pdf and zip files with wget from a php website

This website contains pdf and zip files for download. The problem is that I should download these files one by one by clicking on a button. I tried using wget to download the entire website without ...
1
vote
3answers
132 views

Download by appending after some percentage completion

I always use wget -c to download a file which enables the download by appending whenever needed from the last position of download. A file is downloaded 30%. Then after network occupancy it started ...
1
vote
2answers
1k views

How to get a direct link to a downloadable file (for use with wget or cURL) that's normally downloaded via Javascript in a web browser [closed]

A web site presents an xhtml page with a Download clickable button. When clicked from the web page I get the .zip file. Instead of Browser - I'm try to automate the download using wget --referrer. ...
1
vote
1answer
2k views

wget mirror site + resources from other domain

I'm trying to download a website so it can be browsed offline, so I want the html, images, css, javascript, etc. The problem is that the images are not all hosted on the same domain as the website, ...
1
vote
2answers
2k views

downloading images from webpage with different links

I am trying to download all the images from a webpage. The images are included as follows: <img src="https://alwaysSamePart.com/SomeRandomLinkThatVaries.jpg"> How should I parametrize my wget ...
1
vote
1answer
135 views

Linux Gateway as Download Accelerator like IPCop's

We're running dnsmasq on a linux box inside our network for DHCP and DNS. I would like to add a download accelerator like IPCop's (http://blockouttraffic.de/ua_index.php) but without having IPCop as ...
1
vote
1answer
2k views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
1
vote
1answer
217 views

Is it possible to download to files while in a SSH interactive? [duplicate]

Here I am, poking around a remote server via SSH, and I want to find out about/read/edit/whatever a file. I don't like vi or other CMI stuff, I want to read it locally. Is there any way I can ...
1
vote
0answers
22 views

How to save command line screen output in Linux after running program?

I ran a program that has a good amount of command line output, and it ran on a screen in a ssh server. I referred to this post so that I can scroll through the screen and see the output, but there is ...
1
vote
1answer
40 views

How to download the latest pre-release of Manjaro Linux?

From DistroWatch, I can see there is a version of Manjaro marked as "stable" which is more recent than the last release, 18.0.4. However I cannot find any link to download it, not even on Manjaro ...
1
vote
1answer
24 views

SAMBA copy file without properties: the file has properties that can't be copied to new location

From Windows 10 (enterprise) copying a file that has only been downloaded from internet will I get a windows popup saying: Are you sure you want to copy this file without it's properties? The ...
1
vote
0answers
27 views

Recursive wget, append something to each found URL

My main goal is to easily backup the page source for a bunch of MediaWiki pages of mine. I have every page I want downloaded, listed on my username page (https://wiki.example.com/index.php?title=User:...
1
vote
0answers
30 views

Logging remote file to rsyslog

I have an embedded system that does not support remote logging, but I can download its log file over HTTP, e.g. with: wget http://192.168.1.1/status/syslog.log I'd like to use a third machine to get ...
1
vote
1answer
1k views

Curl parallel download file list

first post sorry if I did some mess here =) Using Ubuntu 14.04lts 64bits server version. I have a list (url.list) with only URLs to download, one per line, that looks like this: http://domain.com/...
1
vote
1answer
538 views

wget multiple PDF files from links

I would like to download PDF files for particular search terms from the CIA archives. For example for "Vietnam", the URL is https://www.cia.gov/library/readingroom/search/site/Vietnam. The PDF files ...
1
vote
0answers
97 views

How to download files from a webpage that points to a directory?

I'm trying to download all the .mp3 files from here; but the download links are not .mp3 . (ex:https://freemusicarchive.org/music/download/98281de10b6cc09df9e99a5a3bd2c7ee0eddaf82) links but a ...
1
vote
0answers
389 views

Problem with downloading large file from internet

Since a while ago, whenever I am downloading a large file with maven it takes a long time. I also tried with just wget and still had the same problem. It will freeze for 10 or more minutes after ...
1
vote
1answer
741 views

Continuing an interrupted `wget` session?

Is it possible to continue an interrupted wget session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget store additional information to disk (like it's list over ...