The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
0answers
9 views

Calcualte the correct MBit/s in my speedtest

I know wget is usually showing the speed in a summary, but in my small OpenWRT shell. I want to test how long it takes to download 100MB with t=$(date +"%s") wget ...
0
votes
1answer
27 views

Continuing an interrupted `wget` session?

Is it possible to continue an interrupted wget session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget store additional information to disk (like it's list over ...
1
vote
1answer
22 views

Iceweasel doesnt open downloads correctly

When I try to open a tarball from the downloads with iceweasel it opens it with the VLC-Player. Can I change it somehow?
0
votes
0answers
55 views

How to download files and folders from Onedrive using wget?

How to use wget to download files from Onedrive? (and batch files and entire folders, if possible)
0
votes
1answer
43 views

Can I check a suspect .zip file without downloading it?

I am using Linux Fedora 20 and BT Yahoo mail. I have received an email with an attached .zip file, but I suspect that it might be malicious and dangerous even to download the attachment -- it might ...
1
vote
1answer
25 views

Is there a conventional place in Unix to store downloaded packages?

Working in a Unixy system, I am often confused by where to store downloaded packages. For example, I'm trying to install Spark on OSX, following these instructions. When I get to tar -xvzf ...
0
votes
1answer
24 views

Is it okay to partition my drive while I'm downloading a huge file (4gb)

I'm downloading a huge file using a torrent client and I was wondering if I can use GParted to partition around 100gb of my 1tb to save time because I plan to dual boot this computer right after the ...
1
vote
0answers
44 views

How to download thousands of files quickly?

I need to download thousands of files (approximately 2-12 MB each) - Currently I am using the following command wget --reject "index.html*" -A *.gz -N -r -l1 -nd --no-check-certificate --user ...
0
votes
0answers
35 views

Download Hotlinked Images from Forum from Command Line

From the command line, is it possible to download linked images posted on forums? I want to enter the forum thread url and maybe stipulate which image hosts to detect. Also some threads will have ...
0
votes
0answers
150 views

Can't download all of specified webpages by using wkhtmltopdf

i try to download the webpages specified as a list of urls in a text file urls, and convert and merge them to a single pdf file, by running: $ wkhtmltopdf $(cat urls) all.pdf Loading pages (1/6) ...
1
vote
0answers
31 views

Download a webpage by putting everything it needs in a dedicated directory?

To download a webpage ( its html file and other files needed by it), wget seems to mirror the directory structure of the files of the webpage on the website server When in a web browser (e.g. Firefox ...
0
votes
3answers
249 views

download file from internet to server using SSH

recently because of some problem i lost all my server file and request to hosting team to provide me backup. they will provide me link from where i have to download that compressed file and upload ...
1
vote
1answer
280 views

checksum failed on workstation live fedora 22 64bit download

I downloaded the iso from https://getfedora.org/en/workstation/download/ Next, I attempted to follow the instructions at https://getfedora.org/en/verify I downloaded the checksum file from the ...
1
vote
1answer
122 views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
2
votes
1answer
204 views

For Loop for Google Image Downloading Bash Script

I have a bash script which downloads images from Google Images. This is the command I use: bash getimages.sh 3 rocky%20mountains That command will download the 3rd picture in Google Images. To ...
2
votes
1answer
70 views

wget on the fly to extract specific info from file without downloading the entire file

I have some files (which are in .bam format(binary)) to download from a location. I can download them using wget and then want to extract some specific information from them only. For that I use ...
5
votes
3answers
921 views

command-line tool for a single download of a torrent (like wget or curl)

I'm interested in a single command that would download the contents of a torrent (and perhaps participate as a seed following the download, until I stop it). Usually, there is a torrent-client daemon ...
1
vote
1answer
91 views

Tar and download in one step over ssh / scp [duplicate]

(This seems like an obvious / common question, but I couldn't find it when searching - maybe I wasn't using the correct terminology...) I want to login over ssh to a remote machine, tar a directory, ...
0
votes
2answers
87 views

Download an article with cURL given a dynamic download link

I'm trying to download this published journal article using cURL. It's the main page of an open access, so there should be not problems for anyone to see/download the article. I then extract the ...
0
votes
0answers
29 views

Aria2 download html page

I'm trying to download a video using aria2, but it download the html page of the link instead the video. I've also tried the link from browser and I can download it normally. Why?
1
vote
2answers
297 views

FTP: get the latest file in sever

This is really really pain in the ass. I have a ftp server running, and it irregularly generates the latest file. The file is store as: Home->T22:30:10->new.txt, and the latest one would be (a new ...
1
vote
0answers
35 views

FTP: Removing an entire directory

Is there any way to delete a non-empty directory in Linux using FTP? I am using client, and I wish to delete the directory in a remote server. I have looked into wget and curl. What do you guys ...
0
votes
2answers
94 views

Filter hyperlinks from web page and download all that match a certain pattern

I wanted to download all graphic files from our organisation's graphics repository web page. They are Illustrator (.ai) format and Corel Draw (.cdr) format. They are directly hyperlinked (i.e. <a ...
0
votes
1answer
85 views

Re-download Corrupted Part of ISO

I have download an ISO file from one of the public FTP server. It took a lot of time to download the file because of my Internet Connection Issues. I used the wget command to download the ISO in ...
0
votes
2answers
26 views

How do I set up a .deb file?

I am trying to set up a .deb package I have downloaded. I need to know how to set it up. I do have root privileges, and I am currently running BasilOS Linux(Trinity).
3
votes
1answer
95 views

Is there a command-line method to tell if all current downloads in Chromium have finished?

Is there a command-line way to determine if all current downloads in Chromium have finished? By downloads, I mean downloading videos from Youtube. I don't want to just rely on looking at Chromium's ...
0
votes
1answer
205 views

Download Forum Attachments

Is there a way to download forum jpeg image attachments, possibly using Wget or Curl or some other tool? I would like to download jpeg attachments from specific pages on forums. I'm not interested in ...
2
votes
1answer
331 views

How do I securely download files in shell scripting?

I am writing some shell scripts to automatically download software packages off my server and set them up on customer servers. At some point within the script, the download command is wget ...
0
votes
1answer
561 views

youtube-dl problems, can't download private videos

I want to download all my private videos, but I when try it I get errors. This is the command line arguments that I'm using: youtube-dl -u "Username" -p "Password" ...
1
vote
0answers
36 views

Is there a download manager which can retrieve automatically an URL from a RSS feed?

Is there a download manager which can retrieve automatically a URL from an RSS feed, or an XML file, or even a text or HTML file (any of these options is fine)? If yes how can I configure it? I (or ...
2
votes
1answer
123 views

Wget: convert-links and avoid redownloading already fetched files?

I am downloading data spread among multiple files that don't change once published. Therefore --timestamping is not good enough, because it is constantly checking whatever resource is changed, which ...
0
votes
2answers
871 views

How to move completed torrent downloads to another folder without breaking the torrent link?

I'm using Transmission on EOs and I've downloaded a bunch of torrent files which ended up my Download folder in my /home. I'd like now to move the files to my external hard drive without breaking the ...
2
votes
1answer
47 views

I need to download Leonard Suskind video Lectures

Is there a way to download the physics video lectures using curl, mget, or wget. accessing youtube and selecting download method (MP4) takes too long. Any command line example would help greatly.
2
votes
0answers
303 views

wget resume download from dropbox gives can't write error

I want to resume download from dropbox using wget. I was downloading a file wget -O SQLyog.exe "https://www.dropbox.com/s/dfv2z0le0c2bo7z/SQLyog-9.3.3-0Trial.exe?dl=1" .......... Length: 15775640 ...
0
votes
1answer
416 views

What options does wget --report-speed take?

When I do this command: wget --report-speed=type they only type it accepts is bits. It won't have numbers, kilobits / kilobytes or bytes. The help page (wget --help) says: --report-speed=TYPE ...
2
votes
1answer
46 views

Why is my computer sluggish after downloading a lot?

When I download a lot of data (e.g. 3GB) in one go, using a program such as Transmission or Wget, progressively during the downloading, and after it has has finished, the computer always seems ...
5
votes
2answers
414 views

Bash Script - Wget Graphical Download Progress

I'm trying to port this code from wget + zenity to wget + kdialog. The code with zenity: #!/bin/bash # Start wget | zenity # Note the & at the end of the pipe, this allows the script to continue ...
1
vote
1answer
154 views

Server reports incorrect file size when downloading a large file

I have a large tarball file on an OS X web server that I uploaded via sshfs. The file on my computer prior to uploading is 5345834658 bytes. The file after copying is 5345834658 bytes on the server so ...
1
vote
2answers
97 views

Download all pages linked on a page in a certain region

I would like to download my users activity page of this Unix&Linux with wget and all pages that are linked in the activity list. I tried wget -m -l 2 which should mirror the site recursively ...
1
vote
3answers
4k views

wget downloading tar.gz file as html?

I need to download this file http://download.oracle.com/otn-pub/java/jdk/7u67-b01/jdk-7u67-linux-x64.tar.gz using wget. I use the command wget ...
0
votes
2answers
180 views

Get the file list in an HTML directory listing

I can get all files on the bash patches site by downloading them in a sequence: SEQ=$(seq -f "%03g" 1 30) for i in $SEQ; do wget http://ftp.gnu.org/gnu/bash/bash-4.3-patches/bash43-$i; done But ...
0
votes
2answers
582 views

After downloading an .asp or .php file, can it be converted to a .html file? [closed]

I wonder if downloading files via wget and having them named .asp or .php means that I download the webpage? Aren't these executable files? If so, after downloading an .asp or .php file, can it be ...
4
votes
3answers
6k views

How to call a service URL from bash shell script in parallel?

I have a service which I am calling from another application. Below is my service URL which I am calling - http://www.betaservice.domain.host.com/web/hasChanged?ver=0 I need to do some load test ...
3
votes
1answer
358 views

Recover the content of a Firefox .part file?

The question says it all, I have a <filename>.zip.part file in my Firefox download directory which is ~150MB and I'd like to recover its content. The original file was a very large zip archive ...
2
votes
1answer
102 views

How to find out how much of internet bandwidth is used by all processes except one specific process?

As a followup question to this one: I am downloading a file on multiple remote computers using curl command and am using the --limit-rate parameter to limit the download speed on the ones whose ...
2
votes
1answer
94 views

Is it possible to dynamically change the --limit-rate parameter of curl?

As a followup question to this one: I am using the --limit-rate parameter to limit the download speed on computers whose internet is being used: curl --limit-rate 10k -r 104857601-209715200 -o ...
35
votes
1answer
2k views

How do I distribute a large download over multiple computers?

I need to download a large file (1GB). I also have access to multiple computers running Linux, but each is limited to a 50kB/s download speed by an admin policy. How do I distribute downloading this ...
1
vote
0answers
118 views

How to limit aria2 connections to one server but enable concurrent connections to multiple servers?

I have a long list urls to download with aria2 from a variety of servers, with some urls from the same server. Here's a snippet of urls.txt: ...
1
vote
1answer
81 views

Lynx is trying to unzip my downloads

I am having a problem with the Lynx text browser. When I try to download a some tar.gz files, Lynx is not downloading it. It is putting it in a tmp directory and then trying to unpack it with the ...
1
vote
0answers
26 views

How can I find out what's seeding in Vuze if it's not listed anywhere in the application?

I use Vuze (formally known as Azuereus) for downloading torrents. But for some time now it's been seeding something that I can't see or find anywhere. It's not listed in any of the lists that are ...