The tag has no usage guidance.

learn more… | top users | synonyms

1
vote
2answers
25 views

downloading images from webpage with different links

I am trying to download all the images from a webpage. The images are included as follows: <img src="https://alwaysSamePart.com/SomeRandomLinkThatVaries.jpg"> How should I parametrize my wget ...
0
votes
1answer
82 views

How do you make apt-get install faster? [closed]

I just installed Debian for the first time in a virtual-machine (I have used centos/RHEL/fedora for the last 11 years so I have some Linux experience). I did an apt-get install gcc... the command took ...
2
votes
2answers
41 views

treating web page like directory

I'm a Mac user and I want to cd to a web page and then cp some files onto a local directory. Is there a way to do this? This is the page I'm referring to: ...
-3
votes
1answer
24 views

Why wget is not willing to download recursively?

The command $ wget -r http://www.comp.brad.ac.uk/research/GIP/tutorials/index.html only downloads index.html and robots.txt for me, even though there are links in it to further pages in the same ...
0
votes
0answers
45 views

Google Drive HTTP Error when downloading .zip file with Firefox

I'm using openSUSE 42.1 and opened a fresh install of Firefox, but somehow when I try to download a zip file from my Google Drive, an error is shown: Could not download "[filename]". HTTP error. ...
1
vote
2answers
53 views

Can I download tar.gz file while it is being compressed?

I am compressing a huge directory which could be more than 10 GB, It takes time to compress it. But at the same time, I have to download this to another new server. So while the compressing is going ...
0
votes
1answer
46 views

Download files from the file with same path directory

I need a simple command/script which allows me to download hundreds of files from the file in the same path structure as on the remote server. For example: ...
1
vote
2answers
56 views

How do I quickly transfer a large archive (~16GB)

How do I quickly transfer a large archive (~16GB) from one mount point to another on 80 servers? The mount points are on separate partitions. I tried ansible (with the -f 100 option) and a bash script ...
3
votes
2answers
99 views

Extract compressed file by it's header as it is piped from stdout (locally or from remote location)?

I am sending compressed file with piping either local or from a network location. And on the receiving end, I would like to detect the type of compression and use the appropriate decompression utility ...
1
vote
3answers
69 views

Downloading a few thousand files - how?

I want to download a few thousand files one by one. The average size of each one is 5-10Mb. Each has a name of "name_{i}", where "i" is a counter. What's the easiest and best way to do that? Note ...
2
votes
2answers
256 views

downloading a file once and playing it multiple times

I want to play youtube videos on a loop from my terminal using mplayer, and for that I've written the following code taking pieces from here and there: #!/bin/bash if [[ $(echo $*) ]]; then ...
1
vote
1answer
45 views

Linux Gateway as Download Accelerator like IPCop's

We're running dnsmasq on a linux box inside our network for DHCP and DNS. I would like to add a download accelerator like IPCop's (http://blockouttraffic.de/ua_index.php) but without having IPCop as ...
-1
votes
1answer
28 views

Create Automate Task to download and search in PDF and notify

I want to create an Automate Task to hourly download a PDF from a specific URL and then search for certain text like "6256896" and then if there was the text inside the PDF,notifies me for example ...
0
votes
1answer
28 views

How do I download log4j on ec2 instance?

The link to download log4j is here. However I have logged into the my EC2 instance. Whats the command line to download this log4j ?
0
votes
0answers
19 views

Calculate the correct MBit/s in my speedtest

I know wget is usually showing the speed in a summary. But in my small OpenWRT shell, I want to test how long it takes to download 100MB with t=$(date +"%s") wget ...
0
votes
1answer
73 views

Continuing an interrupted `wget` session?

Is it possible to continue an interrupted wget session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget store additional information to disk (like it's list over ...
1
vote
1answer
60 views

Iceweasel doesn't open downloads correctly

When I try to open a tarball from the downloads directory with iceweasel it opens it with the VLC-Player. Can I change this behavior?
0
votes
0answers
633 views

How to download files and folders from Onedrive using wget?

How to use wget to download files from Onedrive? (and batch files and entire folders, if possible)
0
votes
1answer
69 views

Can I check a suspect .zip file without downloading it?

I am using Linux Fedora 20 and BT Yahoo mail. I have received an email with an attached .zip file, but I suspect that it might be malicious and dangerous even to download the attachment -- it might ...
1
vote
1answer
35 views

Is there a conventional place in Unix to store downloaded packages?

Working in a Unixy system, I am often confused by where to store downloaded packages. For example, I'm trying to install Spark on OSX, following these instructions. When I get to tar -xvzf ...
0
votes
1answer
31 views

Is it okay to partition my drive while I'm downloading a huge file (4gb)

I'm downloading a huge file using a torrent client and I was wondering if I can use GParted to partition around 100gb of my 1tb to save time because I plan to dual boot this computer right after the ...
1
vote
0answers
88 views

How to download thousands of files quickly?

I need to download thousands of files (approximately 2-12 MB each) - Currently I am using the following command wget --reject "index.html*" -A *.gz -N -r -l1 -nd --no-check-certificate --user ...
0
votes
0answers
68 views

Download Hotlinked Images from Forum from Command Line

From the command line, is it possible to download linked images posted on forums? I want to enter the forum thread url and maybe stipulate which image hosts to detect. Also some threads will have ...
0
votes
0answers
518 views

Can't download all of specified webpages by using wkhtmltopdf

i try to download the webpages specified as a list of urls in a text file urls, and convert and merge them to a single pdf file, by running: $ wkhtmltopdf $(cat urls) all.pdf Loading pages (1/6) ...
1
vote
0answers
57 views

Download a webpage by putting everything it needs in a dedicated directory?

To download a webpage ( its html file and other files needed by it), wget seems to mirror the directory structure of the files of the webpage on the website server When in a web browser (e.g. Firefox ...
1
vote
3answers
4k views

download file from Internet to server using SSH

Recently because of some problem, I lost all my server files and requested the hosting team to provide me my files from a backup. They will provide me a link from which I have to download a compressed ...
1
vote
1answer
615 views

checksum failed on workstation live fedora 22 64bit download

I downloaded the iso from https://getfedora.org/en/workstation/download/ Next, I attempted to follow the instructions at https://getfedora.org/en/verify I downloaded the checksum file from the ...
1
vote
1answer
311 views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
2
votes
1answer
530 views

For Loop for Google Image Downloading Bash Script

I have a bash script which downloads images from Google Images. This is the command I use: bash getimages.sh 3 rocky%20mountains That command will download the 3rd picture in Google Images. To ...
2
votes
1answer
96 views

wget on the fly to extract specific info from file without downloading the entire file

I have some files (which are in .bam format(binary)) to download from a location. I can download them using wget and then want to extract some specific information from them only. For that I use ...
7
votes
3answers
2k views

command-line tool for a single download of a torrent (like wget or curl)

I'm interested in a single command that would download the contents of a torrent (and perhaps participate as a seed following the download, until I stop it). Usually, there is a torrent-client daemon ...
1
vote
1answer
210 views

Tar and download in one step over ssh / scp [duplicate]

(This seems like an obvious / common question, but I couldn't find it when searching - maybe I wasn't using the correct terminology...) I want to login over ssh to a remote machine, tar a directory, ...
0
votes
2answers
310 views

Download an article with cURL given a dynamic download link

I'm trying to download this published journal article using cURL. It's the main page of an open access, so there should be not problems for anyone to see/download the article. I then extract the ...
0
votes
0answers
50 views

Aria2 download html page

I'm trying to download a video using aria2, but it download the html page of the link instead the video. I've also tried the link from browser and I can download it normally. Why?
1
vote
2answers
674 views

FTP: get the latest file in sever

This is really really pain in the ass. I have a ftp server running, and it irregularly generates the latest file. The file is store as: Home->T22:30:10->new.txt, and the latest one would be (a new ...
1
vote
0answers
54 views

FTP: Removing an entire directory

Is there any way to delete a non-empty directory in Linux using FTP? I am using client, and I wish to delete the directory in a remote server. I have looked into wget and curl. What do you guys ...
0
votes
2answers
173 views

Filter hyperlinks from web page and download all that match a certain pattern

I wanted to download all graphic files from our organisation's graphics repository web page. They are Illustrator (.ai) format and Corel Draw (.cdr) format. They are directly hyperlinked (i.e. <a ...
0
votes
1answer
149 views

Re-download Corrupted Part of ISO

I have download an ISO file from one of the public FTP server. It took a lot of time to download the file because of my Internet Connection Issues. I used the wget command to download the ISO in ...
0
votes
2answers
32 views

How do I set up a .deb file?

I am trying to set up a .deb package I have downloaded. I need to know how to set it up. I do have root privileges, and I am currently running BasilOS Linux(Trinity).
3
votes
1answer
173 views

Is there a command-line method to tell if all current downloads in Chromium have finished?

Is there a command-line way to determine if all current downloads in Chromium have finished? By downloads, I mean downloading videos from Youtube. I don't want to just rely on looking at Chromium's ...
0
votes
1answer
326 views

Download Forum Attachments

Is there a way to download forum jpeg image attachments, possibly using Wget or Curl or some other tool? I would like to download jpeg attachments from specific pages on forums. I'm not interested in ...
2
votes
1answer
833 views

How do I securely download files in shell scripting?

I am writing some shell scripts to automatically download software packages off my server and set them up on customer servers. At some point within the script, the download command is wget ...
0
votes
1answer
759 views

youtube-dl problems, can't download private videos

I want to download all my private videos, but I when try it I get errors. This is the command line arguments that I'm using: youtube-dl -u "Username" -p "Password" ...
1
vote
0answers
49 views

Is there a download manager which can retrieve automatically an URL from a RSS feed?

Is there a download manager which can retrieve automatically a URL from an RSS feed, or an XML file, or even a text or HTML file (any of these options is fine)? If yes how can I configure it? I (or ...
2
votes
1answer
193 views

Wget: convert-links and avoid redownloading already fetched files?

I am downloading data spread among multiple files that don't change once published. Therefore --timestamping is not good enough, because it is constantly checking whatever resource is changed, which ...
0
votes
2answers
2k views

How to move completed torrent downloads to another folder without breaking the torrent link?

I'm using Transmission on EOs and I've downloaded a bunch of torrent files which ended up my Download folder in my /home. I'd like now to move the files to my external hard drive without breaking the ...
2
votes
1answer
64 views

I need to download Leonard Suskind video Lectures

Is there a way to download the physics video lectures using curl, mget, or wget. accessing youtube and selecting download method (MP4) takes too long. Any command line example would help greatly.
2
votes
0answers
400 views

wget resume download from dropbox gives can't write error

I want to resume download from dropbox using wget. I was downloading a file wget -O SQLyog.exe "https://www.dropbox.com/s/dfv2z0le0c2bo7z/SQLyog-9.3.3-0Trial.exe?dl=1" .......... Length: 15775640 ...
0
votes
1answer
827 views

What options does wget --report-speed take?

When I do this command: wget --report-speed=type they only type it accepts is bits. It won't have numbers, kilobits / kilobytes or bytes. The help page (wget --help) says: --report-speed=TYPE ...
2
votes
1answer
50 views

Why is my computer sluggish after downloading a lot?

When I download a lot of data (e.g. 3GB) in one go, using a program such as Transmission or Wget, progressively during the downloading, and after it has has finished, the computer always seems ...