The tag has no usage guidance.

learn more… | top users | synonyms

2
votes
1answer
27 views

Can I use wget to download all files recursively, but not their actual content?

Sometimes, I wish to only get the directory structure of a website, but the files themselves are not important. I only want their name. Sort of like a mirror where every entry is just an empty dummy ...
-1
votes
0answers
22 views

Windows Internet Download Manager alternative for Linux

Windows has a famous program called internet download manager. This is the only last software which has kept me from fully migrating to linux from windows. Is there any credible alternative for the ...
2
votes
1answer
46 views

Continue interrupted “curl” download

I am downloading a large file over the network. while downloading (say at 40%) the underlying machine get disconnected from network and before the curl quit, the network get connected. But in this ...
1
vote
0answers
35 views

Problem with downloading large file from internet

Since a while ago, whenever I am downloading a large file with maven it takes a long time. I also tried with just wget and still had the same problem. It will freeze for 10 or more minutes after ...
1
vote
2answers
63 views

Check in pure bash that the download is complete

short story is, I probably need a simple loop in bash which checks periodically whether the size of a given file has changed or not since last checked. Long story, I will be downloading a file ...
-1
votes
1answer
46 views

grab git repo from multiple sources in Yocto recipe

I am trying to retrieve sources from multiple git repos in a Yocto recipe. I used SRC_URI = "git://<git_repo_uri>;protocol=ssh;rev=<revision> \ git://<git_repo_uri>;...
0
votes
0answers
69 views

Very slow download from FTP-site, must wait for control-connection to close between operations

I'm trying to recursively download some files and directories (some with sub-directories) from a FTP-site with wget, but it's turning-out to be a painfully slow process. It seems like I'm only able ...
3
votes
2answers
241 views

How to check if a video is completely downloaded?

I have a bunch of videos which I want to check if they are complete or not. Some of them may be downloaded partially, but they are not faulty. How can I efficiently check if these video are completely ...
0
votes
2answers
36 views

How to download remotely by sending URL

I've been trying to search but keep getting results on how to remotely install Linux and how to send files to another Linux computer, and can't find what I'm trying to do. I would like to be able to ...
0
votes
1answer
89 views

wget mirror site + resources from other domain

I'm trying to download a website so it can be browsed offline, so I want the html, images, css, javascript, etc. The problem is that the images are not all hosted on the same domain as the website, ...
0
votes
2answers
35 views

Problem in installing new software - RHEL6

I am currently having difficulty in installing new software/plugins on my rhel6 work pc. I don't have any internet connection on it and have to download anything I require on a separate internet PC (...
1
vote
2answers
71 views

downloading images from webpage with different links

I am trying to download all the images from a webpage. The images are included as follows: <img src="https://alwaysSamePart.com/SomeRandomLinkThatVaries.jpg"> How should I parametrize my wget ...
0
votes
1answer
117 views

How do you make apt-get install faster? [closed]

I just installed Debian for the first time in a virtual-machine (I have used centos/RHEL/fedora for the last 11 years so I have some Linux experience). I did an apt-get install gcc... the command took ...
2
votes
2answers
51 views

treating web page like directory

I'm a Mac user and I want to cd to a web page and then cp some files onto a local directory. Is there a way to do this? This is the page I'm referring to: http://www0.cs.ucl.ac.uk/staff/M.Herbster/...
-3
votes
1answer
51 views

Why wget is not willing to download recursively?

The command $ wget -r http://www.comp.brad.ac.uk/research/GIP/tutorials/index.html only downloads index.html and robots.txt for me, even though there are links in it to further pages in the same ...
0
votes
0answers
108 views

Google Drive HTTP Error when downloading .zip file with Firefox

I'm using openSUSE 42.1 and opened a fresh install of Firefox, but somehow when I try to download a zip file from my Google Drive, an error is shown: Could not download "[filename]". HTTP error. ...
1
vote
2answers
74 views

Can I download tar.gz file while it is being compressed?

I am compressing a huge directory which could be more than 10 GB, It takes time to compress it. But at the same time, I have to download this to another new server. So while the compressing is going ...
0
votes
1answer
98 views

Download files from the file with same path directory

I need a simple command/script which allows me to download hundreds of files from the file in the same path structure as on the remote server. For example: http://download.com/path/to/the/folder/...
1
vote
2answers
64 views

How do I quickly transfer a large archive (~16GB)

How do I quickly transfer a large archive (~16GB) from one mount point to another on 80 servers? The mount points are on separate partitions. I tried ansible (with the -f 100 option) and a bash script ...
3
votes
2answers
139 views

Extract compressed file by it's header as it is piped from stdout (locally or from remote location)?

I am sending compressed file with piping either local or from a network location. And on the receiving end, I would like to detect the type of compression and use the appropriate decompression utility ...
1
vote
3answers
82 views

Downloading a few thousand files - how?

I want to download a few thousand files one by one. The average size of each one is 5-10Mb. Each has a name of "name_{i}", where "i" is a counter. What's the easiest and best way to do that? Note ...
2
votes
2answers
287 views

downloading a file once and playing it multiple times

I want to play youtube videos on a loop from my terminal using mplayer, and for that I've written the following code taking pieces from here and there: #!/bin/bash if [[ $(echo $*) ]]; then ...
1
vote
1answer
68 views

Linux Gateway as Download Accelerator like IPCop's

We're running dnsmasq on a linux box inside our network for DHCP and DNS. I would like to add a download accelerator like IPCop's (http://blockouttraffic.de/ua_index.php) but without having IPCop as ...
-1
votes
1answer
61 views

Create Automate Task to download and search in PDF and notify

I want to create an Automate Task to hourly download a PDF from a specific URL and then search for certain text like "6256896" and then if there was the text inside the PDF,notifies me for example ...
0
votes
1answer
80 views

How do I download log4j on ec2 instance?

The link to download log4j is here. However I have logged into the my EC2 instance. Whats the command line to download this log4j ?
0
votes
0answers
23 views

Calculate the correct MBit/s in my speedtest

I know wget is usually showing the speed in a summary. But in my small OpenWRT shell, I want to test how long it takes to download 100MB with t=$(date +"%s") wget http://speedtest.netcologne.de/...
0
votes
1answer
111 views

Continuing an interrupted `wget` session?

Is it possible to continue an interrupted wget session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget store additional information to disk (like it's list over ...
1
vote
1answer
102 views

Iceweasel doesn't open downloads correctly

When I try to open a tarball from the downloads directory with iceweasel it opens it with the VLC-Player. Can I change this behavior?
0
votes
0answers
1k views

How to download files and folders from Onedrive using wget?

How to use wget to download files from Onedrive? (and batch files and entire folders, if possible)
0
votes
1answer
91 views

Can I check a suspect .zip file without downloading it?

I am using Linux Fedora 20 and BT Yahoo mail. I have received an email with an attached .zip file, but I suspect that it might be malicious and dangerous even to download the attachment -- it might ...
1
vote
1answer
35 views

Is there a conventional place in Unix to store downloaded packages?

Working in a Unixy system, I am often confused by where to store downloaded packages. For example, I'm trying to install Spark on OSX, following these instructions. When I get to tar -xvzf spark-1....
0
votes
1answer
31 views

Is it okay to partition my drive while I'm downloading a huge file (4gb)

I'm downloading a huge file using a torrent client and I was wondering if I can use GParted to partition around 100gb of my 1tb to save time because I plan to dual boot this computer right after the ...
1
vote
0answers
140 views

How to download thousands of files quickly?

I need to download thousands of files (approximately 2-12 MB each) - Currently I am using the following command wget --reject "index.html*" -A *.gz -N -r -l1 -nd --no-check-certificate --user ...
0
votes
0answers
88 views

Download Hotlinked Images from Forum from Command Line

From the command line, is it possible to download linked images posted on forums? I want to enter the forum thread url and maybe stipulate which image hosts to detect. Also some threads will have ...
0
votes
0answers
769 views

Can't download all of specified webpages by using wkhtmltopdf

i try to download the webpages specified as a list of urls in a text file urls, and convert and merge them to a single pdf file, by running: $ wkhtmltopdf $(cat urls) all.pdf Loading pages (1/6) ...
1
vote
0answers
74 views

Download a webpage by putting everything it needs in a dedicated directory?

To download a webpage ( its html file and other files needed by it), wget seems to mirror the directory structure of the files of the webpage on the website server When in a web browser (e.g. Firefox ...
1
vote
3answers
8k views

download file from Internet to server using SSH

Recently because of some problem, I lost all my server files and requested the hosting team to provide me my files from a backup. They will provide me a link from which I have to download a compressed ...
1
vote
1answer
842 views

checksum failed on workstation live fedora 22 64bit download

I downloaded the iso from https://getfedora.org/en/workstation/download/ Next, I attempted to follow the instructions at https://getfedora.org/en/verify I downloaded the checksum file from the ...
1
vote
1answer
523 views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
2
votes
1answer
862 views

For Loop for Google Image Downloading Bash Script

I have a bash script which downloads images from Google Images. This is the command I use: bash getimages.sh 3 rocky%20mountains That command will download the 3rd picture in Google Images. To ...
3
votes
1answer
122 views

wget on the fly to extract specific info from file without downloading the entire file

I have some files (which are in .bam format(binary)) to download from a location. I can download them using wget and then want to extract some specific information from them only. For that I use ...
8
votes
3answers
4k views

command-line tool for a single download of a torrent (like wget or curl)

I'm interested in a single command that would download the contents of a torrent (and perhaps participate as a seed following the download, until I stop it). Usually, there is a torrent-client daemon ...
1
vote
1answer
473 views

Tar and download in one step over ssh / scp [duplicate]

(This seems like an obvious / common question, but I couldn't find it when searching - maybe I wasn't using the correct terminology...) I want to login over ssh to a remote machine, tar a directory, ...
0
votes
2answers
604 views

Download an article with cURL given a dynamic download link

I'm trying to download this published journal article using cURL. It's the main page of an open access, so there should be not problems for anyone to see/download the article. I then extract the ...
0
votes
0answers
61 views

Aria2 download html page

I'm trying to download a video using aria2, but it download the html page of the link instead the video. I've also tried the link from browser and I can download it normally. Why?
1
vote
2answers
968 views

FTP: get the latest file in sever

This is really really pain in the ass. I have a ftp server running, and it irregularly generates the latest file. The file is store as: Home->T22:30:10->new.txt, and the latest one would be (a new ...
1
vote
0answers
69 views

FTP: Removing an entire directory

Is there any way to delete a non-empty directory in Linux using FTP? I am using client, and I wish to delete the directory in a remote server. I have looked into wget and curl. What do you guys ...
0
votes
2answers
264 views

Filter hyperlinks from web page and download all that match a certain pattern

I wanted to download all graphic files from our organisation's graphics repository web page. They are Illustrator (.ai) format and Corel Draw (.cdr) format. They are directly hyperlinked (i.e. <a ...
0
votes
1answer
206 views

Re-download Corrupted Part of ISO

I have download an ISO file from one of the public FTP server. It took a lot of time to download the file because of my Internet Connection Issues. I used the wget command to download the ISO in Linux....
0
votes
2answers
32 views

How do I set up a .deb file?

I am trying to set up a .deb package I have downloaded. I need to know how to set it up. I do have root privileges, and I am currently running BasilOS Linux(Trinity).