The tag has no usage guidance.

learn more… | top users | synonyms

1
vote
2answers
52 views

Check in pure bash that the download is complete

short story is, I probably need a simple loop in bash which checks periodically whether the size of a given file has changed or not since last checked. Long story, I will be downloading a file ...
-1
votes
1answer
28 views

grab git repo from multiple sources in Yocto recipe

I am trying to retrieve sources from multiple git repos in a Yocto recipe. I used SRC_URI = "git://<git_repo_uri>;protocol=ssh;rev=<revision> \ ...
-1
votes
0answers
47 views

Can someone help me make a Youtube-DL script?

I would like a youtube-DL script which could download all the playlists on a channel in audio format (mp3?), but also some playlists in video format. Each playlist must be in its own directory (called ...
0
votes
0answers
45 views

Very slow download from FTP-site, must wait for control-connection to close between operations

I'm trying to recursively download some files and directories (some with sub-directories) from a FTP-site with wget, but it's turning-out to be a painfully slow process. It seems like I'm only able ...
3
votes
2answers
170 views

How to check if a video is completely downloaded?

I have a bunch of videos which I want to check if they are complete or not. Some of them may be downloaded partially, but they are not faulty. How can I efficiently check if these video are completely ...
0
votes
2answers
34 views

How to download remotely by sending URL

I've been trying to search but keep getting results on how to remotely install Linux and how to send files to another Linux computer, and can't find what I'm trying to do. I would like to be able to ...
0
votes
1answer
52 views

wget mirror site + resources from other domain

I'm trying to download a website so it can be browsed offline, so I want the html, images, css, javascript, etc. The problem is that the images are not all hosted on the same domain as the website, ...
0
votes
2answers
35 views

Problem in installing new software - RHEL6

I am currently having difficulty in installing new software/plugins on my rhel6 work pc. I don't have any internet connection on it and have to download anything I require on a separate internet PC ...
1
vote
2answers
56 views

downloading images from webpage with different links

I am trying to download all the images from a webpage. The images are included as follows: <img src="https://alwaysSamePart.com/SomeRandomLinkThatVaries.jpg"> How should I parametrize my wget ...
0
votes
1answer
104 views

How do you make apt-get install faster? [closed]

I just installed Debian for the first time in a virtual-machine (I have used centos/RHEL/fedora for the last 11 years so I have some Linux experience). I did an apt-get install gcc... the command took ...
2
votes
2answers
46 views

treating web page like directory

I'm a Mac user and I want to cd to a web page and then cp some files onto a local directory. Is there a way to do this? This is the page I'm referring to: ...
-3
votes
1answer
42 views

Why wget is not willing to download recursively?

The command $ wget -r http://www.comp.brad.ac.uk/research/GIP/tutorials/index.html only downloads index.html and robots.txt for me, even though there are links in it to further pages in the same ...
0
votes
0answers
102 views

Google Drive HTTP Error when downloading .zip file with Firefox

I'm using openSUSE 42.1 and opened a fresh install of Firefox, but somehow when I try to download a zip file from my Google Drive, an error is shown: Could not download "[filename]". HTTP error. ...
1
vote
2answers
61 views

Can I download tar.gz file while it is being compressed?

I am compressing a huge directory which could be more than 10 GB, It takes time to compress it. But at the same time, I have to download this to another new server. So while the compressing is going ...
0
votes
1answer
85 views

Download files from the file with same path directory

I need a simple command/script which allows me to download hundreds of files from the file in the same path structure as on the remote server. For example: ...
1
vote
2answers
64 views

How do I quickly transfer a large archive (~16GB)

How do I quickly transfer a large archive (~16GB) from one mount point to another on 80 servers? The mount points are on separate partitions. I tried ansible (with the -f 100 option) and a bash script ...
3
votes
2answers
132 views

Extract compressed file by it's header as it is piped from stdout (locally or from remote location)?

I am sending compressed file with piping either local or from a network location. And on the receiving end, I would like to detect the type of compression and use the appropriate decompression utility ...
1
vote
3answers
82 views

Downloading a few thousand files - how?

I want to download a few thousand files one by one. The average size of each one is 5-10Mb. Each has a name of "name_{i}", where "i" is a counter. What's the easiest and best way to do that? Note ...
2
votes
2answers
280 views

downloading a file once and playing it multiple times

I want to play youtube videos on a loop from my terminal using mplayer, and for that I've written the following code taking pieces from here and there: #!/bin/bash if [[ $(echo $*) ]]; then ...
1
vote
1answer
60 views

Linux Gateway as Download Accelerator like IPCop's

We're running dnsmasq on a linux box inside our network for DHCP and DNS. I would like to add a download accelerator like IPCop's (http://blockouttraffic.de/ua_index.php) but without having IPCop as ...
-1
votes
1answer
57 views

Create Automate Task to download and search in PDF and notify

I want to create an Automate Task to hourly download a PDF from a specific URL and then search for certain text like "6256896" and then if there was the text inside the PDF,notifies me for example ...
0
votes
1answer
57 views

How do I download log4j on ec2 instance?

The link to download log4j is here. However I have logged into the my EC2 instance. Whats the command line to download this log4j ?
0
votes
0answers
22 views

Calculate the correct MBit/s in my speedtest

I know wget is usually showing the speed in a summary. But in my small OpenWRT shell, I want to test how long it takes to download 100MB with t=$(date +"%s") wget ...
0
votes
1answer
101 views

Continuing an interrupted `wget` session?

Is it possible to continue an interrupted wget session - eg. by parsing the log-file (created with -o or -a ), or after somehow have wget store additional information to disk (like it's list over ...
1
vote
1answer
96 views

Iceweasel doesn't open downloads correctly

When I try to open a tarball from the downloads directory with iceweasel it opens it with the VLC-Player. Can I change this behavior?
0
votes
0answers
1k views

How to download files and folders from Onedrive using wget?

How to use wget to download files from Onedrive? (and batch files and entire folders, if possible)
0
votes
1answer
86 views

Can I check a suspect .zip file without downloading it?

I am using Linux Fedora 20 and BT Yahoo mail. I have received an email with an attached .zip file, but I suspect that it might be malicious and dangerous even to download the attachment -- it might ...
1
vote
1answer
35 views

Is there a conventional place in Unix to store downloaded packages?

Working in a Unixy system, I am often confused by where to store downloaded packages. For example, I'm trying to install Spark on OSX, following these instructions. When I get to tar -xvzf ...
0
votes
1answer
31 views

Is it okay to partition my drive while I'm downloading a huge file (4gb)

I'm downloading a huge file using a torrent client and I was wondering if I can use GParted to partition around 100gb of my 1tb to save time because I plan to dual boot this computer right after the ...
1
vote
0answers
125 views

How to download thousands of files quickly?

I need to download thousands of files (approximately 2-12 MB each) - Currently I am using the following command wget --reject "index.html*" -A *.gz -N -r -l1 -nd --no-check-certificate --user ...
0
votes
0answers
83 views

Download Hotlinked Images from Forum from Command Line

From the command line, is it possible to download linked images posted on forums? I want to enter the forum thread url and maybe stipulate which image hosts to detect. Also some threads will have ...
0
votes
0answers
711 views

Can't download all of specified webpages by using wkhtmltopdf

i try to download the webpages specified as a list of urls in a text file urls, and convert and merge them to a single pdf file, by running: $ wkhtmltopdf $(cat urls) all.pdf Loading pages (1/6) ...
1
vote
0answers
69 views

Download a webpage by putting everything it needs in a dedicated directory?

To download a webpage ( its html file and other files needed by it), wget seems to mirror the directory structure of the files of the webpage on the website server When in a web browser (e.g. Firefox ...
1
vote
3answers
7k views

download file from Internet to server using SSH

Recently because of some problem, I lost all my server files and requested the hosting team to provide me my files from a backup. They will provide me a link from which I have to download a compressed ...
1
vote
1answer
781 views

checksum failed on workstation live fedora 22 64bit download

I downloaded the iso from https://getfedora.org/en/workstation/download/ Next, I attempted to follow the instructions at https://getfedora.org/en/verify I downloaded the checksum file from the ...
1
vote
1answer
483 views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
2
votes
1answer
793 views

For Loop for Google Image Downloading Bash Script

I have a bash script which downloads images from Google Images. This is the command I use: bash getimages.sh 3 rocky%20mountains That command will download the 3rd picture in Google Images. To ...
2
votes
1answer
116 views

wget on the fly to extract specific info from file without downloading the entire file

I have some files (which are in .bam format(binary)) to download from a location. I can download them using wget and then want to extract some specific information from them only. For that I use ...
8
votes
3answers
3k views

command-line tool for a single download of a torrent (like wget or curl)

I'm interested in a single command that would download the contents of a torrent (and perhaps participate as a seed following the download, until I stop it). Usually, there is a torrent-client daemon ...
1
vote
1answer
381 views

Tar and download in one step over ssh / scp [duplicate]

(This seems like an obvious / common question, but I couldn't find it when searching - maybe I wasn't using the correct terminology...) I want to login over ssh to a remote machine, tar a directory, ...
0
votes
2answers
526 views

Download an article with cURL given a dynamic download link

I'm trying to download this published journal article using cURL. It's the main page of an open access, so there should be not problems for anyone to see/download the article. I then extract the ...
0
votes
0answers
56 views

Aria2 download html page

I'm trying to download a video using aria2, but it download the html page of the link instead the video. I've also tried the link from browser and I can download it normally. Why?
1
vote
2answers
873 views

FTP: get the latest file in sever

This is really really pain in the ass. I have a ftp server running, and it irregularly generates the latest file. The file is store as: Home->T22:30:10->new.txt, and the latest one would be (a new ...
1
vote
0answers
63 views

FTP: Removing an entire directory

Is there any way to delete a non-empty directory in Linux using FTP? I am using client, and I wish to delete the directory in a remote server. I have looked into wget and curl. What do you guys ...
0
votes
2answers
241 views

Filter hyperlinks from web page and download all that match a certain pattern

I wanted to download all graphic files from our organisation's graphics repository web page. They are Illustrator (.ai) format and Corel Draw (.cdr) format. They are directly hyperlinked (i.e. <a ...
0
votes
1answer
191 views

Re-download Corrupted Part of ISO

I have download an ISO file from one of the public FTP server. It took a lot of time to download the file because of my Internet Connection Issues. I used the wget command to download the ISO in ...
0
votes
2answers
32 views

How do I set up a .deb file?

I am trying to set up a .deb package I have downloaded. I need to know how to set it up. I do have root privileges, and I am currently running BasilOS Linux(Trinity).
3
votes
1answer
224 views

Is there a command-line method to tell if all current downloads in Chromium have finished?

Is there a command-line way to determine if all current downloads in Chromium have finished? By downloads, I mean downloading videos from Youtube. I don't want to just rely on looking at Chromium's ...
0
votes
1answer
416 views

Download Forum Attachments

Is there a way to download forum jpeg image attachments, possibly using Wget or Curl or some other tool? I would like to download jpeg attachments from specific pages on forums. I'm not interested in ...
2
votes
1answer
993 views

How do I securely download files in shell scripting?

I am writing some shell scripts to automatically download software packages off my server and set them up on customer servers. At some point within the script, the download command is wget ...