cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

learn more… | top users | synonyms

1
vote
1answer
34 views

Can not connect to the host itself

Well, the problem is simple. I have the site based on apache and trying to execute cron job at this site from the same server. Let's say my site http://example.com and cronjob is /usr/bin/curl http:/...
1
vote
0answers
27 views

How to extract a web page text onthe basis of <p> tag [migrated]

The Punjabi Dictionary (year-1895) web page is available in Creative Commons license. How can i extract the text (words) in between the html <p> </p> tag. This video describes. But i am ...
0
votes
1answer
38 views

download a torrent file from kickass torrent from linux cli

this one has been bugging me for a while and I cannot find any answer. In fact I usually get google results for cli torrent clients rather than what I want. So rtorrent is notorious about crashing ...
0
votes
0answers
18 views

cURL hanging on connection

I am using cURL from bash script. I have this code in a loop to download multiple files from remote server curl --fail --silent ${url} -o ${local_filename} Most of the time, this works as supposed. ...
0
votes
1answer
40 views

How do I pipe the output of a curl command to an environment variable and use it in another curl command?

I have a REST endpoint that I can get an access token from. To get the access token (JSON web token, JWT) and export that value as an environment variable, I do the following. export ACCESS_TOKEN=$(...
0
votes
0answers
29 views

Why is this curl command stalling when inside a while read loop?

This curl command, when used alone, is performing its job perfectly fine. But since curl does not support wildcard or pattern globbing, and that per shellcheck errors "find commands inside for loops ...
0
votes
0answers
20 views

How to compile wget or curl with https support statically on armv5tejl?

I have an IP camera with BusyBox. It has armv5tejl architecture When I want to use wget to download something from https://.... When I try to use it with https I get an error: wget: not an http or ...
0
votes
2answers
37 views

recursively download from a website

I am trying to get images from a website url "www.example.com/products" in this products folder lots of subfolders there I need to download the products folder. In the www.example.com/products, www....
0
votes
0answers
58 views

Curl gets 200 OK, while browser shows 503

I have a bash script: code=$(curl -I -s -S --resolve $host:$port:$ip $link | grep 'HTTP/1.' | awk '{ print $2 }') if [ $code -eq 502 -o $code -eq 503 -o $code -eq 504 ]; then /usr/sbin/service ...
1
vote
0answers
33 views

How can I get a translated string from Google Translate with curl etc?

How can I get a translated string, e.g. English to Spanish, from Google Translate with some command line tools like curl? I looked at the page source but Google Translate doesn't seem to include the ...
1
vote
1answer
37 views

How to provide parameters using text file in curl?

I'm trying to pass parameters in text file and read it in curl command. Like:I added username and password in text file Sample.txt: username:"admin" password:"admin" In curl command, I'm reading ...
0
votes
1answer
20 views

Unable to download data using curl for loop

I'm trying to download data from the following link export ICTP_DATASITE='http://clima-dods.ictp.it/data/Data/RegCM_Data/EIN15/1990/' These are the codes : for type in "air hgt rhum uwnd vwnd" do ...
1
vote
0answers
23 views

round robin for curl and dnsmasq

I have setup dnsmasq to the basic configuration, pointing a file with two IP addresses. 10.0.0.1 a.b.c 10.0.0.2 a.b.c When I do nslookup or dig on a.b.c, I see round robin seems to be in effect (...
-1
votes
1answer
71 views

Curl to grab the page after complete load

I have a url which takes some time to load completely. But when I use curl to download the link as html, it download the html at the real time before loading page completely I mean complete execution ...
1
vote
1answer
51 views

Cannot Ping, nor Curl, but Nslookup works

On a freshly installed Fedora Workstation running the default Workstation spin which installs Gnome. I'm having problems getting to a web server on the LAN with my browser. The commands curl and ping ...
0
votes
1answer
70 views

Curl a string with whitespaces and characters in it? [duplicate]

I'm trying to create a "simple" script that I'm going to use to create some documentation for Unix/Mac machines. I've successfully received the information I need, but it seems like I can't send it ...
1
vote
1answer
57 views

SSL related “undefined reference” on libssh2 and libcurl libs when compiling C on OpenSUSE

I been trying to compile a C software but I'm getting 'undefined reference' over SSL libraries I think. The libraries it mentions are there, actually I compiled them all again: zlib + openssl + ...
1
vote
0answers
39 views

cURL: Java website not loading

I can access the configuration page of my device with no problems via web browser (on the GUI). But it doesn't seem to work by using cURL: luis@Fresoncio:~$ curl http://192.168.1.232 <html><...
2
votes
1answer
59 views

Continue interrupted “curl” download

I am downloading a large file over the network. while downloading (say at 40%) the underlying machine get disconnected from network and before the curl quit, the network get connected. But in this ...
3
votes
1answer
38 views

Storing stderr output in a variable without modifing stdout, and doing so repeatedly

there are many "almost duplicate" questions, but none gave me the answer I'm looking for, so bear with me. consider a simple server API, in which you can consume data in iterations, using a "...
1
vote
1answer
55 views

What is the curl equivalent of this wget command?

I'm trying to switch over part of a script from wget to curl. I have this command: wget --output-document=dl.html --quiet --timeout=10 --tries=1 $URL What's the curl equivalent of this?
0
votes
1answer
53 views

Unable to install curl on Debian

I am trying to install Curl on Debian but unfortunately I get the following error: The following packages have unmet dependencies: curl : Depends: libcurl3-gnutls (= 7.47.0-1) but 7.38.0-4+deb8u2 ...
0
votes
0answers
20 views

cURL and Iceweasel disagree about TLS certificate validity, despite same CA

On Debian Jessie 8.4 GNU/Linux, I am experiencing a certificate validation inconsistency between Iceweasel (Debian's derivative of Firefox) and cURL in relation to the URL https://profile.mensa.org.uk/...
2
votes
1answer
108 views

SSL Certificate Problem: unable to get local issuer certificate

I am having small initramfs with static busybox into it. The sole purpose of this initramfs is to download/upload files to the HTTPS server. I have the proper certificate and credentials to do so. ...
1
vote
1answer
68 views

How to enable CURL in UNIX server? [closed]

I have to make a web service call through CURL in shell script. For this, CURL should be enabled. Below is my server details: Sun Microsystems Inc. SunOS 5.10 Generic January 2005 below is ...
0
votes
0answers
40 views

How do I make Web Service call in Shell Script? [closed]

Can I make a web service call in a shell script? For example, below is a web service call through cURL: curl -u graeme:abcd -i -F name=files -F filedata=@employees.csv https://app.example.com/api/...
0
votes
1answer
39 views

OpenWRT: What devices can support cURL on internal storage?

I'm trying to install cURL on my TP-Link TL-WR740N and there's no sufficient space for it. How can I know which TP-Link router or any other OpenWRT supported device has space for cURL? Edit: Is 8 ...
3
votes
2answers
137 views

posting data using cURL in a script

I'm trying to write a simple alternative script for uploading files to the transfer.sh service. One of the examples on the website mentions a way of uploading multiple files in a single "session": $ ...
1
vote
1answer
56 views

BASH Script for logging in to Website

I've tried many solutions provided here in other forums and websites. Like this: #curl -A "Mozilla/4.73 [en] (X11; U; Linux 2.2.15 i686)" \ #--cookie cjar --cookie-jar cjar \ #--data "username=name" ...
1
vote
1answer
73 views

Pass a list of URLs contained in a file to curl

I have to set ACL on a multiple files. I have downloaded a list of object stored using below commands. C:\Users\Gshrivastava\Downloads\curl_748_0>curl -o urlname.csv -i -k -H "Authorization: ...
0
votes
2answers
76 views

How to get a correct error code from curl when transfer was closed before getting the whole file

I have a bash-script which calls curl using a proxy. Today there is a problem with the download location. Calling curl ends up with: curl: (18) transfer closed with 7512708716 bytes remaining to ...
0
votes
0answers
644 views

cURL doesn't connect to HTTPS while wget does (NSS error -12286)

I'm getting error NSS error -12286 while downloading a file from HTTPS using curl. I can download the same file without issues using wget so I can exclude any firewall or blacklist issues. Already ...
1
vote
1answer
44 views

unzip/untar files using Curl in ftp server

In the curl command we can delete,rename and move files from a FTP server using Curl like in the command below: curl -v -u username:pwd ftp://host/FileTodelete -Q "DELE FileTodelete" Can we untar ...
1
vote
1answer
113 views

Using Named Pipes in Bash created in a C Program

I have a C code that takes a rather large input. At every iteration, it processes a small chunk of it and it should send that processed chunk to S3 using curl. In the end, it will generate a number of ...
0
votes
1answer
247 views

Parse xml returned from curl within a bash script

I've been digging through stackexchange for the past few days and I've found bits and pieces of what I'm trying to accomplish, but I'm unsure how to put it all together... I'm trying to create a ...
3
votes
1answer
244 views

curl outfile variable not working in bash script

Attempting to shorten a bash script that uses curl to fetch multiple API calls takes something like this: curl --user $USER:$PASS https://api.example.com/foo -o 'foo.json' curl --user $USER:$PASS ...
1
vote
2answers
45 views

How to treat remote txt file as stream?

A web service writes its output in a text file. I can fetch that log via: curl -u user:password -k https://log.my-app.com/log.2016-04-04.txt Yet this always only fetches a current "full" file even ...
1
vote
1answer
45 views

Cronjob Create File Every Execute

I can create a cron job for every 5 minutes with following codes: */5 * * * * root bash /etc/cron.d/mongo/5min.sh In the /etc/cron.d/mongo/5min.sh file send request with cURL: #!/bin/sh ...
1
vote
1answer
126 views

bash scripting - wget or curl file with action based on the status 200 or not

I would like to write a script where I try to download a file with wget (or curl if is really not something that can be done with wget) and do 2 actions if the file exists and it's downloaded ...
1
vote
1answer
51 views

curl load IPs from Text file

I have a list of IPs and want to run a specific curl command on each of them. The command is: curl --user test:test http://192.168.1.1/security/pkm.html | egrep '@company|config.pkm.password' ...
0
votes
2answers
111 views

Curl and Grep to Parsing Content

I need to parse the output of a curl command: curl --user test:test http://192.168.1.1/security/pkm.html | egrep '@company|config.pkm.password' This returns: <input type="text" id="config.pkm....
1
vote
1answer
79 views

How to pipe html into lynx?

I am testing some ajax call from the console. I like get rid of the meta-information noise that is html markup and just read the content, hence I like to pipe it into a terminal browser, e.g. lynx. ...
1
vote
0answers
113 views

php curl script working in cli but not on crontab [closed]

I have set the following on crontab */1 * * * * /opt/php-5.3/bin/php -f /var/httpd/appliance/appliance/docs/vip_dashboard_script.php >> /tmp/vip.log 2>&1 the contents of my script. &...
1
vote
3answers
428 views

POST json data with cURL from a while loop - bash shell

I have a JSON output from which I need to extract an ID and Iterate through them and send multiple request to API execute REST API with curl. For example: This is how the JSON output looks like: { ...
0
votes
1answer
31 views

Problems with crontab du to curl

I am trying to send the output of a treesize command to my webserver for further processing. This is not going well, I guess mainly because I am very new to Linux/Debian7 :). Hope you can help me. ...
1
vote
1answer
58 views

How can I give an argument as an external file to curl with url encode?

I try to request query.wikidata.org using curl. The following command line works perfectly : $ curl -G https://query.wikidata.org/bigdata/namespace/wdq/sparql --data-urlencode query='PREFIX wd: &...
0
votes
1answer
57 views

How to grep response to figure out how many calls got timed out?

I have a curl command which is calling one of our service so if my service timesout, it returns JSON response like below: [{"results":{"response":null},"error":{"errorCode":1001,"message":"Service ...
0
votes
1answer
30 views

wget TLSv1 behaves the same as TLSv1_2

I used wireshark to compare curl --tlsv1.0 vs --tlsv1.2 The server handshake obediently uses TLSv1.0 for servers that support it (the point is to check to validate they don't): wget url --no-check-...
0
votes
0answers
36 views

Curl ebay multi page ebay api xml to a single text file

I am using the curl -K url.txt > output.txt command to transfer the xml output of an ebay api search to a text file. The search I am performing is multi page, but I am unsure how to export ...
-1
votes
1answer
131 views

WGET encountering 403 when trying to access filter - nginx [closed]

I'm trying to download some images from an asset folder of a site, that folder happens to be forbidden. I've tried various suggestions online including a referrer flag for google.com and setting the ...