Questions tagged [curl]

cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

Filter by
Sorted by
Tagged with
1
vote
0answers
421 views

Curl is not supporting SSL (./configure --with-ssl)

I am trying to install curl in opensuse Leap 15.0. I have downloaded the .zip file from this link (version 7.63.0) I am running this command from the curl root directory: ./configure --with-ssl=/usr/...
0
votes
2answers
51 views

How to save a web resource, applying decoding to URL Encoded Characters?

I would like to save this file with this URL "http://pti.regione.sicilia.it/portal/page/portal/PIR_PORTALE/PIR_LaStrutturaRegionale/PIR_AssessoratoEconomia/PIR_DipBilancioTesoro/PIR_Areetematiche/...
-1
votes
1answer
34 views

How to download AWS documentation using linux terminal?

I tried to download AWS documentation using wget and curl commands. I realized and turned off robot and set Mozilla as browser header. But still failed to recursively download the entire documents.
0
votes
1answer
215 views

CURL Not Following Redirect

I am trying to setup a page that redirects to an sh file so I don't have to lookup the actual URL when I need it, but I can't get curl to follow the redirect even when using -L. what am I doing wrong? ...
-7
votes
1answer
860 views

Does HTTP `TRACE` method do the same thing as `curl --trace`?

Does HTTP TRACE method do the same thing as curl --trace? Stephen said at Does `curl -v` show the complete HTTP request including the body?: the TRACE HTTP method affects the server’s behaviour, ...
0
votes
1answer
4k views

What HTTP request and response headers do `curl --cert` and `curl --cacert` read and write?

From https://curl.haxx.se/docs/httpscripting.html In the HTTPS world, you use certificates to validate that you are the one you claim to be, as an addition to normal passwords. Curl supports ...
-3
votes
1answer
594 views

What is the purpose of “use curl --cookie with a file that doesn't exist”?

From https://curl.haxx.se/docs/httpscripting.html Curl's "cookie engine" gets enabled when you use the --cookie option. If you only want curl to understand received cookies, use --cookie with a ...
3
votes
1answer
10k views

Does `curl -v` show the complete HTTP request including the body?

I thought user=user&password=password will be in the body of the request, but I can't find it. Where is it? Does -v show the complete request including the body? Thanks. $ curl --data "user=user&...
-1
votes
1answer
38 views

Which methods does curl use in these two cases for authentication, GET or POST?

You can opt to either insert the user and password in the URL or you can provide them separately: curl http://user:password@example.org/ or curl -u user:password http://example.org/ Which methods ...
2
votes
1answer
390 views

Protocol SSL is not working with Curl

I am trying to clone Wayland repository from git (for a project) but git clone command is throwing me an error. I installed curl (from here). After cloning make && make install. Earlier I had ...
0
votes
1answer
237 views

Curl hangs after Accept

I have connectivity in both ways from the client to the server as my nc command to port 80 gives [tcp/http] succeeded! in both ways. I'm able to do curl post locally in the server. but couldn't do ...
1
vote
1answer
68 views

Are these commands materially, or only semantically different?

In a shell script that's using curl to fetch a script, then executing it, are these two approaches materially different? curl http://address-to-some-script/dosomething.sh | sudo tee /usr/bin/...
0
votes
0answers
21 views

problem installing curl [duplicate]

I am currently running kali linux(light, 64 bit) on a multiboot usb using YUMI and i'm trying to install curl but it needs additional storage, what should you suggest?
0
votes
2answers
74 views

Working with grep

I am try to fetch all the links from materialdesignicons.com! I do the following: curl -X GET https://materialdesignicons.com | grep -i "<link href=" | grep -v "<link href=" But it doesn't ...
2
votes
0answers
184 views

PHP Curl when accessing SSL slows down connection. How to correct?

After migrating to a new server, our scripts slowed down dramatically. Some troubleshooting showed that the slowdown occurred during Curl connections as the server was trying to load the SSL cert. ...
1
vote
1answer
399 views

bash curl post request set timeout

I make a post request from url like this curl -s -X POST http://site.com -d "data:data" The thing is that I want to set a timeout for the url I am sending the post request to. I tried -m 5, but ...
1
vote
1answer
709 views

curl doesn't work in bash loop

I run this command in a single bash file to post the data to a url and get the response curl -s -X POST $url -d "username=username" It outputs the response body. All good But I want to automate ...
2
votes
1answer
927 views

Capture http token with tcpdump

My server runs curl commands to some API using a token. For example: curl --header "Private-Token: aaaaaaaaaaaaaa" http://mysite.example.com/api/v4/any Can i capture with tcpdump all of the requests ...
11
votes
1answer
3k views

how to make Gnu/Linux trust a certificate that's trusted by Windows out-of-the-box?

There is a server with a broken SSL chain, as reported by this SSL check: I know this is a problem that should be solved on the server itself, but sometimes this is hard to have fixed (I'm not the ...
0
votes
1answer
801 views

bash and curl commands gets errors : bash: /dev/fd/63: No such file or directory and curl: (23) Failed writing body (0 != 8192)

I am trying to install Litespeed in my Debian instance under Google cloud. I try : sudo bash <( curl https://get.litespeed.sh ) my_serial_number I get : bash: /dev/fd/63: No such file or ...
1
vote
0answers
103 views

How to set connect-timeout value of curl more than 120 sec in linux systems?

Tried curl with connect-timeout value more than 120 sec but it is not waiting for specified time. It stops trying to connect after 120 sec eventhough inputted connect-timeout is 180 sec(more than 120 ...
0
votes
2answers
89 views

Make a list of URLs if webpages contain specific text [closed]

I am trying to make a list of URLs of webpages, based on whether the webpages contain the text "XYZ". The URLs are of the form: https://www.website.tld/page.php?var1=???&var2=static ??? is a ...
0
votes
1answer
1k views

How to download https file in AIX without wget and curl? [duplicate]

In an UNIX environment running AIX where I'm a not privileged user (without sudo) if I need to download a file from HTTPS server and there is no wget or curl... How I do it? Is there any replacement ...
1
vote
1answer
821 views

Variable inside a curl Array [duplicate]

How to put the variable "user" in this array. The way it is not it doesn't work sadly. The $user variable should be john.smith for example. I have the following output: curl --header "Authorization: ...
2
votes
1answer
693 views

Alternatives to cURL/wget for remote API calls

I'm on IBM AIX 7.1 where cURL and wget are not available. Also, I'm not in a position to install either. Are there alternatives that would be available that would enable remote API calls using GET/...
0
votes
1answer
27 views

MacOS parsing for ASN

I use MaxMind API to get IP Address data. What I am looking for is the country and the ASN. The MaxMind API works as follow: curl -s http://geoip.maxmind.com/e\?l\={APIKEY}\&i\={IP} And returns ...
0
votes
1answer
2k views

What does curl -sS means?

man curl says: -S, --show-error When used with -s it makes curl show an error message if it fails. If curl -S (uppercase) will show error instead an alleged default silent mode, then I don't ...
1
vote
1answer
183 views

curl download file and name it <custom-name>.<provided-extension>

Say I have a bunch of URLs like this: https://domain.com/foo/bar/2d9ec0354908e055acf372 From the URL I don't know what the extension is, and I don't have any other "frontend" information to tell me ...
1
vote
1answer
2k views

using variables inside the curl command not working in bash script

I am trying to write a bash script to update certain nodes in my repository. I wrote below script, but it does not seem to be working when I use variables inside curl. Below is the code. I tried all ...
24
votes
6answers
14k views

What are the alternatives for checking open ports, besides telnet?

We can use the following in order to test telnet VIA port; in the following example we test port 6667: [root@kafka03 ~]# telnet kafka02 6667 Trying 103.64.35.86... Connected to kafka02. Escape ...
1
vote
0answers
142 views

curl stops working when used in combination with xargs [duplicate]

I need to check a list of domains in parallel. So I was planning on using curl and xargs. This is check.sh: #!/bin/bash domain=${1?Pass the domain as a parameter} curl -o /dev/null --silent --write-...
3
votes
2answers
1k views

Run curl commands in parallel using xargs with inputs from csv

I have a csv file with several columns including a sequence number and an image URL. The file is 450+ lines. 1,text1,text2,http://image_a.jpg 2,text1,text2,http://image_b.jpg 3,text1,text2,http://...
1
vote
1answer
49 views

why do I get the monitoring information from curl in some case and not in other case?

When I run the following command in an interactive bash shell: $ curl ipinfo.io/ip 123.45.67.890 If I create /etc/cron.d/myjob: 24 * * * * tim ( date && curl ipinfo.io/ip && date ) &...
1
vote
1answer
850 views

Difference between cURL's cookie-jar option and browser cookie?

I'm trying to login to a website using curl and HTTP requests. With the first http GET request I add -c cookie.txt to the command to save the cookie to a file. For the second curl POST I add -b ...
0
votes
1answer
100 views

Comparing the `time_total` of two curl requests to different sites

I know that I can get the time_total of of curl request by using this command: curl https://www.google.com -s -o /dev/null -w "%{time_total}\n" Is there any way for me to easily compare the results ...
0
votes
2answers
909 views

Concatenate and use multi line variable in multi line curl execution

With this code #!/bin/bash set -x PROPERTIES="MAINTAINER=Self, My" while IFS='=' read -r key value do ADDITIONAL_PARAMETERS+="-F variables[${key}]=${value} " done <<< "${PROPERTIES}" #...
0
votes
3answers
2k views

Verify if a URL exists

I would like to verify if a URL exists without downloading. I am using below with curl: if [[ $(curl ftp://ftp.somewhere.com/bigfile.gz) ]] 2>/dev/null; then echo "This page exists." else ...
1
vote
1answer
35 views

Transferring a file to two destinations efficiently

At present I am creating a backup file and using curl to send it to a remote host, using: tar -cvzf - ./folder | curl -u user:pwd ftp://example.com/folder/backup.tar.gz --ftp-create-dirs -T - I also ...
0
votes
1answer
44 views

Fetching title of browser

[Fetching user title] Seen a post prior of someone posting how to do it by single account I wish to do this from the range 1-1000 and have it output to >> .txt Example: x@nine:~# wget -qO- 'http:...
2
votes
0answers
147 views

libcurl post request from debian 7 to debian 9 gnutls handshake error

I have a problem with libcurl returning an SSL error, let me describe the situation: There are two machines with Debian, the client is Debian 7 and the server is Debian 9, the client uses libcurl to ...
0
votes
2answers
3k views

Curl : Read headers from a file and use them in a cURL command

I have a bash script with the following curl command : curl -v -X GET https://example.com -H ~/Desktop/headers.txt -o ~/Desktop/file.txt When i run the bash script i am getting unothorized 401. ...
-4
votes
2answers
388 views

Automate the command curl to download multiple URLs

How can I run curl on multiple URLs example: curl https://google.com/1 curl https://google.com/2 curl https://google.com/3 I would like to automate curl every 60 seconds.
1
vote
1answer
187 views

Cron - crontab executes half of bash script

I have a bash script named testScript.sh that looks like this : #!/bin/bash curl -X GET https://www.example.com -o ~/Desktop/testFile.json curl -X POST -d ~/Desktop/testFile.json http://www.example2....
1
vote
1answer
430 views

Store a file on server with curl command using post method like scp? [duplicate]

Like this: cat tmp.txt | curl --post domain.com/file-to-store I want to store content of tmp.txt on my machine to server using only terminal. Is it possible?
2
votes
2answers
266 views

Downloading using curl, username and password required (cookie, phpsessid, etc…) [closed]

I am trying to download files using curl and chrome extension called CurlWget. When I click on a file to download it, I get this message: wget --header="Host: www.dummy-website.com" \ --header="User-...
0
votes
1answer
392 views

The same curl binary shows different version of openssl on 2 different servers

so I have built curl (possibly incorrectly) on debian 9 x64, and after curl -V command I can see that it uses the new version: OpenSSL/1.1.0f After that, I copied the very same library into ...
2
votes
2answers
3k views

Streaming Data to REST Service Using Unix Pipes

Based on an answer to another question I am using curl to stream the stdout of one process as the entity of a POST request: myDataGeneratingApp \ | curl -H "Content-Type: application/json" -H "...
1
vote
0answers
247 views

How to cross compile curl with ftps?

The status of configure are as below. curl version: 7.50.0 Host setup: arm-arago-linux-gnueabi Install prefix: /home/calvin/Downloads/ConnectedDVR/car_dvr_rdk/target/filesys/opt/dvr ...
0
votes
1answer
614 views

Using netcat and curl together in a bash script

This question is more related to infosec, but I can't seem to find a workaround in automating the following process: There is a cURL command which triggers a connection to the netcat. Without ...
0
votes
1answer
53 views

using curl with ${=(System.nanoTime())} inside req.xml file

i want to be able generating system nano second sequence when using curl my code is like this: curl -X POST -H 'Content-type: text/xml' -d @req.xml server_URL > result.xml the req.xml contains ...