Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [curl]

cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

0
votes
0answers
10 views

Get URL content including parsed javascript

I know there are a lot of CLI tools to get data from URL like curl, wget, lynx and so on. Problem is that I need to get data that is created with javascript. For example URL outputs table with data ...
0
votes
1answer
33 views

curl in Jenkins,

What i want to do is: The 1st curl command output will be the input of the 2nd curl command... Have a jenkins build which originally runs a curl commands such as: curl -u $user:$PS -h "content-type:...
0
votes
0answers
12 views

Testing if iptables rules working on VirtualBox Linux VM

I have this specific set up I created to test squid cache intercept mode. I have created a VritualBox centos 7 SE linux VM on my mac. Disabled SE linux (set to Permissive) and disabled the firewall ...
0
votes
1answer
25 views

Listing files of a sharepoint directory via curl [closed]

I would like to know if there is a way to list all the files in a specific SharePoint directory via curl? At the moment i can access SharePoint via the following code: curl -U ${SharePointLoginUser}...
0
votes
0answers
21 views

Globbing error via Curl on SharePoint

I would like to download all the zip files in a SharePoint directory. The zip files are named in the following format "0111A.zip". I am able to download a specific zip file via this: curl -U ${...
0
votes
1answer
41 views

What does curl -sS means?

man curl says: -S, --show-error When used with -s it makes curl show an error message if it fails. If curl -S (uppercase) will show error instead an alleged default silent mode, then I don't ...
0
votes
1answer
14 views

curl download file and name it <custom-name>.<provided-extension>

Say I have a bunch of URLs like this: https://domain.com/foo/bar/2d9ec0354908e055acf372 From the URL I don't know what the extension is, and I don't have any other "frontend" information to tell me ...
1
vote
1answer
48 views

using variables inside the curl command not working in bash script

I am trying to write a bash script to update certain nodes in my repository. I wrote below script, but it does not seem to be working when I use variables inside curl. Below is the code. I tried all ...
22
votes
5answers
2k views

What are the alternatives for checking open ports, besides telnet?

We can use the following in order to test telnet VIA port; in the following example we test port 6667: [root@kafka03 ~]# telnet kafka02 6667 Trying 103.64.35.86... Connected to kafka02. Escape ...
0
votes
0answers
26 views

curl stops working when used in combination with xargs

I need to check a list of domains in parallel. So I was planning on using curl and xargs. This is check.sh: #!/bin/bash domain=${1?Pass the domain as a parameter} curl -o /dev/null --silent --write-...
2
votes
2answers
64 views

Run curl commands in parallel using xargs with inputs from csv

I have a csv file with several columns including a sequence number and an image URL. The file is 450+ lines. 1,text1,text2,http://image_a.jpg 2,text1,text2,http://image_b.jpg 3,text1,text2,http://...
0
votes
0answers
34 views

Curl 7.27.0-1 Symbol Resolution Failed Error

On an AIX 5.3 I have installed curl 7.27.0-1 through .rpm's and if I try to use it by issuing a curl -V command I am getting this error: Could not load program curl: Symbol resolution failed for /opt/...
1
vote
1answer
30 views

why do I get the monitoring information from curl in some case and not in other case?

When I run the following command in an interactive bash shell: $ curl ipinfo.io/ip 123.45.67.890 If I create /etc/cron.d/myjob: 24 * * * * tim ( date && curl ipinfo.io/ip && date ) &...
1
vote
1answer
18 views

Difference between cURL's cookie-jar option and browser cookie?

I'm trying to login to a website using curl and HTTP requests. With the first http GET request I add -c cookie.txt to the command to save the cookie to a file. For the second curl POST I add -b ...
0
votes
0answers
11 views

Api to Delete pull request in bitbucket

Need a api which deletes particular Pull request gone through official document https://docs.atlassian.com/bitbucket-server/rest/5.15.0/bitbucket-rest.html#idm45622371702720 Tried :- curl -u ...
0
votes
0answers
22 views

Curl results in a 403 when using a squid proxy

I'm trying to access an endpoint with curl and a squid HTTP proxy, however I'm running into 403 Forbidden errors when I try to do it. curl -X GET 'https://secure-store.nike.com/ap/services/...
1
vote
1answer
48 views

libcurl with ssl in linux (curle_not_built_in error) [closed]

curl_easy_setopt(Config->hHandle->curl, CURLOPT_SSL_CTX_FUNCTION, NULL)) is returning CURLE_NOT_BUILT_IN error in linux, where in Windows (Visual Studio) its working fine. I built libcurl in ...
0
votes
1answer
14 views

Comparing the `time_total` of two curl requests to different sites

I know that I can get the time_total of of curl request by using this command: curl https://www.google.com -s -o /dev/null -w "%{time_total}\n" Is there any way for me to easily compare the results ...
0
votes
0answers
41 views

bash script uses curl

sed -e 's/,$//' -e 'y/,/:/' test.txt | xargs -P 80 -I XX /usr/bin/curl -sk https://XX/ |grep phrase |printf "XX" it does not work for some reason. I need to do the curl and print the ip visited. The ...
0
votes
2answers
36 views

Concatenate and use multi line variable in multi line curl execution

With this code #!/bin/bash set -x PROPERTIES="MAINTAINER=Self, My" while IFS='=' read -r key value do ADDITIONAL_PARAMETERS+="-F variables[${key}]=${value} " done <<< "${PROPERTIES}" #...
0
votes
3answers
40 views

Verify if a URL exists

I would like to verify if a URL exists without downloading. I am using below with curl: if [[ $(curl ftp://ftp.somewhere.com/bigfile.gz) ]] 2>/dev/null; then echo "This page exists." else ...
0
votes
0answers
43 views

Update curl and libcurl on Debian stretch

I got a docker container running Debian stretch: PRETTY_NAME="Debian GNU/Linux 9 (stretch)" When i try apt list -a curl I get Listing... Done curl/stable,now 7.52.1-5+deb9u7 amd64 [...
1
vote
1answer
22 views

Transferring a file to two destinations efficiently

At present I am creating a backup file and using curl to send it to a remote host, using: tar -cvzf - ./folder | curl -u user:pwd ftp://example.com/folder/backup.tar.gz --ftp-create-dirs -T - I also ...
0
votes
1answer
34 views

Fetching title of browser

[Fetching user title] Seen a post prior of someone posting how to do it by single account I wish to do this from the range 1-1000 and have it output to >> .txt Example: x@nine:~# wget -qO- 'http:...
2
votes
0answers
34 views

libcurl post request from debian 7 to debian 9 gnutls handshake error

I have a problem with libcurl returning an SSL error, let me describe the situation: There are two machines with Debian, the client is Debian 7 and the server is Debian 9, the client uses libcurl to ...
0
votes
2answers
82 views

Curl : Read headers from a file and use them in a cURL command

I have a bash script with the following curl command : curl -v -X GET https://example.com -H ~/Desktop/headers.txt -o ~/Desktop/file.txt When i run the bash script i am getting unothorized 401. ...
0
votes
0answers
14 views

Soap & cURL don't work after upgrading Ubuntu

I'm running a WordPress site on an Ubuntu VPS Server. After upgrading the server using: do-release-upgrade it was upgraded from Ubuntu 16.04.04 to 18.04.01. Soap and cURL don't seem to work any ...
-4
votes
2answers
47 views

Automate the command curl to download multiple URLs

How can I run curl on multiple URLs example: curl https://google.com/1 curl https://google.com/2 curl https://google.com/3 I would like to automate curl every 60 seconds.
1
vote
1answer
35 views

Cron - crontab executes half of bash script

I have a bash script named testScript.sh that looks like this : #!/bin/bash curl -X GET https://www.example.com -o ~/Desktop/testFile.json curl -X POST -d ~/Desktop/testFile.json http://www.example2....
1
vote
1answer
24 views

Store a file on server with curl command using post method like scp? [duplicate]

Like this: cat tmp.txt | curl --post domain.com/file-to-store I want to store content of tmp.txt on my machine to server using only terminal. Is it possible?
2
votes
2answers
37 views

Downloading using curl, username and password required (cookie, phpsessid, etc…) [closed]

I am trying to download files using curl and chrome extension called CurlWget. When I click on a file to download it, I get this message: wget --header="Host: www.dummy-website.com" \ --header="User-...
0
votes
1answer
43 views

The same curl binary shows different version of openssl on 2 different servers

so I have built curl (possibly incorrectly) on debian 9 x64, and after curl -V command I can see that it uses the new version: OpenSSL/1.1.0f After that, I copied the very same library into ...
1
vote
2answers
148 views

Streaming Data to REST Service Using Unix Pipes

Based on an answer to another question I am using curl to stream the stdout of one process as the entity of a POST request: myDataGeneratingApp \ | curl -H "Content-Type: application/json" -H "...
0
votes
0answers
309 views

curl: (35) error:14077410:SSL routines:SSL23_GET_SERVER_HELLO:sslv3 alert handshake failure

I am using the curl ftp with ssl.the command line are as below. ./curl -v -T /tmp/resolv.conf -u user:passwd --ssl -l --insecure ftp://55.92.74.251:7020 the results are as below. ./curl: /...
1
vote
0answers
50 views

How to cross compile curl with ftps?

The status of configure are as below. curl version: 7.50.0 Host setup: arm-arago-linux-gnueabi Install prefix: /home/calvin/Downloads/ConnectedDVR/car_dvr_rdk/target/filesys/opt/dvr ...
0
votes
1answer
172 views

Using netcat and curl together in a bash script

This question is more related to infosec, but I can't seem to find a workaround in automating the following process: There is a cURL command which triggers a connection to the netcat. Without ...
0
votes
1answer
23 views

using curl with ${=(System.nanoTime())} inside req.xml file

i want to be able generating system nano second sequence when using curl my code is like this: curl -X POST -H 'Content-type: text/xml' -d @req.xml server_URL > result.xml the req.xml contains ...
1
vote
1answer
129 views

Execute as fast as possible many curl commands

I am gathering some data locally at home on a Raspberry Pi and I want to send the data as fast as possible to a REST API (which I own) on a server on the web. The locally gathered data could flow as ...
0
votes
1answer
33 views

curl from sitemap.xml?

I would like to curl a list of URLs (Namely as defined in https://example.com/sitemap.xml The closest I've been able to get to this goal is xargs curl --referer https://mywebsite.ca --user-agent "It ...
0
votes
1answer
53 views

Manual install of curl can't find openssl

My system (Centos7) install of curl doesn't support https. So I followed this answer downloaded from source and installed myself, using the ./configure --with-ssl option. I got the following warning ...
2
votes
1answer
31 views

Generating quoted command arguments

I'm working with a HTTP API that demands a very particular set of signed headers + JSON body. And I really want to cURL it for debugging and sanity in general. So, I've written a small script that, ...
0
votes
1answer
64 views

cURL “[skips] unknown form field” when passing semicolon-delimited string as form data

Problem I'm attempting to use cURL to POST form data to an API. The API's documentation states that it accepts multipart/form-data content types. Since this is part of a script, I'm trying to build ...
0
votes
0answers
180 views

curl: (25) Failed FTP upload: 553

I'm tyring to upload to a vsftpd ftp using curl with this line curl -T "$ATTACHMENTS_DIR${file##*/}" ftp://10.0.13.52/ -v I have enabled all the anon settings, I'm just creating a test script so ...
1
vote
1answer
128 views

A file on AkamaiGlobalHost downloads with a browser but not with curl

When I download the following file on my browsers (firefox & waterfox): https://launcher-public-service-prod06.ol.epicgames.com/launcher/api/installer/download/EpicGamesLauncherInstaller.msi?...
1
vote
0answers
28 views

openssl hangs on server

I have a problem on the server. Commands wget, curl and dependent commands are not working when a request is via 443 port. Commands hangs on 2-3 minutes and after just say "time out": # curl -v ...
0
votes
1answer
172 views

Unable to use curl with cookie-jar

I am trying to use curl for login request automation. Here, use of cookie-jar is must. When I use --cooki-jar cjar option, it shows following error. root@kali:~# curl --cookie-jar cjar --output /root/...
1
vote
1answer
61 views

PHP missing cURL and XDebug after upgrade

I just upgraded to Ubuntu 18.04.1 LTS and went to check on my local apache2 installation by adding phpinfo() to an index file. I do not see an entry for cURL or for XDebug. Here's what I did: ...
-2
votes
1answer
74 views

shell: evaluate an curl expression

In this following script i generate a status code and if the statusCode=200, i send the data else if the statusCode !=200 i générate à token and i send the message by recalling eval "$request_cmd". ...
0
votes
0answers
329 views

How do I download all images from a webpage with wget

I want to download all images from a webpage but when I type: $ wget -nd -r -P images -A "*.jpg, *.jpeg, *.png" "Path/to/url" wget not only downloads images from the webpage I want but it also ...
2
votes
2answers
37 views

Fetching, merging and exporting data from CURL

Before anything else, english isn't my laguage. I'll try to be understandable :-) Second, I am not a regular Linux user, I'm just starting out. I'm using curl and the API of a web chat platform to ...