Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [curl]

cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

0
votes
1answer
24 views

How to grep for multiple text lines in between unknown and changing html code

Here is my function. ph_relwords () { search="" echo "related words: $@" for term in $@; do search="$search+$term" done wget -q -x "https://www.pornhub.com/video/search?...
0
votes
0answers
12 views

Problem with the limit of requests api youtube v3 search

I execute the following command: curl -G https://www.googleapis.com/youtube/v3/search \ -d part="id" \ -d q="es-por-ti-juanes" \ -d maxResults="1" \ -d key="..........." \ -d type="video" \ -d ...
-3
votes
0answers
22 views

Curl problem in Python [migrated]

I'm using python 2.7 and I need a python script like following. The problem is waiting file download everytime for result if curl time condition is True. I want to get result without waiting file ...
0
votes
2answers
48 views

Get web page complete data

I'm using busybox tools and I want to take all http links in a web page. I save an example link page by using curl or wget. However, it saves the page as html. How to do it with curl or wget commands? ...
-1
votes
0answers
22 views

Uninstalled version that I cannot reinstall

I'm running nextcloudPlus on a raspberry pi 3 B. I decided to try some stuff out and I uninstalled curl and a bit later reinstalled it. This is the apt history log: Start-Date: 2019-06-04 18:04:26 ...
-1
votes
1answer
10 views

how to download ebi fastq link via command line using wget/curl

I have loads of data (fastq) to download from ENA database. Example: ERS076383 ERS012262 ERS160574 ERS349280 etc Link to download via browser: https://www.ebi.ac.uk/ena/data/warehouse/filereport?...
0
votes
1answer
37 views

RH 7.5 Linux using curl with sftp to pull multiple files ending in a particular file extension

I am in a Red Hat Linux 7.5 environment. I am trying to write a curl script to pull/receive any file from a folder that ends with a particular file extension. Previously, I have written a script to ...
0
votes
0answers
18 views

Binary Output from Curl [duplicate]

When I executed the command: curl https://piwik.openstreetmap.org/piwik.php?idsite=1 I received a warning that binary output can mess up my terminal, which, yes it did having ignored the warning, so ...
0
votes
1answer
18 views

asus ac68 merlin curl ignore http_proxy

asus ac68 is a router. I have installed the latest firmware(merlin) 384.11. curl -V curl 7.64.1 (arm-unknown-linux-gnu) libcurl/7.64.1 OpenSSL/1.0.2r zlib/1.2.5 Release-Date: 2019-03-27 Protocols: ...
1
vote
1answer
88 views

Bash script curl input variable from command line

I would like to be able to pass in what environment when script is run. Like script.sh dev ($dev would populate appropriate URL in curl command in script). Maybe even print the environment as options ...
1
vote
0answers
60 views

Curl download speed restricted when down/uploading from stdin/stdout

I'm running 2 curl commands where one downloads all the data into stdout/in until the stack is filled and another uploading whatever is in it out but it seems like the speed is restricted. For the ...
0
votes
0answers
17 views

Automatically upload directory to dropbox in no time (whenever any changes done to that directory

I installed the following Script on my CentOS 7 terminal access. I'll use this script to upload specific directory from the Linux to dropbox. using the following command i can upload the directory ...
1
vote
0answers
15 views

After setcap on executable, curl_easy_perform throws out of memory error

I've cross compiled an executable to run on Debian Stretch that requires a specific version of cURL (greater than 7.56) to run, and needs specific capabilities during execution. So on the executable ...
1
vote
2answers
81 views

php curl not getting installed on Debian 8 [duplicate]

I am using linux debian 8. I have webmin/virtualmin installed and 1 domain is running over the server. Php version is 7.1. But, i can not run curl on my server. i tried to install curl but it throws ...
0
votes
4answers
48 views

how to capture IP address from info

by the following api we can get the info about master1/2 machines curl -sH "X-Requested-By: ambari" -u "admin"":""admin" -i http://192.23.39.2:8080/api/v1/hosts?fields=Hosts/host_name,Hosts/ip | ...
1
vote
1answer
17 views

Terminology used in the manual for the curl package

An extract from the manual for the curl package reads: Using --anyauth is not recommended if you are doing uploads from stdin, since it may require the data to be sent twice and the client must be ...
0
votes
2answers
34 views

Phantom binary installed with curl

I upgraded binary youtube-dl following this instruction. locate seems to find it, not ls, and it cannot be invoked. What is happening? /usr/bin $ sudo apt-get remove youtube-dl /usr/bin $ sudo curl -...
0
votes
1answer
147 views

Download ZIP file of private GitHub repository using `wget` like `curl`

There are already some questions with answers how to download the ZIP file of GitHub repositories, but they don't work if the repository is private. I know it should work with wget somehow since it ...
0
votes
1answer
35 views

How to send a file for single POST parameter with CURL?

I want to send myfile.json for one POST parameter while specifying explicit value for another parameter with CURL. Is it possible? Something like POST a=value1&b=<load and encode from my file....
-1
votes
1answer
48 views

Is there a similar tool like Curl but is already included in Linux?

I'm not sure if there is a similar command/utility which comes along with Linux distro CentOs, Ubuntu and RedHat without installing Curl. Basically I'd like to do a command like below curl -H ...
0
votes
0answers
13 views

curl command - any option for site RDW and site SDB

I have an ftp command and i want to change it and use curl instead, but i am not able to find any options for site RDW and site SDB. Is there a solution? My ftp command is similar with: ftp ...
0
votes
1answer
134 views

Update Failed: Download failed. cURL error 6: Could not resolve host:

I am getting the error "Update Failed: Download failed. cURL error 6: Could not resolve host:"  on WordPress on my vps server...I have also noticed it in other applications as well. As a consequence, ...
0
votes
0answers
55 views

How to pass JSON in a curl GET request?

I am trying to test a REST api. Using any other web browser, I can paste the URL into the address field and gt the desired result: https://some.company.com/SomeAppAPI?cmd=setSomeData&token=...
2
votes
2answers
40 views

JQ Linux JSON Parse Unknown Key

I want to build an automated script which builds an new VPS Server on the page vultr.com. They also have an API Access and I could create it and receive also anything I need. The problem is, vultr ...
0
votes
0answers
13 views

curl doesn't measure spent time properly

I need a shell script to get data from the URL and process it. curl "$Url" | jq '(..|select(type == "number")) |= tostring' > "$SCRIPTPATH/../output.json" Curl is used for getting data, all work ...
2
votes
2answers
110 views

Script a Github file download using curl where filename AND path are variable

I needed to script the install of the Digital Ocean CLI " doctl " tool from Github using curl, but there was a problem: The filename varied as it incorporated the version number- so hard-coding it ...
0
votes
1answer
40 views

How do I increment an integer in an URL?

I want to scrape a forum by using an API and curl. API: https://api.hackertarget.com/pagelinks/?q=websitetotest.com Here is the initial link: https://bitcointalk.org/index.php?topic=840124.0 ...
0
votes
0answers
51 views

How can I multithread a for loop to run 1000 times at once?

I have a for loop that is curling the contents of a file, the file contains 2 million web addresses. I woud like to create a for loop that instead of curling the address 1 at a time, curls 1000 at ...
1
vote
1answer
51 views

Unable to save Session ID using curl

With the request: curl -i -u pvserver:XXXXXXX 'http://192.168.2.42/api/login.json' I have this output {"salt":"uTxYWQDc9lWwsuHBRfkuTzJYG5M=","session":{"sessionId":2748768190,"roleId":0},"status":{"...
0
votes
0answers
47 views

randomly generated words to a form using curl

What I want to achieve is to post a form containing 3 fields (forename, surname and email) to a url, but i want the entries to be randomly generated. I want to generate a random word using; { head /...
0
votes
1answer
111 views

How to run shell command inside awk and redirect to another shell command?

I want to get particular string from the files downloaded using curl and redirect the downloaded file content to another shell program. Here is the code : curl "http://file-list-url" -s | awk 'BEGIN {...
0
votes
0answers
30 views

How to receive data from a Webpage and send it back to it in the same connection?

I am trying to fill a form of a webpage with curl and give it some arguments. Dumb enough, it also sends a hidden form in which there is an unique token which has to be sent back to the page, a so ...
0
votes
2answers
55 views

bash remove members Slack from channels using xargs and sleep?

I'd like to be able to remove a batch of people from a "private" Slack channel. Use case: whoops, I just added 137 people to the wrong channel! The Slack Member ID list is obtained from an Airtable ...
1
vote
2answers
429 views

Loop into JSON Array in Bash Script

I make a curl request to an API and get a json return with jq. The result { "errors": [], "metadata": { "clientTransactionId": "", "serverTransactionId": "20190318164551347" }, "...
1
vote
1answer
82 views

Save Request url in Curl output

The command below cats a file full of urls and feeds it into gnu parallel. I would like the output in curlresponse.txt to have also the original request url. How can it be done? cat urls.txt | ...
0
votes
1answer
475 views

Linux Shell - How to remove escape characters generated by JQ when json is read with sed?

I am trying to read a json file and use its output in jq to build another json, combining so said json file and other values, and pass it to CURL I read the file with policies=$( sed 's/\\//g' ...
-2
votes
1answer
350 views

How to send binary file URL in the curl command instead passing local path

I am trying to post a binary .apk file which is on s3 bucket to a POST API. Local way which I know is: curl -X POST https://xxx.example.com:443/api/storage/upload -H "Content-Type:application/octet-...
0
votes
2answers
367 views

Getting exit code from curl in bash script

I want to take the output of simple.sh, a script from the internet and check its exit code. I on OSX #!/bin/bash $(curl -s http://127.0.0.1:8000/simple.sh) if [ -z "$?" ]; then echo "Good" ...
0
votes
1answer
179 views

Curl giving different responses on connection timeout

I use Ubuntu 18.04 and I try to curl the unavailable resource like: curl 192.168.11.1 --connect-timeout 10 curl 192.168.11.1 --connect-timeout 35 Why does it sometimes respond with curl: (7) Failed ...
0
votes
0answers
23 views

Error making vince-perf_defconfig

When I want to enter the vince-perf_defconfig file in the terminal, I get an error message like this make vince-perf_defconfig ./scripts/fetch-latest-wireguard.sh: line 7: curl: command not found ./...
1
vote
1answer
56 views

cURL status bar not displaying

I have done something in a bash script and my cURL command is no longer showing the status bar. I need to save the HTTP response code to a variable, $status: I have: status=$(curl -s -S -o curl.tmp -...
0
votes
1answer
111 views

running curl with sudo results in a status code 301 (Moved Permanently)

i have a test server running on port 3062, i want to send it HTTP POST data using curl when i run the following command : curl -d '{"k1":"v1","k2","v2"}' -X POST http://localhost:3062 it works fine ...
7
votes
3answers
694 views

How do I add a variable to this curl command?

I have a curl command that sends a string of text to the server and I've been trying to figure out how to either have the string of text come from a file or from a bash variable. The command looks ...
-1
votes
2answers
47 views

Looping by replacing the values in a file and then doing curl request for 25 times increasing count by 1000

I have a scenario of doing a curl request with payload from a file to my server. Here I need to replace values in my file incrementing values by 1000 and repeating the same for 25 times. I am able to ...
0
votes
1answer
68 views

why curl can't expand variable inside the loop, but echo can?

I need to include variable inside curl for fname in "assets/*.drx"; do echo $fname curl -F file=@"$fname" "http://someurl.com/" echo $fnamename done Result: assets/...
0
votes
2answers
303 views

curl and grep(?) to grab specifc string - how?

I need to do some testing using curl against our web farm. Each server has some default page with some verbiage on it like this: "Welcome to webappsrv01" "Welcome to webappsrv02" and so forth. How ...
0
votes
1answer
327 views

Why “curl -k https://www.google.com” is not work? [closed]

Environment: macOs + iTerm(has be set https_proxy and http_proxy) + shadowsocks(in auto mode) why curl -k https://www.google.com (not http) has no effect, while https://www.google.com is ok in google ...
1
vote
0answers
159 views

GET via wget or cURL gives a limited response

I'm bumping my head on a simple HTTP GET request. Using a tool like Postman, I'm getting the full and expected response (an over 1 thousand lines xml document, displaying the details of my 60 albums) ...
0
votes
1answer
105 views

Troubleshooting: cURL timeouts, Java app doesn't

I'm trying to use curl against a remote server to access a REST API (and right now, just the welcome page...) Currently, I have a Java application that can send REST request on this server. But if I ...
0
votes
0answers
46 views

Enable SSLV3 request in libcurl 7.52.1

I am using libcurl 7.52.1 to send http request so far I have successfully tried to send TLS request down to TLSV1.0. I need to send SSLV3 requests how can I enable SSLV3 request on my current libcurl ...