cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

learn more… | top users | synonyms

0
votes
3answers
27 views

Download an article with cURL given a dynamic download link

I'm trying to download this published journal article using cURL. It's the main page of an open access, so there should be not problems for anyone to see/download the article. I then extract the ...
0
votes
0answers
19 views

URL Parameters with cURL code

I have been converting a .vbs script for use with CURL from an old domain to a new AD domain, and to post to a new sharepoint. I think I have evenrything correct except my destination. My output log ...
0
votes
1answer
27 views

Hide curl output [duplicate]

I'm making a curl request where it displays an html output in the console like this <b>Warning</b>: Cannot modify header information - headers already sent by (output started at ...
-1
votes
0answers
36 views

Bash read user input and then call for a curl [duplicate]

I'm trying to execute a bash script that accepts user input and then according to that user input executes a curl request, the user input includes the query string that should be called using curl. ...
0
votes
1answer
21 views

Nnumber of HTML redirects from cURL

My little script extracts DOI's from a csv files in order to check whether they are right. The number should equal 3, and if it doesn't, I want to output an message. #!/bin/bash ...
-1
votes
1answer
49 views

Accessing array elements within process substitution bash

I've got a text file which looks like this: b4238ca2-cb8d-11e4-8731-1681e6b88ec1,https,username,password,ipaddress b4238f0e-cb8d-11e4-8731-1681e6b88ec1,https,username,password,ipaddress ...
-1
votes
0answers
12 views

Outside IP curl cron on FreeBSD

I have FreeBSD 10.1 (ssmtp,curl) I want to receive outside IP from cron. */10 * * * * root curl http://ifconfig.me/ip | mail my@mail But I got the following response Null message body; hope that's ...
0
votes
2answers
56 views

Yum Broke For some reason

i am trying to install Mysql Client i am getting this annoying message. I am still unable to find the proper answer. [root@localhost Downloads]# yum install mysql-bench There was a problem importing ...
1
vote
2answers
41 views

How do I post something using cURL that starts with `@`?

The command curl http://localhost/ --data @hello will try to read from file hello. How do I escape the @ symbol?
0
votes
2answers
427 views

How to fix curl sslv3 alert handshake failure?

I'm trying to curl HTTPS website in the following way: $ curl -v https://thepiratebay.se/ However it fails with the error: * About to connect() to thepiratebay.se port 443 (#0) * Trying ...
1
vote
1answer
62 views

How to get the http dump of a website and the header both from a single curl command?

I have to fetch a website (multiple redirections possible using -L) and save the html content in a file named as [HTTP_Status_code]_[Website_name].html Currently I am using two curl calls one for the ...
0
votes
2answers
28 views

Filter hyperlinks from web page and download all that match a certain pattern

I wanted to download all graphic files from our organisation's graphics repository web page. They are Illustrator (.ai) format and Corel Draw (.cdr) format. They are directly hyperlinked (i.e. <a ...
0
votes
2answers
82 views

linux curl POST request not working

I am trying to make a POST request using curl to retrieve exam results from the page : result odd .... I am using the following syntax but various errors are showing up (like content has moved ...
1
vote
0answers
62 views

cURL does not recognize certificate

At our company they enforce a web proxy which breaks SSL connections and replaces the certificate by its own fake certificate. (To be precise it uses a proxy cert which is signed by the company cert.) ...
2
votes
1answer
130 views

CURL won't connect to self

I'm having a weird issue where CURL cannot connect to its own server. For example if I'm on server example.com wget https://example.com/ <--- WORKS FIND curl https://example.com gets error: 35 ...
2
votes
2answers
282 views

Can't install cURL on Linux Mint

I am trying to install cURL in order to be able to install the Ruby version manager. I write this: sudo apt-get update && apt-get install curl And get this output: E: Some index files ...
0
votes
1answer
107 views

Download Forum Attachments

Is there a way to download forum jpeg image attachments, possibly using Wget or Curl or some other tool? I would like to download jpeg attachments from specific pages on forums. I'm not interested in ...
1
vote
2answers
85 views

curl authentication works but I cannot reach other pages

I'm trying to use cURL to automate some processes that we usually do using a website. I was able to login to the website using curl and the following command: curl -k -v -i --user ...
0
votes
0answers
313 views

Building cURL 7.40.0 and OpenSSL 1.0.2 from source: Headers and library doesn't match

I would like to ask for assistance, related to cURL and OpenSSL, both of them, built from sources. OS is Debian 7, latest version, minimal and clean install. Only installed packages: apt-get -y ...
1
vote
1answer
86 views

Special characters in a web feed

I am running a script to check my gmail from the command line and display the first 35 characters in the title. curl -u username:password --silent "https://mail.google.com/mail/feed/atom" | \ grep ...
0
votes
2answers
173 views

The best way to add Unix Shell variables to CURL GET request

Let’s say I use curl –X GET command with the following link: “$WEBSITE_URL/ACTION_NAME/ACTION1;id=$ID?Command=TEST&id1=$ID1&id2=$ID2&id3=$ID3” As you can see, there are some $variables ...
0
votes
1answer
52 views

Curl Command PUT Method

curl -i -X PUT -H 'Content-Length: 1000' http://dfdc:dfdc@xx.xx.xx.xxx:xx/directory/ Above curl doesn't produce any response at Ubuntu shell prompt.
1
vote
1answer
87 views

Using cURL, How can I fetch a numerical string which contains commas and spaces and convert such to a NON COMAFIED string [duplicate]

Example: Google's Outstanding Shares are 670,000,000 and this value is collected in a txt file from Yahoo Finance API using the below script. The issue is; that numbers WITH commas or spaces are ...
0
votes
1answer
126 views

Using the cURL command, how does one fetch stock data which comes back *without* commas and spaces?

What can I add to the below script so that it fetches the stock data and brings it back WITHOUT any commas and spaces? For example GOOG Outstanding shares is 675,000,000. I desire the output of ...
1
vote
1answer
79 views

Using cURL command-line tool on Mac, how does one fetch stock data which comes back *without* commas? [duplicate]

The below script is not working. cd desktop/quoteUpdate while true do curl-o quotes.txt -s "http://download.finance.yahoo.com/d/quotes.csv?s=goog,aapl&f=sl1" sed -i '.bak' 's/,/ /g' quotes.txt ...
1
vote
2answers
75 views

Multiple arguments using xargs.

I know xargs can take many arguments like so. xargs -n5 -I{} echo {} but how do I put the arguments in a particular location I want do something like. xargs -n5 -I{} curl ...
1
vote
1answer
192 views

how to pass a password with a cron job safely?

I have a site map generator script placed in this URL http://www.mydomain.com/admin/sitemapgen/ However this URL is protected with an username and a password in auth_type basic method. I need to ...
2
votes
2answers
1k views

Use curl to send binary file through POST with content-type multipart/form-data;

A post request is made to: http://www.example.com/example/ and the post data is as follows: ------WebKitFormBoundaryB8NNdk2kNdndnnn Content-Disposition: form-data; name="picture[uploaded_data]"; ...
0
votes
1answer
165 views

using CURL to transmit binary data over POST parameter

How can i use CURL to send binary data through a specific post parameter? E.g in: curl 'http://www.example.com' -H 'hi:hi' --data ...
1
vote
2answers
108 views

Checking URLs for HTTP code 200

I have a text file containing a list of URLs like this: http://somesite.com/some-article/ https://anothersite.fr/somepage.php?page=something What I'd like to do is check which URLs return HTTP code ...
1
vote
1answer
91 views

Curl 7.27: [ANY]_PROXY set; curl does not resolve the hostname via proxy

I'm using curl with a Socks proxy. The proxy is configured via ANY_PROXY="socks5://NNN.NNN.NNN.NNN.PPPP" I observed that curl resolves the hostname locally, not via the proxy. When requesting a URL ...
0
votes
0answers
111 views

cURL settings in debian

I recently setup a cURL script, wich I tested at a Windows XAMPP envirement. Now I want to bring it live on our Debian machine, but its not working anyhow. I think this has something to do with the ...
3
votes
1answer
309 views

cUrl : Argument list too long

Im getting an "Argument list too long" error when trying to use curl to send a file in base64 inside the body of my json. Im using something like this: DATA=$( base64 "$FILE" ) curl -X POST -H ...
1
vote
0answers
49 views

Can I control number of TCP Connections per second in curl?

I am trying to make one traffic generator tool in linux centOS 6.5. I am using curl for this purpose. I can generate traffic from virtual interfaces using curl but I don't know if I can control number ...
1
vote
1answer
1k views

curl: (35) error:14077438:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert internal error

I am using curl 7.26.0-1+wheezy11 on Debian Wheezy, and whenever I try to access the URL https://www.basebit.com.br, it fails with the message: $ curl https://www.basebit.com.br curl: (35) ...
1
vote
0answers
63 views

Transparent proxy to other IP of thousand ports

I was bought a service that only allow a IP, the IP that i say, only one, but I need use this from more IP's. I think that I can install in this computer a system to do a transparent proxy for ...
2
votes
1answer
267 views

Curl failed to read known_hosts file

I'm trying to download a file from a Centos 6 server using another Centos 6 server as client and curl with the scp protocol and I'm getting this error output: $ curl -v -O scp://cz/path/to/file * ...
0
votes
1answer
19 views

Loop across url with static tokens with Oauth

I need to write a loop where I need to pass a "token" (which is fixed) and a variable (i) in the url. Is there any way I can achieve that? I wrote the following code but it is not working. If I put ...
1
vote
1answer
1k views

Sending CURL request with custom IP

Shouldn't it be possible? Let's assume I don't need a response, I just want to send a request. Shouldn't we be able to alter tcp/ip headers, because our computer sends it? I am probably missing ...
0
votes
1answer
72 views

Curl fails to download a file during start up

I am adding startup script in Ubuntu with update-rc.d. My script says : #!/bin/bash nohup curl -C - -o ~/Downloads/linuxmint-17-xfce-dvd-64bit.iso.part ...
0
votes
1answer
52 views

to check the url is live

I have written a script to check if our three URLs are up else echo down.now the problem is even if the URLs are down in that script I get the message URLs are up In the code I have greped 302 ...
0
votes
0answers
49 views

Could session.cache_expire time in php5-fpm/php.ini cause PHP cURL responses to be empty?

Could session.cache_expire time in php5-fpm/php.ini cause PHP cURL requests to have empty responses, if the cache expired before the response came back? My code is like this: $ch = ...
0
votes
1answer
28 views

How do I find out the last-used --max-time in cURL?

I just want to output to stdout cURL's last-used --max-time. As cURL's manpage states: -m, --max-time <seconds> Maximum time in seconds that you allow the whole operation to take. [snip] ...
1
vote
1answer
66 views

For loop for curling on multiple pages with API's

I am trying to crawl a website for fetching pages using an API. When I issue the command cd desktop/mysite ; curl -O https://api.mysite.com/info?page=2 I get the data on the desktop. Then I wanted ...
2
votes
1answer
257 views

Posting XML through cURL using --data-binary

I have this really typical problem. I have an XML file that I have to post to a server. I was told by the network engineer of that site to use the cURL function. The function that he provided to me ...
5
votes
1answer
3k views

How to grep the output of cURL?

I need to retrieve the expiry date of an SSL cert. The curl application does provide this information: $ curl -v https://google.com/ * Hostname was NOT found in DNS cache * Trying ...
-2
votes
1answer
406 views

Resume failed download using Linux command line tool

How to resume partially downloaded file using linux commandline tool. I downloaded large file partially i.e. 400MB out of 900MB due to power interruption, but when I start downloading again it ...
2
votes
1answer
332 views

splitting a CSV and keeping the header without intermediate files [closed]

I am trying to split a dozen 100MB+ csv files into managable smaller files for a curl post. I have managed to do it but with a lot of temporary files and IO. It's taking an eternity. I am hoping ...
1
vote
0answers
86 views

IPTable rules for transparent outbound proxy

I've recently installed MITMProxy (similar to Squid) which I'm currently using to route outbound HTTP requests from my Ubuntu machine to another server (adding a header along the way). When I use ...
0
votes
2answers
772 views

trying to install curl with homebrew, getting “incompatible library version” for libcurl.4.dylib

I am on OSX 10.9.5. I would like to use a later version of CURL than what is bundled with OSX, but I do not want to remove the OSX binary just in case, so I wanted to opt to install it via homebrew. ...