cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

learn more… | top users | synonyms

1
vote
1answer
37 views

Special characters in a web feed

I am running a script to check my gmail from the command line and display the first 35 characters in the title. curl -u username:password --silent "https://mail.google.com/mail/feed/atom" | \ grep ...
0
votes
2answers
22 views

The best way to add Unix Shell variables to CURL GET request

Let’s say I use curl –X GET command with the following link: “$WEBSITE_URL/ACTION_NAME/ACTION1;id=$ID?Command=TEST&id1=$ID1&id2=$ID2&id3=$ID3” As you can see, there are some $variables ...
0
votes
1answer
19 views

Curl Command PUT Method

curl -i -X PUT -H 'Content-Length: 1000' http://dfdc:dfdc@xx.xx.xx.xxx:xx/directory/ Above curl doesn't produce any response at Ubuntu shell prompt.
1
vote
1answer
43 views

Using cURL, How can I fetch a numerical string which contains commas and spaces and convert such to a NON COMAFIED string [duplicate]

Example: Google's Outstanding Shares are 670,000,000 and this value is collected in a txt file from Yahoo Finance API using the below script. The issue is; that numbers WITH commas or spaces are ...
0
votes
1answer
77 views

Using the cURL command, how does one fetch stock data which comes back *without* commas and spaces?

What can I add to the below script so that it fetches the stock data and brings it back WITHOUT any commas and spaces? For example GOOG Outstanding shares is 675,000,000. I desire the output of ...
1
vote
1answer
52 views

Using cURL command-line tool on Mac, how does one fetch stock data which comes back *without* commas? [duplicate]

The below script is not working. cd desktop/quoteUpdate while true do curl-o quotes.txt -s "http://download.finance.yahoo.com/d/quotes.csv?s=goog,aapl&f=sl1" sed -i '.bak' 's/,/ /g' quotes.txt ...
1
vote
2answers
38 views

Multiple arguments using xargs.

I know xargs can take many arguments like so. xargs -n5 -I{} echo {} but how do I put the arguments in a particular location I want do something like. xargs -n5 -I{} curl ...
1
vote
1answer
64 views

how to pass a password with a cron job safely?

I have a site map generator script placed in this URL http://www.mydomain.com/admin/sitemapgen/ However this URL is protected with an username and a password in auth_type basic method. I need to ...
2
votes
2answers
73 views

Use curl to send binary file through POST with content-type multipart/form-data;

A post request is made to: http://www.example.com/example/ and the post data is as follows: ------WebKitFormBoundaryB8NNdk2kNdndnnn Content-Disposition: form-data; name="picture[uploaded_data]"; ...
0
votes
1answer
41 views

using CURL to transmit binary data over POST parameter

How can i use CURL to send binary data through a specific post parameter? E.g in: curl 'http://www.example.com' -H 'hi:hi' --data ...
1
vote
2answers
44 views

Checking URLs for HTTP code 200

I have a text file containing a list of URLs like this: http://somesite.com/some-article/ https://anothersite.fr/somepage.php?page=something What I'd like to do is check which URLs return HTTP code ...
1
vote
1answer
21 views

Curl 7.27: [ANY]_PROXY set; curl does not resolve the hostname via proxy

I'm using curl with a Socks proxy. The proxy is configured via ANY_PROXY="socks5://NNN.NNN.NNN.NNN.PPPP" I observed that curl resolves the hostname locally, not via the proxy. When requesting a URL ...
0
votes
0answers
53 views

cURL settings in debian

I recently setup a cURL script, wich I tested at a Windows XAMPP envirement. Now I want to bring it live on our Debian machine, but its not working anyhow. I think this has something to do with the ...
2
votes
1answer
84 views

cUrl : Argument list too long

Im getting an "Argument list too long" error when trying to use curl to send a file in base64 inside the body of my json. Im using something like this: DATA=$( base64 "$FILE" ) curl -X POST -H ...
1
vote
0answers
24 views

Can I control number of TCP Connections per second in curl?

I am trying to make one traffic generator tool in linux centOS 6.5. I am using curl for this purpose. I can generate traffic from virtual interfaces using curl but I don't know if I can control number ...
1
vote
1answer
447 views

curl: (35) error:14077438:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert internal error

I am using curl 7.26.0-1+wheezy11 on Debian Wheezy, and whenever I try to access the URL https://www.basebit.com.br, it fails with the message: $ curl https://www.basebit.com.br curl: (35) ...
1
vote
0answers
42 views

Transparent proxy to other IP of thousand ports

I was bought a service that only allow a IP, the IP that i say, only one, but I need use this from more IP's. I think that I can install in this computer a system to do a transparent proxy for ...
2
votes
1answer
149 views

Curl failed to read known_hosts file

I'm trying to download a file from a Centos 6 server using another Centos 6 server as client and curl with the scp protocol and I'm getting this error output: $ curl -v -O scp://cz/path/to/file * ...
0
votes
1answer
18 views

Loop across url with static tokens with Oauth

I need to write a loop where I need to pass a "token" (which is fixed) and a variable (i) in the url. Is there any way I can achieve that? I wrote the following code but it is not working. If I put ...
1
vote
1answer
320 views

Sending CURL request with custom IP

Shouldn't it be possible? Let's assume I don't need a response, I just want to send a request. Shouldn't we be able to alter tcp/ip headers, because our computer sends it? I am probably missing ...
0
votes
1answer
47 views

Curl fails to download a file during start up

I am adding startup script in Ubuntu with update-rc.d. My script says : #!/bin/bash nohup curl -C - -o ~/Downloads/linuxmint-17-xfce-dvd-64bit.iso.part ...
0
votes
1answer
46 views

to check the url is live

I have written a script to check if our three URLs are up else echo down.now the problem is even if the URLs are down in that script I get the message URLs are up In the code I have greped 302 ...
0
votes
0answers
36 views

Could session.cache_expire time in php5-fpm/php.ini cause PHP cURL responses to be empty?

Could session.cache_expire time in php5-fpm/php.ini cause PHP cURL requests to have empty responses, if the cache expired before the response came back? My code is like this: $ch = ...
0
votes
1answer
22 views

How do I find out the last-used --max-time in cURL?

I just want to output to stdout cURL's last-used --max-time. As cURL's manpage states: -m, --max-time <seconds> Maximum time in seconds that you allow the whole operation to take. [snip] ...
1
vote
1answer
48 views

For loop for curling on multiple pages with API's

I am trying to crawl a website for fetching pages using an API. When I issue the command cd desktop/mysite ; curl -O https://api.mysite.com/info?page=2 I get the data on the desktop. Then I wanted ...
2
votes
1answer
106 views

Posting XML through cURL using --data-binary

I have this really typical problem. I have an XML file that I have to post to a server. I was told by the network engineer of that site to use the cURL function. The function that he provided to me ...
3
votes
1answer
812 views

How to grep the output of cURL?

I need to retrieve the expiry date of an SSL cert. The curl application does provide this information: $ curl -v https://google.com/ * Hostname was NOT found in DNS cache * Trying ...
-2
votes
1answer
111 views

Resume failed download using Linux command line tool

How to resume partially downloaded file using linux commandline tool. I downloaded large file partially i.e. 400MB out of 900MB due to power interruption, but when I start downloading again it ...
2
votes
1answer
134 views

splitting a CSV and keeping the header without intermediate files

I am trying to split a dozen 100MB+ csv files into managable smaller files for a curl post. I have managed to do it but with a lot of temporary files and IO. It's taking an eternity. I am hoping ...
1
vote
0answers
47 views

IPTable rules for transparent outbound proxy

I've recently installed MITMProxy (similar to Squid) which I'm currently using to route outbound HTTP requests from my Ubuntu machine to another server (adding a header along the way). When I use ...
0
votes
2answers
207 views

trying to install curl with homebrew, getting “incompatible library version” for libcurl.4.dylib

I am on OSX 10.9.5. I would like to use a later version of CURL than what is bundled with OSX, but I do not want to remove the OSX binary just in case, so I wanted to opt to install it via homebrew. ...
1
vote
1answer
4k views

Disable SSLv3 In cURL?

I'm having a problem connecting to a website that is hosted with CloudFlare using cURL. When I try to connect to the website with HTTPS (using curl -v https://www.xxxxxx.com), it says: * About to ...
1
vote
2answers
190 views

Escape strings sent in curl data when using application/json

I'm using CURL to send JSON data. Here is an example: mycomputer$ curl -H "Content-Type: application/json" -d "{ "some_string": "Hello mom it's me!" }" ...
0
votes
1answer
123 views

curl wget - 403 Forbidden

I am trying to download a site as you see bellow with curl or wget but either one seems to work. I tried different options like "curl -k" seemed promising, but did not work. Every one is allowed to ...
1
vote
1answer
182 views

Laravel , Composer and Curl installation on Linux Mint

I have a Linux Mint machine I am working on. I want to install Laravel on it. When I searched for this I got this command: curl -sS https://getcomposer.org/installer | php from ...
1
vote
0answers
84 views

Curl takes JSON file as input but not the content of a JSON file

I am uploading a JSON file using curl. I give the following in the command line as: $ curl -v --header "Content-Type: application/json" -X POST \ http://site -d @test.json where test.json is ...
2
votes
1answer
60 views

How to find out how much of internet bandwidth is used by all processes except one specific process?

As a followup question to this one: I am downloading a file on multiple remote computers using curl command and am using the --limit-rate parameter to limit the download speed on the ones whose ...
2
votes
1answer
49 views

Is it possible to dynamically change the --limit-rate parameter of curl?

As a followup question to this one: I am using the --limit-rate parameter to limit the download speed on computers whose internet is being used: curl --limit-rate 10k -r 104857601-209715200 -o ...
0
votes
0answers
1k views

Linux curl request for SOAP webservice call

I have a SOAP webservice WSDL and when I make a call with SOAP-UI tool, it works perfectly fine.... Now, Im trying to mimic the same call using LINUX CURL but get a 404 error, Here is my CURL ...
1
vote
0answers
28 views

FreeBSD: spdylay build error

I try to install the latest curl updates from ports (curl-7.37.1_2) with HTTP/2.0 support enabled and I need to build spdylay for that purpose, but I keep getting the following strange errors and ...
3
votes
2answers
183 views

How can I check GMail messages with prompt for password from a script?

I'm using zsh on Ubuntu 14.04 over SSH using Putty and I'm setting up the key bindings for my keyboard. Because zsh doesn't seem to make use of my function keys I thought I'd setup scripts to do ...
1
vote
1answer
82 views

Get size of sent curl request

Is there a way to get the size of a curl request programmatically? E.g. if I do curl 'http://www.example.com/url' \ -H 'Cookie: cookie=cookiedata;' \ -H 'X-CSRFToken: csrffake' \ --data ...
1
vote
1answer
208 views

curl timeout troubleshooting

I tried to curl popular websites e.g. curl google.com or curl google.com:80 and there is always a timeout error. Some troubleshooting steps performed: Able to curl localhost with response Able to ...
1
vote
1answer
135 views

wget internal buffer size

I'm constantly using wget to download many files over 1GB each. I'm getting concerned about how this may be straining my HDD. Can wget's internal buffer size be modified so that it writes to my HDD ...
2
votes
4answers
125 views

Set timeout for web page response with curl

I use a tool to monitor if the web-page is up and running. The tool uses curl command internally to fetch the output. However, when a web-page takes longer time to respond, it results back with a ...
0
votes
0answers
115 views

Linking synergyc: libcurl - undefined reference

I'm trying to compile synergy 1.5.0 on openSUSE 13.1 (Kernel 3.11.10-17). While linking, I get the following error: ... [ 83%] Built target ipc [ 84%] Built target client Linking CXX executable ...
3
votes
1answer
384 views

How do I enable rsync in libcurl?

I'm on Arch. When pacman tries to download a package from an ftp server, It fails with the error message Protocol rsync not supported or disabled in libcurl This has been bugging me for a little ...
16
votes
1answer
1k views

What does the @ (at) symbol before a filename mean in a curl command?

I am looking at an example of a curl command that uses the @ symbol before the filename to post data to the server. curl http://localhost/ --data-binary @file.txt What does this mean? Does it ...
2
votes
2answers
215 views

how to add curlcpp to the library/include path?

I'm using Arch Linux and have successfully built https://github.com/JosephP91/curlcpp However, I have no idea how to build the example program. I keep getting fatal error: curl_easy.h: No such file ...
-4
votes
1answer
459 views

cURL for loop variable [closed]

Is there a way to write a for loop with a URL and change the URL each time? I want to append &skip=XX with different numbers to skip, is there a way to write it so that the variable is in the URL? ...