cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

learn more… | top users | synonyms

1
vote
1answer
98 views

curl: (35) error:14077438:SSL routines:SSL23_GET_SERVER_HELLO:tlsv1 alert internal error

I am using curl 7.26.0-1+wheezy11 on Debian Wheezy, and whenever I try to access the URL https://www.basebit.com.br, it fails with the message: $ curl https://www.basebit.com.br curl: (35) ...
14
votes
3answers
19k views

Does curl have a timeout?

So far I couldn't find anything really, but is it true that curl doesn't really time out at all? user@host:~# curl http://localhost/testdir/image.jpg I'm asking because I'm redirecting any request ...
0
votes
1answer
769 views

Slow DNS resolve from curl/lynx etc

I have a strange issue with DNS resolving: Root of the problem is that I get curl errors: "Error executing HTTP request: name lookup timed out". Tried to ping some sites, all resolved fine (and fast). ...
1
vote
0answers
23 views

Transparent proxy to other IP of thousand ports

I was bought a service that only allow a IP, the IP that i say, only one, but I need use this from more IP's. I think that I can install in this computer a system to do a transparent proxy for ...
0
votes
1answer
440 views

How to print gmail inbox messages

I want to print inbox messages one by one (like cat someFile) so that I can parse the message contents. something like printGmail InboxMesg1 | grep some | sed some Using curl I can access the ...
1
vote
1answer
47 views

Curl failed to read known_hosts file

I'm trying to download a file from a Centos 6 server using another Centos 6 server as client and curl with the scp protocol and I'm getting this error output: $ curl -v -O scp://cz/path/to/file * ...
0
votes
1answer
13 views

Loop across url with static tokens with Oauth

I need to write a loop where I need to pass a "token" (which is fixed) and a variable (i) in the url. Is there any way I can achieve that? I wrote the following code but it is not working. If I put ...
0
votes
1answer
1k views

Proper escaping of double quotations for curl post data?

I'm trying to test out a server, by sending it JSON data and reading the response. I need to POST data like {"item":"value with spaces"} but when I use curl I find that it sends the backslashes as ...
1
vote
1answer
44 views

Sending CURL request with custom IP

Shouldn't it be possible? Let's assume I don't need a response, I just want to send a request. Shouldn't we be able to alter tcp/ip headers, because our computer sends it? I am probably missing ...
0
votes
2answers
2k views

Git pull error libcurl.so.3 not found

I have a php script to git pull from my github repository set up in my webservice hook urls like so: <?php echo shell_exec('~/git/usr/bin/git pull 2>&1'); ?> When I open this script ...
0
votes
1answer
36 views

to check the url is live

I have written a script to check if our three URLs are up else echo down.now the problem is even if the URLs are down in that script I get the message URLs are up In the code I have greped 302 ...
0
votes
1answer
32 views

Curl fails to download a file during start up

I am adding startup script in Ubuntu with update-rc.d. My script says : #!/bin/bash nohup curl -C - -o ~/Downloads/linuxmint-17-xfce-dvd-64bit.iso.part ...
1
vote
1answer
30 views

For loop for curling on multiple pages with API's

I am trying to crawl a website for fetching pages using an API. When I issue the command cd desktop/mysite ; curl -O https://api.mysite.com/info?page=2 I get the data on the desktop. Then I wanted ...
0
votes
0answers
13 views

Could session.cache_expire time in php5-fpm/php.ini cause PHP cURL responses to be empty?

Could session.cache_expire time in php5-fpm/php.ini cause PHP cURL requests to have empty responses, if the cache expired before the response came back? My code is like this: $ch = ...
0
votes
1answer
15 views

How do I find out the last-used --max-time in cURL?

I just want to output to stdout cURL's last-used --max-time. As cURL's manpage states: -m, --max-time <seconds> Maximum time in seconds that you allow the whole operation to take. [snip] ...
2
votes
1answer
51 views

Posting XML through cURL using --data-binary

I have this really typical problem. I have an XML file that I have to post to a server. I was told by the network engineer of that site to use the cURL function. The function that he provided to me ...
2
votes
1answer
212 views

How to grep the output of cURL?

I need to retrieve the expiry date of an SSL cert. The curl application does provide this information: $ curl -v https://google.com/ * Hostname was NOT found in DNS cache * Trying ...
4
votes
2answers
1k views

How to check whether a command such as curl completed without error?

I am using curl to upload a file to a server via an HTTP post. curl -X POST -d@myfile.txt server-URL When I manually execute this command on the command line, I get a response from the server like ...
-2
votes
1answer
58 views

Resume failed download using Linux command line tool

How to resume partially downloaded file using linux commandline tool. I downloaded large file partially i.e. 400MB out of 900MB due to power interruption, but when I start downloading again it ...
2
votes
1answer
57 views

splitting a CSV and keeping the header without intermediate files

I am trying to split a dozen 100MB+ csv files into managable smaller files for a curl post. I have managed to do it but with a lot of temporary files and IO. It's taking an eternity. I am hoping ...
1
vote
0answers
24 views

IPTable rules for transparent outbound proxy

I've recently installed MITMProxy (similar to Squid) which I'm currently using to route outbound HTTP requests from my Ubuntu machine to another server (adding a header along the way). When I use ...
0
votes
1answer
56 views

trying to install curl with homebrew, getting “incompatible library version” for libcurl.4.dylib

I am on OSX 10.9.5. I would like to use a later version of CURL than what is bundled with OSX, but I do not want to remove the OSX binary just in case, so I wanted to opt to install it via homebrew. ...
3
votes
1answer
337 views

Given a mime-type get the corresponding file extension

I want to download a file using curl to a temporary directory with the appropriate extension. Currently I do something like this: tmp="$(mktemp -t 'curl')" curl -o "$tmp" ...
1
vote
1answer
2k views

Disable SSLv3 In cURL?

I'm having a problem connecting to a website that is hosted with CloudFlare using cURL. When I try to connect to the website with HTTPS (using curl -v https://www.xxxxxx.com), it says: * About to ...
1
vote
2answers
34 views

Escape strings sent in curl data when using application/json

I'm using CURL to send JSON data. Here is an example: mycomputer$ curl -H "Content-Type: application/json" -d "{ "some_string": "Hello mom it's me!" }" ...
0
votes
1answer
63 views

curl wget - 403 Forbidden

I am trying to download a site as you see bellow with curl or wget but either one seems to work. I tried different options like "curl -k" seemed promising, but did not work. Every one is allowed to ...
1
vote
1answer
126 views

Laravel , Composer and Curl installation on Linux Mint

I have a Linux Mint machine I am working on. I want to install Laravel on it. When I searched for this I got this command: curl -sS https://getcomposer.org/installer | php from ...
2
votes
1answer
2k views

How can I queue up an entire directory for FTP?

Currently I know how to do this: curl -T file.zip ftp://server.domain.com/ --user username:password Which will let me do a single file. However I can't figure out how to do it for a directory. I ...
9
votes
3answers
6k views

Get URL's redirect target with curl

I would like to check where a single URL redirects. An example of that could be a link from Google's search result page (where a click always goes through Google server). Can I do that with curl?
1
vote
0answers
42 views

Curl takes JSON file as input but not the content of a JSON file

I am uploading a JSON file using curl. I give the following in the command line as: $ curl -v --header "Content-Type: application/json" -X POST \ http://site -d @test.json where test.json is ...
2
votes
1answer
46 views

How to find out how much of internet bandwidth is used by all processes except one specific process?

As a followup question to this one: I am downloading a file on multiple remote computers using curl command and am using the --limit-rate parameter to limit the download speed on the ones whose ...
2
votes
1answer
36 views

Is it possible to dynamically change the --limit-rate parameter of curl?

As a followup question to this one: I am using the --limit-rate parameter to limit the download speed on computers whose internet is being used: curl --limit-rate 10k -r 104857601-209715200 -o ...
0
votes
0answers
456 views

Linux curl request for SOAP webservice call

I have a SOAP webservice WSDL and when I make a call with SOAP-UI tool, it works perfectly fine.... Now, Im trying to mimic the same call using LINUX CURL but get a 404 error, Here is my CURL ...
1
vote
0answers
23 views

FreeBSD: spdylay build error

I try to install the latest curl updates from ports (curl-7.37.1_2) with HTTP/2.0 support enabled and I need to build spdylay for that purpose, but I keep getting the following strange errors and ...
20
votes
4answers
10k views

Throttle the download speed of wget or curl while downloading

Is it possible to throttle (limit) the download speed of wget or curl ? Is it possible to change the throttle value while it is downloading ?
10
votes
2answers
12k views

Any way to encode the url in curl command?

I have some url which has space in it's query param. I want to use this in curl, e.g. curl -G "http://localhost:30001/data?zip=47401&utc_begin=2013-8-1 00:00:00&utc_end=2013-8-2 ...
3
votes
2answers
124 views

How can I check GMail messages with prompt for password from a script?

I'm using zsh on Ubuntu 14.04 over SSH using Putty and I'm setting up the key bindings for my keyboard. Because zsh doesn't seem to make use of my function keys I thought I'd setup scripts to do ...
1
vote
1answer
87 views

curl timeout troubleshooting

I tried to curl popular websites e.g. curl google.com or curl google.com:80 and there is always a timeout error. Some troubleshooting steps performed: Able to curl localhost with response Able to ...
1
vote
1answer
54 views

Get size of sent curl request

Is there a way to get the size of a curl request programmatically? E.g. if I do curl 'http://www.example.com/url' \ -H 'Cookie: cookie=cookiedata;' \ -H 'X-CSRFToken: csrffake' \ --data ...
4
votes
3answers
16k views

Set a network range in the no_proxy environment variable

I'm in a network using a proxy. I've got machines using lots of scripts here and there accessing each other over HTTP. The network is 10.0.0.0/8. My proxy is 10.1.1.1:81, so I set it up accordingly: ...
39
votes
3answers
10k views

What is the difference between curl and wget?

I am keen to know the difference between curl and wget. Both are used to get files and documents but what the key difference between them. Why are there two different programs?
1
vote
4answers
977 views

Write output of wget or curl to a custom filename based on the url

For example I have a link http://www.abc.com/123/def/ghi/jkl.mno. I want to download it using wget or curl and get the name of output file as def_ghi_jkl.mno, where the part def_ghi is taken from the ...
1
vote
1answer
93 views

wget internal buffer size

I'm constantly using wget to download many files over 1GB each. I'm getting concerned about how this may be straining my HDD. Can wget's internal buffer size be modified so that it writes to my HDD ...
2
votes
4answers
99 views

Set timeout for web page response with curl

I use a tool to monitor if the web-page is up and running. The tool uses curl command internally to fetch the output. However, when a web-page takes longer time to respond, it results back with a ...
2
votes
1answer
229 views

Extract download progress from curl output

I'm trying to extract the download progress of a file that's being retrieved by curl. I tried this, but this doesn't work: curl --progress-bar http://127.0.0.1/test.tar.bz2 -o test.tar.bz2 ...
2
votes
2answers
3k views

Running thousands of curl background processes in parallel in bash script

I am running thounsand of curl background processes in parallel in the following bash script START=$(date +%s) for i in {1..100000} do curl -s "http://some_url_here/"$i > $i.txt& ...
5
votes
4answers
10k views

How do I get the http status of a site in bash?

I figure curl would do the job. I wrote in a bash script: #!/bin/sh function test { res=`curl -I $1 | grep HTTP/1.1 | awk {'print $2'}` if [ $res -ne 200 ] then echo "Error $res ...
0
votes
0answers
84 views

Linking synergyc: libcurl - undefined reference

I'm trying to compile synergy 1.5.0 on openSUSE 13.1 (Kernel 3.11.10-17). While linking, I get the following error: ... [ 83%] Built target ipc [ 84%] Built target client Linking CXX executable ...
3
votes
1answer
260 views

How do I enable rsync in libcurl?

I'm on Arch. When pacman tries to download a package from an ftp server, It fails with the error message Protocol rsync not supported or disabled in libcurl This has been bugging me for a little ...
6
votes
3answers
1k views

How to tweet using terminal?

I would like to tweet a message using terminal. I tried something like: curl -u 'TwitterUsername':'TwitterPassword' -d status=”Your Message Here” https://twitter.com/statuses/update.xml but seems ...