cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

learn more… | top users | synonyms

1
vote
1answer
129 views

Disable SSLv3 In cURL?

I'm having a problem connecting to a website that is hosted with CloudFlare using cURL. When I try to connect to the website with HTTPS (using curl -v https://www.xxxxxx.com), it says: * About to ...
0
votes
1answer
359 views

How to print gmail inbox messages

I want to print inbox messages one by one (like cat someFile) so that I can parse the message contents. something like printGmail InboxMesg1 | grep some | sed some Using curl I can access the ...
0
votes
1answer
656 views

Slow DNS resolve from curl/lynx etc

I have a strange issue with DNS resolving: Root of the problem is that I get curl errors: "Error executing HTTP request: name lookup timed out". Tried to ping some sites, all resolved fine (and fast). ...
1
vote
2answers
19 views

Escape strings sent in curl data when using application/json

I'm using CURL to send JSON data. Here is an example: mycomputer$ curl -H "Content-Type: application/json" -d "{ "some_string": "Hello mom it's me!" }" ...
0
votes
1answer
901 views

Proper escaping of double quotations for curl post data?

I'm trying to test out a server, by sending it JSON data and reading the response. I need to POST data like {"item":"value with spaces"} but when I use curl I find that it sends the backslashes as ...
0
votes
2answers
1k views

Git pull error libcurl.so.3 not found

I have a php script to git pull from my github repository set up in my webservice hook urls like so: <?php echo shell_exec('~/git/usr/bin/git pull 2>&1'); ?> When I open this script ...
0
votes
1answer
43 views

curl wget - 403 Forbidden

I am trying to download a site as you see bellow with curl or wget but either one seems to work. I tried different options like "curl -k" seemed promising, but did not work. Every one is allowed to ...
1
vote
1answer
66 views

Laravel , Composer and Curl installation on Linux Mint

I have a Linux Mint machine I am working on. I want to install Laravel on it. When I searched for this I got this command: curl -sS https://getcomposer.org/installer | php from ...
2
votes
1answer
2k views

How can I queue up an entire directory for FTP?

Currently I know how to do this: curl -T file.zip ftp://server.domain.com/ --user username:password Which will let me do a single file. However I can't figure out how to do it for a directory. I ...
9
votes
3answers
5k views

Get URL's redirect target with curl

I would like to check where a single URL redirects. An example of that could be a link from Google's search result page (where a click always goes through Google server). Can I do that with curl?
1
vote
0answers
27 views

Curl takes JSON file as input but not the content of a JSON file

I am uploading a JSON file using curl. I give the following in the command line as: $ curl -v --header "Content-Type: application/json" -X POST \ http://site -d @test.json where test.json is ...
2
votes
1answer
37 views

How to find out how much of internet bandwidth is used by all processes except one specific process?

As a followup question to this one: I am downloading a file on multiple remote computers using curl command and am using the --limit-rate parameter to limit the download speed on the ones whose ...
2
votes
1answer
28 views

Is it possible to dynamically change the --limit-rate parameter of curl?

As a followup question to this one: I am using the --limit-rate parameter to limit the download speed on computers whose internet is being used: curl --limit-rate 10k -r 104857601-209715200 -o ...
0
votes
0answers
203 views

Linux curl request for SOAP webservice call

I have a SOAP webservice WSDL and when I make a call with SOAP-UI tool, it works perfectly fine.... Now, Im trying to mimic the same call using LINUX CURL but get a 404 error, Here is my CURL ...
1
vote
0answers
21 views

FreeBSD: spdylay build error

I try to install the latest curl updates from ports (curl-7.37.1_2) with HTTP/2.0 support enabled and I need to build spdylay for that purpose, but I keep getting the following strange errors and ...
19
votes
4answers
9k views

Throttle the download speed of wget or curl while downloading

Is it possible to throttle (limit) the download speed of wget or curl ? Is it possible to change the throttle value while it is downloading ?
7
votes
2answers
10k views

Any way to encode the url in curl command?

I have some url which has space in it's query param. I want to use this in curl, e.g. curl -G "http://localhost:30001/data?zip=47401&utc_begin=2013-8-1 00:00:00&utc_end=2013-8-2 ...
3
votes
2answers
88 views

How can I check GMail messages with prompt for password from a script?

I'm using zsh on Ubuntu 14.04 over SSH using Putty and I'm setting up the key bindings for my keyboard. Because zsh doesn't seem to make use of my function keys I thought I'd setup scripts to do ...
1
vote
1answer
55 views

curl timeout troubleshooting

I tried to curl popular websites e.g. curl google.com or curl google.com:80 and there is always a timeout error. Some troubleshooting steps performed: Able to curl localhost with response Able to ...
1
vote
1answer
27 views

Get size of sent curl request

Is there a way to get the size of a curl request programmatically? E.g. if I do curl 'http://www.example.com/url' \ -H 'Cookie: cookie=cookiedata;' \ -H 'X-CSRFToken: csrffake' \ --data ...
4
votes
3answers
15k views

Set a network range in the no_proxy environment variable

I'm in a network using a proxy. I've got machines using lots of scripts here and there accessing each other over HTTP. The network is 10.0.0.0/8. My proxy is 10.1.1.1:81, so I set it up accordingly: ...
38
votes
3answers
9k views

What is the difference between curl and wget?

I am keen to know the difference between curl and wget. Both are used to get files and documents but what the key difference between them. Why are there two different programs?
1
vote
4answers
701 views

Write output of wget or curl to a custom filename based on the url

For example I have a link http://www.abc.com/123/def/ghi/jkl.mno. I want to download it using wget or curl and get the name of output file as def_ghi_jkl.mno, where the part def_ghi is taken from the ...
1
vote
1answer
78 views

wget internal buffer size

I'm constantly using wget to download many files over 1GB each. I'm getting concerned about how this may be straining my HDD. Can wget's internal buffer size be modified so that it writes to my HDD ...
1
vote
4answers
64 views

Set timeout for web page response with curl

I use a tool to monitor if the web-page is up and running. The tool uses curl command internally to fetch the output. However, when a web-page takes longer time to respond, it results back with a ...
2
votes
1answer
173 views

Extract download progress from curl output

I'm trying to extract the download progress of a file that's being retrieved by curl. I tried this, but this doesn't work: curl --progress-bar http://127.0.0.1/test.tar.bz2 -o test.tar.bz2 ...
2
votes
2answers
2k views

Running thousands of curl background processes in parallel in bash script

I am running thounsand of curl background processes in parallel in the following bash script START=$(date +%s) for i in {1..100000} do curl -s "http://some_url_here/"$i > $i.txt& ...
11
votes
3answers
16k views

Does curl have a timeout?

So far I couldn't find anything really, but is it true that curl doesn't really time out at all? user@host:~# curl http://localhost/testdir/image.jpg I'm asking because I'm redirecting any request ...
5
votes
4answers
9k views

How do I get the http status of a site in bash?

I figure curl would do the job. I wrote in a bash script: #!/bin/sh function test { res=`curl -I $1 | grep HTTP/1.1 | awk {'print $2'}` if [ $res -ne 200 ] then echo "Error $res ...
0
votes
0answers
68 views

Linking synergyc: libcurl - undefined reference

I'm trying to compile synergy 1.5.0 on openSUSE 13.1 (Kernel 3.11.10-17). While linking, I get the following error: ... [ 83%] Built target ipc [ 84%] Built target client Linking CXX executable ...
3
votes
1answer
169 views

How do I enable rsync in libcurl?

I'm on Arch. When pacman tries to download a package from an ftp server, It fails with the error message Protocol rsync not supported or disabled in libcurl This has been bugging me for a little ...
6
votes
3answers
1k views

How to tweet using terminal?

I would like to tweet a message using terminal. I tried something like: curl -u 'TwitterUsername':'TwitterPassword' -d status=”Your Message Here” https://twitter.com/statuses/update.xml but seems ...
16
votes
1answer
945 views

What does the @ (at) symbol before a filename mean in a curl command?

I am looking at an example of a curl command that uses the @ symbol before the filename to post data to the server. curl http://localhost/ --data-binary @file.txt What does this mean? Does it ...
2
votes
2answers
115 views

how to add curlcpp to the library/include path?

I'm using Arch Linux and have successfully built https://github.com/JosephP91/curlcpp However, I have no idea how to build the example program. I keep getting fatal error: curl_easy.h: No such file ...
-4
votes
1answer
153 views

cURL for loop variable [closed]

Is there a way to write a for loop with a URL and change the URL each time? I want to append &skip=XX with different numbers to skip, is there a way to write it so that the variable is in the URL? ...
0
votes
0answers
221 views

How to add SSL with cURL URL using Ubuntu Terminal

While running a Twitter API from cURL in Ubuntu Terminal it asked me to use SSL. After searching for it, I tried: sudo curl -s https://localhost:8080/tweets/HLaddha sudo curl -k ...
17
votes
3answers
3k views

why would curl and wget result in a 403 forbidden?

I try to download a file with wget and curl and it is rejected with a 403 error (forbidden). I can view the file using the web browser on the same machine. I try again with my browser's user agent, ...
1
vote
1answer
209 views

Login site using cURL

I am trying to login from cURL command line with the command curl --data "username=user&password=pass&submit=Login" http://www.ip.com:8080/LoginApplication/Login.jsp And after that trying to ...
-1
votes
1answer
110 views

Click a link to download file using curl [closed]

I have an HTML page on which several links are there, I want to click one link and that will download relevant file for me. How do I simulate this using curl. All links have different name attribute
1
vote
1answer
119 views

How to use cURL commandline to download a file, for which the link is hidden(activates on-click only)

I was referring to this question. However, I am wondering how to do the same with curl. So far, I have tried the following: curl -O output.rar --referer http://subs.sab.bz/ ...
2
votes
2answers
3k views

Using curl to access basic auth protected website via proxy (polipo)

I am trying to download a file protected via basic auth: curl "http://User:Pass@example.com/blub/bla.bin" This is working fine. As soon as I tell curl to use my locally installed polipo it fails: ...
0
votes
1answer
83 views

Uploading a file over FTPS

As the title says, I need to automatically upload an excel file to a FTPS server. Right now I'm using curl but if there is a better option out there, I'm all ears. What I have so far: curl -k ...
0
votes
1answer
223 views

Download all source files for a webpage

I want to download the source files for a webpage which is a database search engine. Using curl I'm only able to download the main html page. I would also like to download all the javascript files, ...
5
votes
3answers
801 views

Crontab job not emailing on failure

I have a cron job on Debian: 1 * * * * /home/paradroid/bin/myscript.sh >/dev/null There is an installed and configured MTA, and I have received emails when the script has a syntax error, so I ...
2
votes
0answers
86 views

Difference between “curl -XPUT --data-binary @${file_path}” and “curl -XPUT -T ${file_path}”?

While using curl to POST or PUT a file to a url, there are two different ways to load the file content: -T ${file_path} --data-binary @${file_path} or -d $@{file_path} (for ascii data files) What ...
1
vote
1answer
125 views

Wget or curl a self-signed certificate from server

From my browser, I can browse to a machine in my companies local intranet and (after marking the certificate as trusted) export that certificate to a file. I'm trying to automate this process into a ...
4
votes
2answers
346 views

Is there a command line method by which I can check whether a downloaded file is complete or broken?

I'm writing a script that involves downloading and manipulating a file, and I want to ensure that the file is not incomplete (due to e.g. a dropped connection) before I work on it.
2
votes
0answers
136 views

Problems uploading a file via WebDAV?

I've configured on my Linux server (SLES11) with IHS Webserver with WebDAV enabled. A file upload via curl is successful using a URL like this: $ curl --insecure --upload-file testfile.txt \ ...
0
votes
2answers
763 views

How to run a command with a hidden password

I need to run a curl command that accesses a website that another person has the password to. e.g. curl --basic --user myfriendsname:friendspassword http://www.updateinfo.com I need a way where I ...
1
vote
1answer
935 views

curl url call in for loop? [closed]

I am working with bash and I am trying to make a curl url call in a for loop. Below is my simple curl call - curl -v --header "Connection: keep-alive" ...