cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

learn more… | top users | synonyms

0
votes
1answer
11 views

Why is curl failing write to body?

I am trying to install pathogen.vim plugin with following command: mkdir -p ~/.vim/autoload ~/.vim/bundle && \ curl -LSso ~/.vim/autoload/pathogen.vim https://tpo.pe/pathogen.vim But it is ...
1
vote
3answers
33 views

Joining two parts together to make a single script

I'm trying to create a script to do the following: extract the magnet link from a lynx bookmark and then use it as part of a curl command. like this: curl ...
1
vote
2answers
26 views

downloading images from webpage with different links

I am trying to download all the images from a webpage. The images are included as follows: <img src="https://alwaysSamePart.com/SomeRandomLinkThatVaries.jpg"> How should I parametrize my wget ...
0
votes
0answers
31 views

How to get curl progress bar in terminal?

I'm using curl to upload files from a bash shell. I know there's the option --progress-bar which is supposed to give an upload progress indicator, but no matter what, I can't get it to show. I do ...
4
votes
2answers
4k views

Use curl to send binary file through POST with content-type multipart/form-data;

A post request is made to: http://www.example.com/example/ and the post data is as follows: ------WebKitFormBoundaryB8NNdk2kNdndnnn Content-Disposition: form-data; name="picture[uploaded_data]"; ...
1
vote
0answers
12 views

size of array '__curl_rule_01__' is negative [migrated]

I'm struggling with an error whilst trying to compile GIT. I've searched Google and the GIT source issues/bugs for similar issues but i've not found anything to help me. Originally I received the ...
0
votes
3answers
2k views

The best way to add Unix Shell variables to CURL GET request

Let’s say I use curl –X GET command with the following link: “$WEBSITE_URL/ACTION_NAME/ACTION1;id=$ID?Command=TEST&id1=$ID1&id2=$ID2&id3=$ID3” As you can see, there are some $variables ...
1
vote
2answers
39 views

Copy output of curl to file

I'm running raspbian and using this bash script to take a photo every minute and upload it to my FTP server: #!/bin/bash while [ 1 ]; do DATE=$(date +"%Y-%m-%d_%H_%M_%S") raspistill -q 10 -th none ...
0
votes
0answers
23 views

Curl fails with ntlm proxy

My work uses an NTLM proxy. On my Linux servers and workstations we us cntlm to authenticate. I'm not having any issues with yum,wget, or the web browser, but for some reason curl refuses to work ...
8
votes
3answers
7k views

How do I use curl to download content from sourceforge?

Simply typing http://downloads.sourceforge.net/project/romfs/genromfs/0.5.2/genromfs-0.5.2.tar.gz works fine on a browser, but I'm trying to download from a CLI environment with limited utilities. ...
0
votes
2answers
2k views

download multiple files from sourceforge

Is there any way to download / mirror a folder structure with many files from sourceforge using wget/curl/similar tool? I've seen some examples using rsync or scp but I think that works only for SF ...
0
votes
1answer
35 views

cURL: Request to http and https by default

A server is running on 5000 port. I have to write a bash script to cURL that URL and parse the response. Here the problem is server can run on either http or https protocol. That means I have curl ...
0
votes
3answers
69 views

Make curl/cat not scroll down when given long text?

I have made a program where I read the text from a url using curl. The problem is that when given texts that are larger than the terminal window, it automatically scrolls down to the bottom, I want to ...
0
votes
1answer
1k views

Slow DNS resolve from curl/lynx etc

I have a strange issue with DNS resolving: Root of the problem is that I get curl errors: "Error executing HTTP request: name lookup timed out". Tried to ping some sites, all resolved fine (and fast). ...
3
votes
2answers
3k views

trying to install curl with homebrew, getting “incompatible library version” for libcurl.4.dylib

I am on OSX 10.9.5. I would like to use a later version of CURL than what is bundled with OSX, but I do not want to remove the OSX binary just in case, so I wanted to opt to install it via homebrew. ...
2
votes
2answers
3k views

Git pull error libcurl.so.3 not found

I have a php script to git pull from my github repository set up in my webservice hook urls like so: <?php echo shell_exec('~/git/usr/bin/git pull 2>&1'); ?> When I open this script ...
0
votes
0answers
24 views

Creating a manual delay (30 seconds) on server side (VSFTPD ) - while a bash client sends to it some files using curl

I have created a shell script in ubuntu that connects to a vsftp server using curl and transfer some files. In my testing 3 files and each file will take 0.3 seconds to get transferred (very fast to ...
1
vote
1answer
4k views

Proper escaping of double quotations for curl post data?

I'm trying to test out a server, by sending it JSON data and reading the response. I need to POST data like {"item":"value with spaces"} but when I use curl I find that it sends the backslashes as ...
1
vote
1answer
39 views

Get page in curl as text

Is there any option for curl that saves a page as text? I mean, in the same way a page can be saved in browser as Text Files. At least, Firefox has that option. I need it for a script, I simply ...
0
votes
2answers
72 views

Parsing HTTP response with shell

I want to parse below HTTP response but I cannot figure out how to grep the values separately using a single curl request. I need these two output. 1. status_code - (Array of HTTP status codes) 2. ...
1
vote
1answer
940 views

Curl Command PUT Method

curl -i -X PUT -H 'Content-Length: 1000' http://dfdc:dfdc@xx.xx.xx.xxx:xx/directory/ Above curl doesn't produce any response at Ubuntu shell prompt.
0
votes
1answer
61 views

curl hangs after client hello

When I execute the following command in Ubuntu: curl -v --insecure -XGET 'https://user:pass@IP_ADDR:PORT/SOME_FILE.php' I get this output: * Hostname was NOT found in DNS cache * Trying ...
1
vote
0answers
76 views

curl --data-urlencode and underscores

I've been using curl -XPOST to post some links to a Telegram channel via a bot api/key, the urls are in form of https://site/x/pre_encoded_string, where pre_encoded_string is in form (real samples) ...
0
votes
1answer
60 views

Curl error (2) when trying to connect with sftp

I have confirmed that I can login via Telnet $ telnet ftp.domain.com 990 Trying xx.xxx.xxx.xx... Connected to ftp.domain.com. Escape character is '^]'. I am getting the following error when ...
1
vote
0answers
32 views

How to get all files of a certain type from a virtual web path?

I try to use wget to download certain files from a website. But probably the virtual locations of the files do not represent their actual location. For example, if the link to the file is ...
0
votes
0answers
32 views

curl fails to login in to my router

I wanted to port my reconnect script from iMacros to curl. iMacros was great because it acts like regular web browser and you can record your actions and then edit the code, but i'd like to port it to ...
104
votes
2answers
118k views

Does curl have a --no-check-certificate option like wget?

I am trying to make a curl request to one of our local development servers running a dev site with a self-signed SSL cert. I am using curl from the command line. I saw some blog posts mentioning that ...
1
vote
1answer
48 views

Delay FIN-ACK sent on linux

For a project I need to delay the FIN-ACK sent in an SSL connection on Linux. Is there any way to do this? I can send an https request by using curl https://www.google.com, but how do I modify the TCP ...
2
votes
2answers
2k views

How to convert ssl ciphers to curl format?

The official ssl docs list ciphers in a different format than curl takes. For instance, if I want curl to use the cipher TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA, I have to pass it curl --ciphers ...
0
votes
2answers
17 views

curl stopped to post anything

In the below dev-netpro.sh script 'curl' does not post anything if my $FWK (i.e. '8fwk3_dev 2fwk0_dev' - could be up to 9 words) and $CON (in the example it is series of digits:'72 43 172 28021 8261 ...
1
vote
1answer
80 views

GET URI from webserver by IP address not matching hostname's IP

Using curl, I would like to request a URI from a web server via a specific IP address that does not necessarily match the forward DNS of the hostname. For example, suppose the hostname ...
1
vote
1answer
43 views

Error when substituting part of curl command with variable

I'm writing a script where I am running curl commands several times. The use of the curl command varies throughout the script and I would like to save myself time (in the future when I have to debug ...
24
votes
4answers
25k views

why would curl and wget result in a 403 forbidden?

I try to download a file with wget and curl and it is rejected with a 403 error (forbidden). I can view the file using the web browser on the same machine. I try again with my browser's user agent, ...
1
vote
1answer
41 views

Launch web page secured with HTTP authentication from a terminal kiosk

I am trying to launch Chromium to open a specific webpage that requires username and password login details. I can open the webpage no problem from the terminal however I have been unable to so far ...
1
vote
1answer
38 views

Curl or Lynx: stripping Javascript possible?

I am doing corpus generation through curl or lynx of some web pages. I have written a program in bash to strip away the html code (e.g., when I do lynx -source myurl), but the problem is that some ...
0
votes
1answer
48 views

Does anyone know a good pastebin where I can easily pickup the code with curl?

I'm in a domU with nothing but a console to work with an internet connection. I need to configure a file in it that I feel is too long to just type by hand. So I want to pick it up from somewhere ...
2
votes
3answers
102 views

curl page source from text file containing URLs

I have a text file containing up to 100 URLs. I am able to curl the page source from them using: cat /path/to/url.txt|xargs curl -o /path/to/output.txt This will download the page source for all of ...
0
votes
1answer
28 views

curl download multiple files with brace syntax

I am trying to download two files by the following syntax: curl -O http://domain/path/to/{file1,file2} The problem is that only the first file is actually saved locally, and the second was simply ...
0
votes
1answer
202 views

Connection refused on port 8081 using curl

I have two CentOS 7 boxes, called Turbo and Demo. I started a daemon/service on the first one, Turbo, and wish to call the service from the second one, Demo. I started the service to monitor port ...
2
votes
3answers
89 views

How to download files without full URL?

I was always wondering how to download the files through the Linux shell (I have wget, curl) that do not have a full URL of the file to be downloaded, but the full URL is passed e.g. to the browser ...
1
vote
2answers
91 views

(Shell Script) Variable not pass correctly when fetching value from file?

I have this section of curl command inside my shell script which caused a error 500 repsonse from the server. However, this code works when I manually run the command. curl -qgsSkH "Content-Type: ...
0
votes
2answers
81 views

How to get the contents of a webpage but after running javascript?

I am trying to download the contents of a web page using curl but it seems l am missing some content that l suspect to be generated by JavaScript. If the page runs on the browser l am able to get all ...
3
votes
4answers
21k views

Health check of web page using curl

I'd like to do a health check of a service by calling a specific url on it. Feels like the simplest solution would be to use cron to do the check every minute or so. In case of errors, cron sends me ...
49
votes
3answers
79k views

Does curl have a timeout?

So far I couldn't find anything really, but is it true that curl doesn't really time out at all? user@host:~# curl http://localhost/testdir/image.jpg I'm asking because I'm redirecting any request ...
30
votes
2answers
38k views

Any way to encode the url in curl command?

I have some url which has space in it's query param. I want to use this in curl, e.g. curl -G "http://localhost:30001/data?zip=47401&utc_begin=2013-8-1 00:00:00&utc_end=2013-8-2 ...
-1
votes
2answers
81 views

Curl, ping hangs/waits when using private network ips

I have a whole bunch of servers working inside my office premises private network. When I try to run my tests outside office network, curl/ping/python/nodejs requests library, all of them wait ...
2
votes
2answers
59 views

Extract info with curl or something

I plan to write a script for automatic VirtualBox build I see every release VirtualBox put a version (of course) and a release version. In this example ...
0
votes
1answer
24 views

Using xargs to generate links

I have a file that looks like this: abc,123,x xabc,345,xy cabc,6234,ab abgc,12,yo jabc,9991,to I need to generate a list of links: http://www.mywebsite.com?param1=abc&param2=123&param3=x ...
1
vote
1answer
349 views

Use curl to download list of files in csv

I have a csv of JPG url extensions. http://www.example.com/images/[url_extension] I want to use curl to loop through the CSV and download the jpg at each extension. So far I have the following, but ...
1
vote
0answers
130 views

TOR hidden service not always accessible through cURL. Takes multiple tries

When I try to access a hidden service on TOR using cURL, for some reason I'm not getting access to the site 100% of the time. Many times it returns "curl: (7) Can't complete SOCKS5 connection to ...