cURL is a CLI tool for issuing HTTP GET, POST, & PUT request.

learn more… | top users | synonyms

1
vote
1answer
14 views

unzip/untar files using Curl in ftp server

In the curl command we can delete,rename and move files from a FTP server using Curl like in the command below: curl -v -u username:pwd ftp://host/FileTodelete -Q "DELE FileTodelete" Can we untar ...
0
votes
1answer
34 views

Using Named Pipes in Bash created in a C Program

I have a C code that takes a rather large input. At every iteration, it processes a small chunk of it and it should send that processed chunk to S3 using curl. In the end, it will generate a number of ...
0
votes
1answer
44 views

Parse xml returned from curl within a bash script

I've been digging through stackexchange for the past few days and I've found bits and pieces of what I'm trying to accomplish, but I'm unsure how to put it all together... I'm trying to create a ...
3
votes
1answer
103 views

curl outfile variable not working in bash script

Attempting to shorten a bash script that uses curl to fetch multiple API calls takes something like this: curl --user $USER:$PASS https://api.example.com/foo -o 'foo.json' curl --user $USER:$PASS ...
1
vote
2answers
36 views

How to treat remote txt file as stream?

A web service writes its output in a text file. I can fetch that log via: curl -u user:password -k https://log.my-app.com/log.2016-04-04.txt Yet this always only fetches a current "full" file even ...
1
vote
1answer
36 views

Cronjob Create File Every Execute

I can create a cron job for every 5 minutes with following codes: */5 * * * * root bash /etc/cron.d/mongo/5min.sh In the /etc/cron.d/mongo/5min.sh file send request with cURL: #!/bin/sh ...
1
vote
1answer
43 views

bash scripting - wget or curl file with action based on the status 200 or not

I would like to write a script where I try to download a file with wget (or curl if is really not something that can be done with wget) and do 2 actions if the file exists and it's downloaded ...
1
vote
1answer
29 views

curl load IPs from Text file

I have a list of IPs and want to run a specific curl command on each of them. The command is: curl --user test:test http://192.168.1.1/security/pkm.html | egrep '@company|config.pkm.password' ...
0
votes
2answers
79 views

Curl and Grep to Parsing Content

I need to parse the output of a curl command: curl --user test:test http://192.168.1.1/security/pkm.html | egrep '@company|config.pkm.password' This returns: <input type="text" ...
1
vote
1answer
36 views

How to pipe html into lynx?

I am testing some ajax call from the console. I like get rid of the meta-information noise that is html markup and just read the content, hence I like to pipe it into a terminal browser, e.g. lynx. ...
1
vote
0answers
44 views

php curl script working in cli but not on crontab [closed]

I have set the following on crontab */1 * * * * /opt/php-5.3/bin/php -f /var/httpd/appliance/appliance/docs/vip_dashboard_script.php >> /tmp/vip.log 2>&1 the contents of my script. ...
1
vote
3answers
132 views

POST json data with cURL from a while loop - bash shell

I have a JSON output from which I need to extract an ID and Iterate through them and send multiple request to API execute REST API with curl. For example: This is how the JSON output looks like: { ...
0
votes
1answer
22 views

Problems with crontab du to curl

I am trying to send the output of a treesize command to my webserver for further processing. This is not going well, I guess mainly because I am very new to Linux/Debian7 :). Hope you can help me. ...
1
vote
1answer
23 views

How can I give an argument as an external file to curl with url encode?

I try to request query.wikidata.org using curl. The following command line works perfectly : $ curl -G https://query.wikidata.org/bigdata/namespace/wdq/sparql --data-urlencode query='PREFIX wd: ...
0
votes
1answer
45 views

How to grep response to figure out how many calls got timed out?

I have a curl command which is calling one of our service so if my service timesout, it returns JSON response like below: [{"results":{"response":null},"error":{"errorCode":1001,"message":"Service ...
0
votes
1answer
15 views

wget TLSv1 behaves the same as TLSv1_2

I used wireshark to compare curl --tlsv1.0 vs --tlsv1.2 The server handshake obediently uses TLSv1.0 for servers that support it (the point is to check to validate they don't): wget url ...
0
votes
0answers
24 views

Curl ebay multi page ebay api xml to a single text file

I am using the curl -K url.txt > output.txt command to transfer the xml output of an ebay api search to a text file. The search I am performing is multi page, but I am unsure how to export ...
-1
votes
1answer
34 views

WGET encountering 403 when trying to access filter - nginx [closed]

I'm trying to download some images from an asset folder of a site, that folder happens to be forbidden. I've tried various suggestions online including a referrer flag for google.com and setting the ...
-2
votes
3answers
62 views

How to view only contents of a website without the source content (HTML)?

I tried using curl but it displays lot of HTML content (Source). I wanted to know whether it is possible to view contents of the webpage - say a table with some information.
3
votes
1answer
58 views

How do I set up ssh port forwarding and run a curl in a single command?

I want to set up port forwarding with ssh like so: ssh user@10.10.10.10 -L 5656:remoteserver:80 -N and then run a curl command: curl http://localhost:5656/my/endpoint/ I can accomplish this just ...
1
vote
0answers
34 views

How to avoid curl trying IPv6 name resolution

From a docker container when I try to curl 'another container name', curl first tries to resolve the name to IPv6. This causes few seconds delay because the web server is not reachable over ipv6. I ...
1
vote
1answer
129 views

How to fix curl sslv3 alert handshake failure on Gentoo?

I'm trying open a website with cURL like this: $ curl -vH "Accept: application/json" https://www.rocketleaguereplays.com/api/replays/-1/ The output is: * Trying 104.24.114.83... * Connected to ...
1
vote
1answer
49 views

Script a mobile recharge website

I recently come to know that I can curl a website using the bash command curl --user user:pass xyz.com I have an idea for recharging my mobile using the bash script. I want to write a script which ...
2
votes
1answer
201 views

Filtering JSON request with JQ and bash scripting

I'm requesting a JSON from Twitch with: curl --silent -H 'Accept: application/vnd.twitchtv.v3+json' -X GET https://api.twitch.tv/kraken/streams/$1 where $1 is the input I send for my function. Now ...
0
votes
1answer
93 views

Why is curl failing write to body?

I am trying to install pathogen.vim plugin with following command: mkdir -p ~/.vim/autoload ~/.vim/bundle && \ curl -LSso ~/.vim/autoload/pathogen.vim https://tpo.pe/pathogen.vim But it is ...
1
vote
3answers
44 views

Joining two parts together to make a single script

I'm trying to create a script to do the following: extract the magnet link from a lynx bookmark and then use it as part of a curl command. like this: curl ...
1
vote
2answers
49 views

downloading images from webpage with different links

I am trying to download all the images from a webpage. The images are included as follows: <img src="https://alwaysSamePart.com/SomeRandomLinkThatVaries.jpg"> How should I parametrize my wget ...
0
votes
0answers
181 views

How to get curl progress bar in terminal?

I'm using curl to upload files from a bash shell. I know there's the option --progress-bar which is supposed to give an upload progress indicator, but no matter what, I can't get it to show. I do ...
1
vote
2answers
90 views

Copy output of curl to file

I'm running raspbian and using this bash script to take a photo every minute and upload it to my FTP server: #!/bin/bash while [ 1 ]; do DATE=$(date +"%Y-%m-%d_%H_%M_%S") raspistill -q 10 -th none ...
0
votes
0answers
175 views

Curl fails with ntlm proxy

My work uses an NTLM proxy. On my Linux servers and workstations we us cntlm to authenticate. I'm not having any issues with yum,wget, or the web browser, but for some reason curl refuses to work ...
0
votes
1answer
76 views

cURL: Request to http and https by default

A server is running on 5000 port. I have to write a bash script to cURL that URL and parse the response. Here the problem is server can run on either http or https protocol. That means I have curl ...
0
votes
0answers
31 views

Creating a manual delay (30 seconds) on server side (VSFTPD ) - while a bash client sends to it some files using curl

I have created a shell script in ubuntu that connects to a vsftp server using curl and transfer some files. In my testing 3 files and each file will take 0.3 seconds to get transferred (very fast to ...
1
vote
1answer
60 views

Get page in curl as text

Is there any option for curl that saves a page as text? I mean, in the same way a page can be saved in browser as Text Files. At least, Firefox has that option. I need it for a script, I simply ...
0
votes
2answers
140 views

Parsing HTTP response with shell

I want to parse below HTTP response but I cannot figure out how to grep the values separately using a single curl request. I need these two output. 1. status_code - (Array of HTTP status codes) 2. ...
0
votes
1answer
168 views

curl hangs after client hello

When I execute the following command in Ubuntu: curl -v --insecure -XGET 'https://user:pass@IP_ADDR:PORT/SOME_FILE.php' I get this output: * Hostname was NOT found in DNS cache * Trying ...
1
vote
0answers
164 views

curl --data-urlencode and underscores

I've been using curl -XPOST to post some links to a Telegram channel via a bot api/key, the urls are in form of https://site/x/pre_encoded_string, where pre_encoded_string is in form (real samples) ...
0
votes
0answers
53 views

curl fails to login in to my router

I wanted to port my reconnect script from iMacros to curl. iMacros was great because it acts like regular web browser and you can record your actions and then edit the code, but i'd like to port it to ...
1
vote
0answers
42 views

How to get all files of a certain type from a virtual web path?

I try to use wget to download certain files from a website. But probably the virtual locations of the files do not represent their actual location. For example, if the link to the file is ...
0
votes
1answer
157 views

Curl error (2) when trying to connect with sftp

I have confirmed that I can login via Telnet $ telnet ftp.domain.com 990 Trying xx.xxx.xxx.xx... Connected to ftp.domain.com. Escape character is '^]'. I am getting the following error when ...
1
vote
1answer
90 views

Delay FIN-ACK sent on linux

For a project I need to delay the FIN-ACK sent in an SSL connection on Linux. Is there any way to do this? I can send an https request by using curl https://www.google.com, but how do I modify the TCP ...
0
votes
2answers
19 views

curl stopped to post anything

In the below dev-netpro.sh script 'curl' does not post anything if my $FWK (i.e. '8fwk3_dev 2fwk0_dev' - could be up to 9 words) and $CON (in the example it is series of digits:'72 43 172 28021 8261 ...
1
vote
1answer
138 views

GET URI from webserver by IP address not matching hostname's IP

Using curl, I would like to request a URI from a web server via a specific IP address that does not necessarily match the forward DNS of the hostname. For example, suppose the hostname ...
1
vote
1answer
79 views

Launch web page secured with HTTP authentication from a terminal kiosk

I am trying to launch Chromium to open a specific webpage that requires username and password login details. I can open the webpage no problem from the terminal however I have been unable to so far ...
1
vote
1answer
55 views

Curl or Lynx: stripping Javascript possible?

I am doing corpus generation through curl or lynx of some web pages. I have written a program in bash to strip away the html code (e.g., when I do lynx -source myurl), but the problem is that some ...
2
votes
1answer
84 views

Error when substituting part of curl command with variable

I'm writing a script where I am running curl commands several times. The use of the curl command varies throughout the script and I would like to save myself time (in the future when I have to debug ...
0
votes
1answer
54 views

Does anyone know a good pastebin where I can easily pickup the code with curl?

I'm in a domU with nothing but a console to work with an internet connection. I need to configure a file in it that I feel is too long to just type by hand. So I want to pick it up from somewhere ...
0
votes
2answers
58 views

curl download multiple files with brace syntax

I am trying to download two files by the following syntax: curl -O http://domain/path/to/{file1,file2} The problem is that only the first file is actually saved locally, and the second was simply ...
0
votes
1answer
673 views

Connection refused on port 8081 using curl

I have two CentOS 7 boxes, called Turbo and Demo. I started a daemon/service on the first one, Turbo, and wish to call the service from the second one, Demo. I started the service to monitor port ...
2
votes
3answers
158 views

How to download files without full URL?

I was always wondering how to download the files through the Linux shell (I have wget, curl) that do not have a full URL of the file to be downloaded, but the full URL is passed e.g. to the browser ...
2
votes
3answers
199 views

curl page source from text file containing URLs

I have a text file containing up to 100 URLs. I am able to curl the page source from them using: cat /path/to/url.txt|xargs curl -o /path/to/output.txt This will download the page source for all of ...