All about programs and services that use the Hypertext Transfer Protocol.

learn more… | top users | synonyms

0
votes
1answer
27 views

Using curl with xargs connection hanging sometimes - any way to retry?

echo $LIST | xargs -I{} -n 1 -P 8 sh -c 'curl -o backup.dump http://url.com' I am running this for a large amount of files (around 300). After a while, sometimes curl hangs and won't progress for a ...
1
vote
0answers
40 views

Bash CGI script won't run [closed]

I have made a webpage to control the GPIO pins of my raspberry pi to control a rc car. I use cgi scripts written in bash. I can let the car drive forwards with this script: #!/bin/bash gpio -g write ...
1
vote
1answer
26 views

Upload from shell to HTTP Server

I use scp command to upload file from my local computer to my ftp server is there any tools to do the same thing with http server (like Apache server ) like scp do ?
1
vote
1answer
50 views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
6
votes
1answer
2k views

Generic HTTP server that just dumps POST requests?

I am looking for a command line tool that listens on a given part, happily excepts every HTTP POST request and dumps it. I want to use it for testing purposes, i.e. for testing clients that issue ...
1
vote
2answers
4k views

Type URL and show HTTP status

I want to make a shell script where I type an url and it returns me the status code.So far I've tested wget is there any other cause it has the tendency to save whatever you run. Then I tried to some ...
2
votes
1answer
380 views

How to implement retry mechanism while executing the server url in the shell script?

I am working on a project in which I need to make a url call to one of my server from the bash shell script.. http://hostname.domain.com:8080/beat After hitting the above url, I will be getting the ...
3
votes
3answers
50 views

How can I list every port serving a web page

I have a number of servers, all with various HTTP(S) services accessible on a variety of ports. It's incredibly difficult to keep track of which service is available under which host and what port. ...
29
votes
6answers
5k views

How do I get a websites title using command line?

I want a command line program that prints the title of a website. For e.g.: Alan:~ titlefetcher http://www.youtube.com/watch?v=Dd7dQh8u4Hc should give: Why Are Bad Words Bad? You give it the ...
2
votes
1answer
134 views

Problem with pkg behind a chunking proxy

I have a freshly installed FreeBSD 10.1 at work in a VM. As it is behind a corporate proxy, I had to set HTTP_PROXY in environment and it began to run fine. But no way to get pkg to work correctly. I ...
2
votes
3answers
4k views

How to change user agent on all http requests made from my machine with Squid intercepting proxy?

I'd like to change the user agent on all HTTP requests made from this machine. It's easy enough to change the user agent in each browser, but other apps also make http requests. It's vital I catch ...
9
votes
3answers
4k views

Can't access select https sites on Linux over PPPoE

My internet connection used to be a direct LAN connection to my provider. Back then, everything would load fine on both Windows and Ubuntu (dual boot). However, a while ago they started needing me to ...
0
votes
1answer
18 views

Apache ReverseProxy ssl

I have the following ReverseProxy set up which works for http requests: NameVirtualHost *:80 <VirtualHost *:80> ServerName sub.domain.com ProxyRequests Off ProxyVia Off <Proxy *> Order ...
0
votes
0answers
19 views

Aria2 download html page

I'm trying to download a video using aria2, but it download the html page of the link instead the video. I've also tried the link from browser and I can download it normally. Why?
11
votes
2answers
7k views

Change Apache httpd “Server:” HTTP header

One of the HTTP headers that the Apache httpd sends back with response data is "Server". For example, my web server machine is relatively up-to-date Arch Linux. It sends back headers closely ...
-1
votes
2answers
98 views

How to simulate periodically clicking a button on a webpage?

I need to go to a webpage, and click a button (called "Generate Daily Trends", as shown in the picture below), and click it again every 1 minute. Is there any way (e.g., script or code) that I can ...
1
vote
1answer
84 views

How to get the http dump of a website and the header both from a single curl command?

I have to fetch a website (multiple redirections possible using -L) and save the html content in a file named as [HTTP_Status_code]_[Website_name].html Currently I am using two curl calls one for the ...
0
votes
0answers
36 views

why do I have so many open socket handlers and netstat DGRAM entries?

I run on a RPi (Raspbian 3.12.35+ #730 PREEMPT Fri Dec 19 18:31:24 GMT 2014 armv6l GNU/Linux) a daemon in Python 2.7.8 which queries various APIs via requests and provides itself an API for another ...
0
votes
0answers
116 views

Best way to transparently redirect traffic to proxy

I've implemented a wireless router using hostapd on Debian Wheezy running on a Banana-PI. To access the internet, this router is attached to another network that I haven't any control of via ethernet. ...
0
votes
2answers
229 views

linux curl POST request not working

I am trying to make a POST request using curl to retrieve exam results from the page : result odd .... I am using the following syntax but various errors are showing up (like content has moved ...
0
votes
2answers
56 views

Simple http server from the command line that will always cause a timeout

Regarding the question Simple command line http server I would like to know, what is the simplest method for creating a http server listening on a specified port that will always cause timeout (it ...
0
votes
0answers
21 views

Tinymce with SSL: blank pop-ups

I am running Mezzanine with the main site on http and the admin site on https powered by Nginx. I have set up these in the local_settings.py file: SSL_ENABLED = True SSL_FORCE_URL_PREFIXES = ...
2
votes
2answers
159 views

Using Wireshark on Linux to observe coupled HTTP-request and HTTP-respond

I use Wireshark on Linux to observe my HTTP traffic. Other programms like Firefox Live Http Headers show coupled http-request from my browser and http-respond from any server. How using programs like ...
2
votes
0answers
86 views

TCP, UDP, etc. works, HTTP(S) does not

I have been trying to set up Debian Jessie on an old Dell Inspiron 300m. Right now the problem I have is, the ethernet connection only works partially. ICMP works. I can ping IPs and FQDNs. UDP ...
0
votes
0answers
114 views

web container options for war file in CentOS 7

I know that Tomcat and NginX are both able to host web applications that are defined by war files. But can httpd also host a war-file-based web application on a CentOS 7 server? If so, how would you ...
1
vote
0answers
98 views

Grab http requests by lynx

I need to grab and debug all HTTP-requests and responds which i make from lynx or another text-based browser. How can i save all request url's, redirects, headers and page sources for analyze and ...
2
votes
1answer
44 views

How to create a http mirror?

I need to create a mirror of a directory shared over HTTP. Source server uses apache index module. Here is an example of a similar directory: http://apache.mirrors.pair.com/httpd/ The content is not ...
1
vote
1answer
65 views

Resolving DNS through HTTP/HTTPS

Is there a way to resolve DNS through HTTP/HTTPS, the case was: my ISP redirecting every DNS request to their own DNS and poisoning the DNS records. all I need is a software that could resolve ...
4
votes
2answers
5k views

How to check whether a command such as curl completed without error?

I am using curl to upload a file to a server via an HTTP post. curl -X POST -d@myfile.txt server-URL When I manually execute this command on the command line, I get a response from the server like ...
2
votes
0answers
196 views

File uploads and max_execution_time and request_terminate_timeout

In case of HTTP file uploads (nginx+php5-fpm) does max_execution_time (in /etc/php5/fpm/php.ini) or request_terminate_timeout (in /etc/php5/fpm/pool.d/www.conf) also include the time the file took to ...
4
votes
2answers
2k views

How to make wget download recursive combining --accept with --exclude-directories?

I'm trying to download some directories from an Apache server, but I need to ignore some directories that have huge files I don't care about The dir structure in the server is somewhat like this ...
0
votes
2answers
5k views

How can I set up Virtual Hosts in Centos7?

I am trying to set up virtual hosts in Centos7. I followed this guide: http://twohlix.com/2011/05/setting-up-apache-virtual-hosts-on-centos/ however I keep getting the following error: Job for ...
16
votes
8answers
18k views

Simple command line http server

I have a script which generates a daily report which I want to serve to the so called general public. The problem is I don't want to add to my headaches maintance of a http server (e.x. apache) with ...
4
votes
1answer
3k views

What tool can I use to sniff HTTP/HTTPS traffic?

I'm looking for a command line tool that can intercept HTTP/HTTPS requests, extract information such as: (content, destination, etc.), perform various analysis tasks, and finally determine if the ...
2
votes
1answer
363 views

OpenWRT redirect traffic based on requested domain/port pair

If we would have an OpenWRT router, would we have a solution for redirecting the users traffit to HTTPS if they would request a plain HTTP website based on domain name? Example: If the traffic wants ...
2
votes
2answers
195 views

Run grep or other commands on files on a web server

I have files on another domain. What's the best way to use commands on them like grep? wget http://path/to/file.txt | grep search However this doesn't work. I guess I can use curl but is there a ...
1
vote
0answers
56 views

Forcing broswers to use a different host and port when viewing websites over ssh-tunnels

I've setup an ssh tunnel to a network that has a website I need to view. However, when requesting the page my browsers sends the host localhost and url http://localhost:1234 in the HTTP headers. Is ...
2
votes
0answers
91 views

How to stream audio from /dev/dsp?

What is the best way to stream audio from /dev/dsp (I'm using OSS on Debian). I would prefer HTTP streaming, but if there is a way on another protocol, I can deal with that.
1
vote
1answer
430 views

curl timeout troubleshooting

I tried to curl popular websites e.g. curl google.com or curl google.com:80 and there is always a timeout error. Some troubleshooting steps performed: Able to curl localhost with response Able to ...
0
votes
0answers
90 views

authenticate url with asked credentials

there is a URL http://server, when I open this url it ask for username and password (.htaccess authentication), this URL works fine in browser. This is the webpage not the browser which ask ...
4
votes
2answers
151 views

Port Routing/DNS for individual program

Background Flickr has closed its http api leaving an https only api. My favourite uploader (the official Flickr Uploadr version 2.5 running under wine) is no longer maintained, so this change broke ...
3
votes
1answer
259 views

Allow non-root unmodifiable sofware to bind to ports 80 & 443

The company I'm in uses the Java Secure Application Manager to "secure" non-internal connections their webmail and electronic collaboration software. Aside from using expired certificates, and ...
1
vote
1answer
233 views

How to monitor outgoing http requests per user?

I'd like to know how to monitor users' outgoing http requests. I've got a FreeBSD 8.1 server, and I would like to get an output like this for http requests: source MAC address or IP address → ...
2
votes
0answers
165 views

HTTP request failed after listening on multiple ports or after enabling SSL Module on my Linux Board

I have one custom Linux board on which I want to run apache web server to test HTML and other web based services. I have configured, cross compiled and installed default httpd (2.2.24, 2.4.1, 2.4.4 ...
1
vote
2answers
929 views

How to get wget to use the direct URL file name as output file name for a shortened URL

I'm trying to download all the books from a URL list in bulk. The list is in a text file in http://ligman.me/W3TuLr. I'm trying to use wget on linux for this. All these URLs seem to be created using a ...
3
votes
1answer
309 views

Monitor outgoing web requests as they’re happening

I want to see a list of all outgoing HTTP requests from my desktop. I think it should be possible to monitor HTTPS hostnames as well for local clients using Server Name Indication (SNI). OS X has a ...
0
votes
3answers
1k views

How to get info about given webserver FAST?

$ time nmap -q -sV -P0 -p80 google.com | fgrep '80/tcp open' 80/tcp open http Google httpd 2.0 (GFE) real 0m6.563s user 0m0.280s sys 0m0.016s $ Are there any faster methods to get info ...
1
vote
1answer
549 views

Capture web traffic grouped by individual TCP streams

As far as I know a HTTP request and response constructs one TCP connection. To debug a web application on a GUI-less server, I'd like to be able to capture these TCP streams in a single ...
0
votes
2answers
532 views

Simple server that triggers script and responds

I need to have a very simple server running that can: Take rest call. It triggers a script when a call is made The script checks if database is running or not. If running then reply back to client ...
1
vote
1answer
94 views

Random lag on connection

when i try to connect to my friend's server, the connection seems randomly laggy, sometimes it's 50ms, 40ms, 60ms, but sometimes it tooks 1, 3 or 7 seconds time curl -vv 'http://ipaddress/foo.json' * ...