All about programs and services that use the Hypertext Transfer Protocol.

learn more… | top users | synonyms

1
vote
1answer
522 views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
3
votes
3answers
133 views

How can I list every port serving a web page

I have a number of servers, all with various HTTP(S) services accessible on a variety of ports. It's incredibly difficult to keep track of which service is available under which host and what port. ...
0
votes
1answer
72 views

Apache ReverseProxy ssl

I have the following ReverseProxy set up which works for http requests: NameVirtualHost *:80 <VirtualHost *:80> ServerName sub.domain.com ProxyRequests Off ProxyVia Off <Proxy *> Order ...
0
votes
0answers
61 views

Aria2 download html page

I'm trying to download a video using aria2, but it download the html page of the link instead the video. I've also tried the link from browser and I can download it normally. Why?
0
votes
2answers
587 views

How to simulate periodically clicking a button on a webpage?

I need to go to a webpage, and click a button (called "Generate Daily Trends", as shown in the picture below), and click it again every 1 minute. Is there any way (e.g., script or code) that I can ...
1
vote
1answer
276 views

How to get the http dump of a website and the header both from a single curl command?

I have to fetch a website (multiple redirections possible using -L) and save the html content in a file named as [HTTP_Status_code]_[Website_name].html Currently I am using two curl calls one for the ...
1
vote
0answers
154 views

why do I have so many open socket handlers and netstat DGRAM entries?

I run on a RPi (Raspbian 3.12.35+ #730 PREEMPT Fri Dec 19 18:31:24 GMT 2014 armv6l GNU/Linux) a daemon in Python 2.7.8 which queries various APIs via requests and provides itself an API for another ...
0
votes
2answers
654 views

linux curl POST request not working

I am trying to make a POST request using curl to retrieve exam results from the page : result odd .... I am using the following syntax but various errors are showing up (like content has moved ...
2
votes
1answer
434 views

Problem with pkg behind a chunking proxy

I have a freshly installed FreeBSD 10.1 at work in a VM. As it is behind a corporate proxy, I had to set HTTP_PROXY in environment and it began to run fine. But no way to get pkg to work correctly. I ...
0
votes
2answers
155 views

Simple http server from the command line that will always cause a timeout

Regarding the question Simple command line http server I would like to know, what is the simplest method for creating a http server listening on a specified port that will always cause timeout (it ...
2
votes
0answers
123 views

TCP, UDP, etc. works, HTTP(S) does not

I have been trying to set up Debian Jessie on an old Dell Inspiron 300m. Right now the problem I have is, the ethernet connection only works partially. ICMP works. I can ping IPs and FQDNs. UDP ...
1
vote
1answer
297 views

Grab http requests by lynx

I need to grab and debug all HTTP-requests and responds which i make from lynx or another text-based browser. How can i save all request url's, redirects, headers and page sources for analyze and ...
2
votes
1answer
58 views

How to create a http mirror?

I need to create a mirror of a directory shared over HTTP. Source server uses apache index module. Here is an example of a similar directory: http://apache.mirrors.pair.com/httpd/ The content is not ...
1
vote
1answer
331 views

Resolving DNS through HTTP/HTTPS

Is there a way to resolve DNS through HTTP/HTTPS, the case was: my ISP redirecting every DNS request to their own DNS and poisoning the DNS records. all I need is a software that could resolve ...
2
votes
0answers
453 views

File uploads and max_execution_time and request_terminate_timeout

In case of HTTP file uploads (nginx+php5-fpm) does max_execution_time (in /etc/php5/fpm/php.ini) or request_terminate_timeout (in /etc/php5/fpm/pool.d/www.conf) also include the time the file took to ...
2
votes
1answer
878 views

OpenWRT redirect traffic based on requested domain/port pair

If we would have an OpenWRT router, would we have a solution for redirecting the users traffit to HTTPS if they would request a plain HTTP website based on domain name? Example: If the traffic wants ...
2
votes
2answers
516 views

Run grep or other commands on files on a web server

I have files on another domain. What's the best way to use commands on them like grep? wget http://path/to/file.txt | grep search However this doesn't work. I guess I can use curl but is there a ...
1
vote
0answers
108 views

Forcing broswers to use a different host and port when viewing websites over ssh-tunnels

I've setup an ssh tunnel to a network that has a website I need to view. However, when requesting the page my browsers sends the host localhost and url http://localhost:1234 in the HTTP headers. Is ...
3
votes
0answers
132 views

How to stream audio from /dev/dsp?

What is the best way to stream audio from /dev/dsp (I'm using OSS on Debian). I would prefer HTTP streaming, but if there is a way on another protocol, I can deal with that.
1
vote
1answer
944 views

curl timeout troubleshooting

I tried to curl popular websites e.g. curl google.com or curl google.com:80 and there is always a timeout error. Some troubleshooting steps performed: Able to curl localhost with response Able to ...
3
votes
1answer
510 views

Allow non-root unmodifiable sofware to bind to ports 80 & 443

The company I'm in uses the Java Secure Application Manager to "secure" non-internal connections their webmail and electronic collaboration software. Aside from using expired certificates, and ...
1
vote
2answers
1k views

How to get wget to use the direct URL file name as output file name for a shortened URL

I'm trying to download all the books from a URL list in bulk. The list is in a text file in http://ligman.me/W3TuLr. I'm trying to use wget on linux for this. All these URLs seem to be created using a ...
3
votes
1answer
1k views

Monitor outgoing web requests as they’re happening

I want to see a list of all outgoing HTTP requests from my desktop. I think it should be possible to monitor HTTPS hostnames as well for local clients using Server Name Indication (SNI). OS X has a ...
1
vote
1answer
340 views

How to monitor outgoing http requests per user?

I'd like to know how to monitor users' outgoing http requests. I've got a FreeBSD 8.1 server, and I would like to get an output like this for http requests: source MAC address or IP address → ...
4
votes
2answers
192 views

Port Routing/DNS for individual program

Background Flickr has closed its http api leaving an https only api. My favourite uploader (the official Flickr Uploadr version 2.5 running under wine) is no longer maintained, so this change broke ...
2
votes
1answer
1k views

Capture web traffic grouped by individual TCP streams

As far as I know a HTTP request and response constructs one TCP connection. To debug a web application on a GUI-less server, I'd like to be able to capture these TCP streams in a single ...
1
vote
2answers
1k views

Simple server that triggers script and responds

I need to have a very simple server running that can: Take rest call. It triggers a script when a call is made The script checks if database is running or not. If running then reply back to client ...
1
vote
1answer
126 views

Random lag on connection

when i try to connect to my friend's server, the connection seems randomly laggy, sometimes it's 50ms, 40ms, 60ms, but sometimes it tooks 1, 3 or 7 seconds time curl -vv 'http://ipaddress/foo.json' * ...
1
vote
1answer
80 views

Visualization tools for REST-based services

Let's say there is a cluster/set of processes that communicate via REST/HTTP (that could describe a whole lot of products these days). What's a good and simple way to view the communication among them ...
0
votes
1answer
5k views

Nagios misinterpreting Http response!

I've installed Nagios 4.0.1 on my CentOS 6.5 server. Since I'd set up Node.js to use port 80, I configured the Apache (httpd) service to listen to port 3000 instead. I can open Nagios console and ...
2
votes
1answer
885 views

mplayer not sending the correct user-agent

I am trying to play a stream through mplayer. Here is the command I execute: mplayer -user-agent "PS4 libhttp/1.60" -cache 8192 -v ffmpeg://http://the_stream_url.m3u8 The stream does not play due ...
0
votes
0answers
358 views

Firefox 29 default Accept-Language bug

Since I upgraded Firefox to version 29 it is sending the wrong Accept-Language header en-US,en;q=0.5 which should be pt-BR,pt;q=0.8,en-US;q=0.5,en;q=0.3, it was right on previous version. I managed ...
2
votes
1answer
580 views

How to implement retry mechanism while executing the server url in the shell script?

I am working on a project in which I need to make a url call to one of my server from the bash shell script.. http://hostname.domain.com:8080/beat After hitting the above url, I will be getting the ...
7
votes
2answers
18k views

How to check whether a command such as curl completed without error?

I am using curl to upload a file to a server via an HTTP post. curl -X POST -d@myfile.txt server-URL When I manually execute this command on the command line, I get a response from the server like ...
2
votes
1answer
2k views

Telnet to port 80 is not showing results

I'm trying to a test request/response to www.google.com on port 80 as below : $ telnet www.google.com 80 After that I typed in : GET‌ / HTTP/1.1 Host: www.google.com But nothing happens! Any ...
18
votes
4answers
23k views

Change Apache httpd “Server:” HTTP header

One of the HTTP headers that the Apache httpd sends back with response data is "Server". For example, my web server machine is relatively up-to-date Arch Linux. It sends back headers closely ...
0
votes
2answers
2k views

Particular site is not working on Ubuntu 12.04

I surf net in Ubuntu 12.04. All the sites are working, except one site http://developer.android.com/. I don't know why. At the same time, the same url opens in Windows perfectly. So the site is up ...
2
votes
1answer
118 views

catch http requests from another process

Suppose a process, among other things, is posting https requests, for example with curl. Assuming I have root privileges, is there a way to intercept such requests and respond with an http error or,...
4
votes
2answers
3k views

How to make wget download recursive combining --accept with --exclude-directories?

I'm trying to download some directories from an Apache server, but I need to ignore some directories that have huge files I don't care about The dir structure in the server is somewhat like this (...
1
vote
1answer
4k views

How to redirect HTTP request to different local web servers

I have a Linux machine and some applications are running web interfaces. I'd like to create a web server, opened to the Internet, in order to access these local web interfaces (or web interface on ...
1
vote
2answers
9k views

Type URL and show HTTP status

I want to make a shell script where I type an url and it returns me the status code.So far I've tested wget is there any other cause it has the tendency to save whatever you run. Then I tried to some ...
1
vote
1answer
778 views

Download attachments in a URL redirect via Axel

Axel is not resolving URLs that redirect to another URL that has the file as an attachment. As you see, I'm getting 404 when I try to download this URL. (original site is replaced with example.com) ~...
3
votes
2answers
1k views

How to redirect http requests to local Apache server on internet connection lost?

I have a little Linux (Ubuntu based) server with 2 network cards, which acts as a router, dhcp, dns server, firewall, etc. One network card is connected to the LAN, while the other is connected to my ...
2
votes
1answer
1k views

Run my own HTTP fast-browsing proxy a la Opera Mini?

Opera Mini is a great browser that works well on feature phones and iPhones. Unlike most browsers, it uses Opera's servers to transcode every page you browse to into a small, easy-to-render chunk that'...
35
votes
7answers
10k views

How do I get a websites title using command line?

I want a command line program that prints the title of a website. For e.g.: Alan:~ titlefetcher http://www.youtube.com/watch?v=Dd7dQh8u4Hc should give: Why Are Bad Words Bad? You give it the ...
9
votes
2answers
5k views

What tool can I use to sniff HTTP/HTTPS traffic?

I'm looking for a command line tool that can intercept HTTP/HTTPS requests, extract information such as: (content, destination, etc.), perform various analysis tasks, and finally determine if the ...
27
votes
4answers
4k views

How do I play an HTTP music stream over SSH?

I know I can just do mplayer <stream> to open and play a stream on the local machine. However, I'm behind a firewall. Instead, I'd like to open the stream on a remote machine, but still play it ...
4
votes
1answer
238 views

Map file to URL

I'm looking for a way to do something like this: some_tool --go-to-background http://server.com/~me/uber_vimrc ~/.vimrc After which, reading ~/.vimrc would give the data downloaded from that URL. ...
3
votes
0answers
203 views

WGET - Authenticating root AND all children folders

Before I start the question off, I want to say that a similar question helped me get past the initial login. My issue is as stated below. There's a website that I'm trying to mirror. It is something ...
0
votes
0answers
73 views

Why Redhat is not installing using HTTP

Im trying to install Rehdat using HTTP and these are the steps I preformed to do it. I copied the iso image in /var/www/rhel/5.9/ Then i made a HTTP YUM repo under /yum-repo.d/rhel-5.9.repo/Server ...