All about programs and services that use the Hypertext Transfer Protocol.

learn more… | top users | synonyms

6
votes
1answer
1k views

IPtables - new vs new, established, related

I'm «pretty» new to IPtables, or I have used IPtables a few years, but never with advanced features. I understand the concept of stateful IPtables rules, but recently I discovered that some people ...
0
votes
1answer
61 views

Unwanted and or Abusive Web Requests

We have been contacted by our server host provider about Unwanted and or Abusive Web http Requests going out from our server. The information they gave us are. Block Type: New Ban Time: 2015-10-01 ...
1
vote
1answer
56 views

Iptables dropping HTTP 302 packages contain suspicious domain string

The HTTP 302 packages I want to block have: Header HTTP/1.1 302 Found Location: http://www.yxjiaodai.com/ad/?id=1023&url=http%3A//a1819.oadz.com/link/C/1819/3081547/dtMdon4l79FwsIo2JXEHqtdp5eQ_/...
0
votes
3answers
61 views

Call an URL on debian from command shell

I need a command which will just send http request to required web directory? Does something like this exist?
0
votes
1answer
81 views

Browser (HTTP client) with support of bzip2 or lzma2 compression?

What browsers (HTTP clients) support HTTP compression using bzip2 or lzma2? (HTTP compression for page requests) I have only heard of Firefox patch, but I am not sure if it actually supports ...
1
vote
0answers
42 views

How do I create a deflate file suitable for HTTP?

Say I have index.html. How do I obtain index.html.deflate appropriate for serving through HTTP with the "deflate" encoding? I am coding a simple web server and I don't want to implement streaming ...
2
votes
1answer
138 views

Large downloads interrupted on nginx reload

I'm running nginx 1.9.3. When downloading a large file (in this case, 1GiB), and reloading nginx via "nginx -s reload", the download gets interrupted in numerous browsers, including (but potentially ...
3
votes
0answers
121 views

Using socat to Tunnel/Proxy TCP want to split send/receive into separate files

I'm using socat to dump plain TCP (e.g. HTTP) traffic: socat -v tcp-listen:$PORT,reuseaddr,fork,keepalive tcp:$TARGET_HOST:$TARGET_PORT At the moment all send and receive traffic is dumped into ...
1
vote
1answer
737 views

logrotate every 2 hours

I'm trying to make httpry logs every 2 hours. I added this to my logrotate.conf file: /var/log/httpry/*.log { rotate 1 weekly create 640 root admin missingok notifempty } I ...
10
votes
2answers
3k views

Generic HTTP server that just dumps POST requests?

I am looking for a command line tool that listens on a given part, happily excepts every HTTP POST request and dumps it. I want to use it for testing purposes, i.e. for testing clients that issue ...
1
vote
3answers
851 views

echo text after curl command on same line

#!/bin/bash echo "$(curl -s -I https://google.com|grep Server)" abc returns: abcer: gws and bash -x shows: ++ grep Server ++ curl -s -I https://google.com ' abco 'Server: gws abcer: gws but ...
1
vote
1answer
185 views

Redirect outbound traffic on LAN going to port 443 to port 80 or 8080 instead

How would I achieve this, I've tried using iptables a bit but have had no success at all. Any help at all would be appreciated. I basically just want it so that whenever a user on my LAN attempts to ...
0
votes
1answer
291 views

Using curl with xargs connection hanging sometimes - any way to retry?

echo $LIST | xargs -I{} -n 1 -P 8 sh -c 'curl -o backup.dump http://url.com' I am running this for a large amount of files (around 300). After a while, sometimes curl hangs and won't progress for a ...
1
vote
1answer
221 views

Upload from shell to HTTP Server

I use scp command to upload file from my local computer to my ftp server is there any tools to do the same thing with http server (like Apache server ) like scp do ?
1
vote
1answer
517 views

get original creation date of html file

Can I find the creation/last modified date of an html file? For example, I would like to know when some index.html file from some website was created, not when I downloaded it.
1
vote
2answers
9k views

Type URL and show HTTP status

I want to make a shell script where I type an url and it returns me the status code.So far I've tested wget is there any other cause it has the tendency to save whatever you run. Then I tried to some ...
2
votes
1answer
578 views

How to implement retry mechanism while executing the server url in the shell script?

I am working on a project in which I need to make a url call to one of my server from the bash shell script.. http://hostname.domain.com:8080/beat After hitting the above url, I will be getting the ...
3
votes
3answers
132 views

How can I list every port serving a web page

I have a number of servers, all with various HTTP(S) services accessible on a variety of ports. It's incredibly difficult to keep track of which service is available under which host and what port. ...
2
votes
1answer
434 views

Problem with pkg behind a chunking proxy

I have a freshly installed FreeBSD 10.1 at work in a VM. As it is behind a corporate proxy, I had to set HTTP_PROXY in environment and it began to run fine. But no way to get pkg to work correctly. I ...
10
votes
3answers
6k views

Can't access select https sites on Linux over PPPoE

My internet connection used to be a direct LAN connection to my provider. Back then, everything would load fine on both Windows and Ubuntu (dual boot). However, a while ago they started needing me to ...
0
votes
1answer
71 views

Apache ReverseProxy ssl

I have the following ReverseProxy set up which works for http requests: NameVirtualHost *:80 <VirtualHost *:80> ServerName sub.domain.com ProxyRequests Off ProxyVia Off <Proxy *> Order ...
0
votes
0answers
60 views

Aria2 download html page

I'm trying to download a video using aria2, but it download the html page of the link instead the video. I've also tried the link from browser and I can download it normally. Why?
0
votes
2answers
576 views

How to simulate periodically clicking a button on a webpage?

I need to go to a webpage, and click a button (called "Generate Daily Trends", as shown in the picture below), and click it again every 1 minute. Is there any way (e.g., script or code) that I can ...
1
vote
1answer
276 views

How to get the http dump of a website and the header both from a single curl command?

I have to fetch a website (multiple redirections possible using -L) and save the html content in a file named as [HTTP_Status_code]_[Website_name].html Currently I am using two curl calls one for the ...
1
vote
0answers
150 views

why do I have so many open socket handlers and netstat DGRAM entries?

I run on a RPi (Raspbian 3.12.35+ #730 PREEMPT Fri Dec 19 18:31:24 GMT 2014 armv6l GNU/Linux) a daemon in Python 2.7.8 which queries various APIs via requests and provides itself an API for another ...
0
votes
2answers
651 views

linux curl POST request not working

I am trying to make a POST request using curl to retrieve exam results from the page : result odd .... I am using the following syntax but various errors are showing up (like content has moved ...
0
votes
2answers
151 views

Simple http server from the command line that will always cause a timeout

Regarding the question Simple command line http server I would like to know, what is the simplest method for creating a http server listening on a specified port that will always cause timeout (it ...
2
votes
2answers
201 views

Using Wireshark on Linux to observe coupled HTTP-request and HTTP-respond

I use Wireshark on Linux to observe my HTTP traffic. Other programms like Firefox Live Http Headers show coupled http-request from my browser and http-respond from any server. How using programs like ...
2
votes
0answers
123 views

TCP, UDP, etc. works, HTTP(S) does not

I have been trying to set up Debian Jessie on an old Dell Inspiron 300m. Right now the problem I have is, the ethernet connection only works partially. ICMP works. I can ping IPs and FQDNs. UDP ...
2
votes
1answer
58 views

How to create a http mirror?

I need to create a mirror of a directory shared over HTTP. Source server uses apache index module. Here is an example of a similar directory: http://apache.mirrors.pair.com/httpd/ The content is not ...
1
vote
1answer
330 views

Resolving DNS through HTTP/HTTPS

Is there a way to resolve DNS through HTTP/HTTPS, the case was: my ISP redirecting every DNS request to their own DNS and poisoning the DNS records. all I need is a software that could resolve ...
7
votes
2answers
17k views

How to check whether a command such as curl completed without error?

I am using curl to upload a file to a server via an HTTP post. curl -X POST -d@myfile.txt server-URL When I manually execute this command on the command line, I get a response from the server like ...
2
votes
0answers
449 views

File uploads and max_execution_time and request_terminate_timeout

In case of HTTP file uploads (nginx+php5-fpm) does max_execution_time (in /etc/php5/fpm/php.ini) or request_terminate_timeout (in /etc/php5/fpm/pool.d/www.conf) also include the time the file took to ...
1
vote
2answers
10k views

How can I set up Virtual Hosts in Centos7?

I am trying to set up virtual hosts in Centos7. I followed this guide: http://twohlix.com/2011/05/setting-up-apache-virtual-hosts-on-centos/ however I keep getting the following error: Job for ...
2
votes
2answers
511 views

Run grep or other commands on files on a web server

I have files on another domain. What's the best way to use commands on them like grep? wget http://path/to/file.txt | grep search However this doesn't work. I guess I can use curl but is there a ...
1
vote
0answers
108 views

Forcing broswers to use a different host and port when viewing websites over ssh-tunnels

I've setup an ssh tunnel to a network that has a website I need to view. However, when requesting the page my browsers sends the host localhost and url http://localhost:1234 in the HTTP headers. Is ...
3
votes
0answers
130 views

How to stream audio from /dev/dsp?

What is the best way to stream audio from /dev/dsp (I'm using OSS on Debian). I would prefer HTTP streaming, but if there is a way on another protocol, I can deal with that.
1
vote
1answer
940 views

curl timeout troubleshooting

I tried to curl popular websites e.g. curl google.com or curl google.com:80 and there is always a timeout error. Some troubleshooting steps performed: Able to curl localhost with response Able to ...
4
votes
2answers
192 views

Port Routing/DNS for individual program

Background Flickr has closed its http api leaving an https only api. My favourite uploader (the official Flickr Uploadr version 2.5 running under wine) is no longer maintained, so this change broke ...
3
votes
1answer
507 views

Allow non-root unmodifiable sofware to bind to ports 80 & 443

The company I'm in uses the Java Secure Application Manager to "secure" non-internal connections their webmail and electronic collaboration software. Aside from using expired certificates, and ...
1
vote
1answer
336 views

How to monitor outgoing http requests per user?

I'd like to know how to monitor users' outgoing http requests. I've got a FreeBSD 8.1 server, and I would like to get an output like this for http requests: source MAC address or IP address → ...
1
vote
2answers
1k views

How to get wget to use the direct URL file name as output file name for a shortened URL

I'm trying to download all the books from a URL list in bulk. The list is in a text file in http://ligman.me/W3TuLr. I'm trying to use wget on linux for this. All these URLs seem to be created using a ...
3
votes
1answer
1k views

Monitor outgoing web requests as they’re happening

I want to see a list of all outgoing HTTP requests from my desktop. I think it should be possible to monitor HTTPS hostnames as well for local clients using Server Name Indication (SNI). OS X has a ...
0
votes
3answers
1k views

How to get info about given webserver FAST?

$ time nmap -q -sV -P0 -p80 google.com | fgrep '80/tcp open' 80/tcp open http Google httpd 2.0 (GFE) real 0m6.563s user 0m0.280s sys 0m0.016s $ Are there any faster methods to get info ...
2
votes
1answer
1k views

Capture web traffic grouped by individual TCP streams

As far as I know a HTTP request and response constructs one TCP connection. To debug a web application on a GUI-less server, I'd like to be able to capture these TCP streams in a single ...
1
vote
2answers
1k views

Simple server that triggers script and responds

I need to have a very simple server running that can: Take rest call. It triggers a script when a call is made The script checks if database is running or not. If running then reply back to client ...
1
vote
1answer
126 views

Random lag on connection

when i try to connect to my friend's server, the connection seems randomly laggy, sometimes it's 50ms, 40ms, 60ms, but sometimes it tooks 1, 3 or 7 seconds time curl -vv 'http://ipaddress/foo.json' * ...
1
vote
1answer
80 views

Visualization tools for REST-based services

Let's say there is a cluster/set of processes that communicate via REST/HTTP (that could describe a whole lot of products these days). What's a good and simple way to view the communication among them ...
1
vote
1answer
977 views

Port 80 refused by Linux (Ubunt 12.04)

I am having an issue I cannot seem to resolve. I am being refused only on port 80. However port 8080, and 22 (Tomcat and ssh) are available. I am pretty sure this is not an Apache thing, however I ...
0
votes
1answer
5k views

Nagios misinterpreting Http response!

I've installed Nagios 4.0.1 on my CentOS 6.5 server. Since I'd set up Node.js to use port 80, I configured the Apache (httpd) service to listen to port 3000 instead. I can open Nagios console and ...