Unix & Linux Stack Exchange is a question and answer site for users of Linux, FreeBSD and other Un*x-like operating systems. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

Is there any to get or find the referrers of a link that were crawled by wget?

Suppose that some link returns a 400 error. wget only shows the url on which the 400 error occurrs, not the referrer of error url. If possible please provide any utility similar to wget in linux or wget option for doing this.

share|improve this question

The referrer is passed as part of the request header. Wget prints it if you turn on debug with -d. Then use grep to find the "referer" (note that debug output is probably written to stderr).

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.