I would like to check where a single URL redirects. An example of that could be a link from Google's search result page (where a click always goes through Google server).

Can I do that with curl?

up vote 16 down vote accepted

Try this:

$ LOCATION=`curl -I http://raspberrypi.stackexchange.com/a/1521/86 | perl -n -e '/^Location: (.*)$/ && print "$1\n"'`
$ echo "$LOCATION"
/questions/1508/how-do-i-access-the-distributions-name-on-the-command-line/1521#1521

Google Redirects

Google redirect URLs are slightly different. They return a Javascript redirect, which could easily be processed, but why not process the original URL and for go curl all together?

$ URL="http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CFAQFjAA&url=http%3A%2F%2Fwww.raspberrypi.org%2F&ei=rv8oUODIIMvKswa4xoHQAg&usg=AFQjCNEBMoebclm0Gk0LCZIStJbF04U1cQ"
$ LOCATION=`echo "$URL" | perl -n -e '/url=([a-zA-Z0-9%\.]*)/ && print "$1\n"'`
$ echo "$LOCATION"
http%3A%2F%2Fwww.raspberrypi.org%2F
$ echo "$LOCATION" | perl -pe 's/%([0-9a-f]{2})/sprintf("%s", pack("H2",$1))/eig'
http://www.raspberrypi.org/

Reference

  1. For url decode...
  • How about special URLs with special characters (like Google's redirects), e.g.: google.com/… – syntagma Aug 13 '12 at 13:24
  • @REACHUS The redirect is encoded into the query string of the URL given. – Alex Chamberlain Aug 13 '12 at 13:28
  • @REACHUS No worries - you can probably combine the 2 perl statements. – Alex Chamberlain Aug 13 '12 at 14:12

There is an even easier way

curl -w "%{url_effective}\n" -I -L -s -S $URL -o /dev/null

it would print

http://raspberrypi.stackexchange.com/questions/1508/how-do-i-access-the-distributions-name-on-the-command-line/1521

for URL

http://raspberrypi.stackexchange.com/a/1521/86
  • 2
    That uses more time and bandwidth though, since you're downloading the second page as well. – unhammer May 6 '15 at 12:30
  • @unhammer You are right, updated my answer to do head requests only. – ismail Aug 7 '15 at 8:11

or try this

curl -s -o /dev/null -I -w "HTTP_CODE: %{http_code}\nREDIRECT_URL: %{redirect_url}\n" http://raspberrypi.stackexchange.com/a/1521/86
  • How about special URLs with special characters (like Google's redirects), e.g.: google.com/… – syntagma Aug 13 '12 at 13:25
  • just put the url in single quotes, so that your shell ignores the special characters in the link. But the link you have stated does not redirect to another uri, the status code of the response is 200 and not 3xx. The uri you look for is hidden in the uri itself respectively in the content of the response. For further examination you can study the header of the response with curl -s -I 'http://yoururl' and the content of the response with curl -s 'http://yoururl' (you will see that google use a simple javascript for the redirection). – user1146332 Aug 13 '12 at 14:30

curl can be configured to follow redirects and to print variables after completion. So what you ask can be achieved with the following command:

curl -Ls -w %{url_effective} -o /dev/null https://google.com

The man page explains the necessary parameters like that:

-L, --location          Follow redirects (H)
-s, --silent            Silent mode (don't output anything)
-w, --write-out FORMAT  Use output FORMAT after completion
-o, --output FILE       Write to FILE instead of stdout

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.