188

I'm trying to use the curl command to access a http url with a exclamation mark (!) in its path. e.g:

curl -v "http://example.org/!287s87asdjh2/somepath/someresource"

the console replies with bash: ... event not found.

What is going on here? and what would be the proper syntax to escape the exclamation mark?

2
  • 5
    Bash 4.4 makes cases like "foo!" not invoke history expansion, but "foo!123" still does.
    – ilkkachu
    Commented Apr 7, 2021 at 13:32
  • 2
    The answers below all detail how to correctly use "!" in bash. But for this exact question, where the '!' is in a curl command in a URL, you could have simply URL encoded the problematic symbol instead where '!' is replaced with '%21' Commented Oct 15, 2022 at 0:39

7 Answers 7

198

The exclamation mark is part of history expansion in bash. To use it you need it enclosed in single quotes (eg: 'http://example.org/!132').

You might try to directly escape it with a backslash (\) before the character (eg: "http://example.org/\!132"). However, even though a backslash before the exclamation mark does prevent history expansion, the backslash is not removed on some shells in such a case. So it's better to use single quotes, so you're not passing a literal backslash to curl as part of the URL.

8
  • 13
    "http://example.org/\!132" actually expands without interpreting the backslash (POSIX compliance reasons, I believe).
    – Chris Down
    Commented Mar 3, 2012 at 19:14
  • 8
    For the record: It's not portable to try escaping "!". The best-practices recommendation is to always quote (singe-quotes) "!". Related: "^" (caret), is a non-metacharacter that needs quoting for portability. Finally, "!" should not be used in an if statement; use it as an argument to test instead if possible (again because of Solaris /bin/sh). Commented Oct 18, 2012 at 10:31
  • 9
    Only single quotes worked for me. zsh was still interpreting \! and double quotes.
    – orkoden
    Commented May 21, 2014 at 16:29
  • 2
    On Solaris (rubbish old pre-XPG4 shell), '^' is an alias for | and is used to create a pipe. If you're sending scripts to customers and can't be sure what shell they'll run it in, you have to test with them all! Commented Jan 16, 2018 at 9:47
  • 1
    @Wildcard, ^ is pipe in thompson/Bourne shells and also a glob operator in zsh -o extendedglob. It's also special in rc, es, akanga, fish and probably other less common shells. ksh/POSIX shells are the odd ones out. Commented Apr 25, 2023 at 7:14
108

As well as the answer given by Daniel, you can also simply turn off history expansion altogether if you don't use it with:

set +H

or

set +o histexpand

(the latter also working in zsh, where histexpand is an alternative name for the banghist option for bash compatibility).

In (t)csh where history expansion originates, you'd disable it by assigning the empty string to the $histchars variable with:

set histchars = ''

Or:

set histchars

(not via unset histchars)

That also works in bash and zsh, the two shells that copied that feature, though the syntax is:

histchars=

There.

Beware that bash (contrary to (t)csh or zsh) does not ignore a $histchars variable found in the environment, so beware of the possible consequences if you export that variable.

6
  • 23
    Turning off history expansion altogether is the best advice I've heard all day! History expansion is dangerous and byzantine when there are much better alternatives (incremental history search with Ctrl-R) that let you preview & edit your command so you don't blindly fire away with command !-14 that you though was at !-12 that, oops, happened to be rm -rf *. Be safe. Disable history expansion! Eschew the !!
    – aculich
    Commented Mar 6, 2012 at 1:09
  • 6
    Biggest answer: history expansion is a huge security risk! It can be used to attack your Unix through a crafted URL.
    – athena
    Commented Jun 15, 2015 at 7:30
  • @aculich, or just use the POSIX-specified command fc -14 instead. But it's true that you can do that without history expansion being enabled also. Personally, I use !$ and !vi and sudo !! and even git add !vi:$ often enough to warrant leaving history expansion enabled.
    – Wildcard
    Commented Jan 16, 2018 at 5:02
  • I think I'll add this to my shell RC files. I've only ever used this as a neat "trick"
    – TonyH
    Commented Aug 22, 2019 at 14:02
  • alternate, IMO more descriptive syntax to turn off bash history expansion: set +o histexpand; see also superuser.com/a/133782
    – ssc
    Commented Jun 28, 2020 at 10:15
26

I would personally do single quotes, but for completeness, I will also note since it is a URL, you can encode the ! as %21, e.g. curl -v http://example.org/%21132 .

21

This also can do

curl -v "http://example.org/"'!'"287s87asdjh2/somepath/someresource"
or
curl -v "http://example.org/"\!"287s87asdjh2/somepath/someresource"

Which works because bash concatenates adjacent strings. This approach is particularly useful when you have other things that need shell expansion, so you can't use single quotes for the entire string:

curl -v 'http://example.org/!'"287s87asdjh2/${basepath}/someresource"

! character is used for history expansions in command line prompt.
so this can be a problem in prompt but not in shell script files.
as you can see history expansions work even in double quotes.

10
  • There are lots of ways of making Unix commands and English sentences use more characters than they need to, and be more confusing than they need to be.  How is this superior to the first / accepted / highest-voted answer, namely, putting the entire URL into single quotes? Commented Jun 15, 2015 at 7:10
  • 3
    @G-Man : It tells another way to construct bash arguments. I wasn't aware of this method. Nothing wrong in learning new stuff. Commented Jul 6, 2016 at 12:30
  • @SahilSingh How is this new? It concatenates three strings, two enclosed in double quotes and one enclosed in single quotes. There is no nesting here.
    – Raphael
    Commented Mar 10, 2017 at 6:44
  • @G-Man It is not obvious that when you put 2 strings next to each other they get concatenated. printf("hello""world") would work in c as well, but printf("hello"'w') won't work, so you see knowing that bash accommodates such expressions was new to me, but I do agree from utility point of view, this is not superior. I liked the answer, so did Mark Shust. Commented Mar 10, 2017 at 7:06
  • 3
    @G-Man It's also useful when there are other string expansions one does want to happen in the same string. This is an easy way of separating two types of quoting behavior.
    – WAF
    Commented May 1, 2017 at 15:09
14

I have come across the same problem, and my simple solution was to use a variable:

E=!  
curl -v "http://example.org/${E}287s87asdjh2/somepath/someresource"

Here the simplicity is that (1) It is portable across shells and commands (2) Does not require knowing escape syntax and ASCII codes.

0
5

Ever since Bash 4.3, you can now use double quotes to quote the history expansion character (edit: as long as the the exclamation mark is at the end of the string or followed by a space)

$ $SHELL --version
GNU bash, version 4.3...
[...]
$ echo "Hello World!"
Hello World!
$ echo "Hello! World"
Hello! World
$ echo "Hello!World"
bash: !World: event not found
$ echo 'Hello!World'
Hello!World
4
  • this doesnt work outside of echo, echo seems to handle this differently on its own
    – phil294
    Commented Sep 30, 2017 at 12:04
  • @Blauhirn This has nothing to do with echo, and everything to do with quoting and the version of bash that you're running.
    – Flimm
    Commented Oct 1, 2017 at 13:38
  • @don_crissti: more precisely, it does not trigger history expansion if "end of line" or followed by whitespace : echo "Hi! Hello." also works as intended.
    – MestreLion
    Commented Nov 22, 2021 at 4:33
  • @don_crissti: also, these exceptions to histexpand were indeed introduced in bash 4.3, so Flimm is correct in saying it does have to do with bash version: mywiki.wooledge.org/BashPitfalls#echo_.22Hello_World.21.22
    – MestreLion
    Commented Nov 22, 2021 at 4:39
-1

To those who are using git bash in windows, the accepted answer from @DanielPittman works. However, you should replace the backslash (\) with a forward slash (/).

For example, in unix, it'd look something like this:

curl https://abc.com/services -H 'Authorization: Bearer 111A80BBZZCnS\!ZR412543s'

For windows, it'd be something like this (focus on the forward slash in the authorization header part)

curl https://abc.com/services -H 'Authorization: Bearer 111A80BBZZCnS/!ZR412543s'

2
  • This doesn't make much sense. You have the argument single quoted, so regardless of the slashes involved the exclam won't result in history expansion.
    – Wildcard
    Commented Jan 16, 2018 at 5:03
  • Ohh you're right. I only posted this answer because when I was using Daniel's answer (using backslash), an error pops up.
    – SamuelDev
    Commented Jan 16, 2018 at 5:12

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .