The robots.txt
file is there to stop you from performing bot operations on the site. wget
will, by default abide by the wishes of the robots.txt
file.
Web site owners use the /robots.txt
file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol
.
It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html. Before it does so, it firsts checks for http://www.example.com/robots.txt, and finds:
User-agent: *
Disallow: /
The User-agent: *
means this section applies to all robots. The Disallow: /
tells the robot that it should not visit any pages on the site.
In bing's robots.txt
file we can see the following:
User-agent: *
Disallow: /account/
Disallow: /bfp/search
Disallow: /bing-site-safety
Disallow: /blogs/search/
Disallow: /entities/search
...
Allow: /shopping/$
Allow: /shopping$
...
Disallow: /th?
Disallow: /th$
...
So they don't want you mass downloading from that path, you could try /shopping
though.
If you find a way to bypass the robots.txt
file and perform the operation you want, you will be acting maliciously and the site will likely ban your IP.
robotstxt.org
Conclusion
You likely aren't doing anything wrong (I'm not a wget expert by any means so there may be syntax errors as well), but the action is just not permitted.