robots.txt file is there to stop you from performing bot operations on the site.
wget will, by default abide by the wishes of the
Web site owners use the
/robots.txt file to give instructions about their site to web robots; this is called The
Robots Exclusion Protocol.
It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html. Before it does so, it firsts checks for http://www.example.com/robots.txt, and finds:
User-agent: * means this section applies to all robots. The
Disallow: / tells the robot that it should not visit any pages on the site.
robots.txt file we can see the following:
So they don't want you mass downloading from that path, you could try
If you find a way to bypass the
robots.txt file and perform the operation you want, you will be acting maliciously and the site will likely ban your IP.
You likely aren't doing anything wrong (I'm not a wget expert by any means so there may be syntax errors as well), but the action is just not permitted.