I am running scrapy on ubuntu server 13. And while it is crawling the network becomes very slow and it becomes difficult to even ssh into the system.
I think I can solve the problem by having one more network interface card connected to a different router that scrapy doesn't use. Is it possible? How?