I created a couple of web spiders that I intend to run simultaneously with scrapyd. First, I successfully installed scrapyd on Ubuntu 14.04 using the command: pip install scrapyd, and when I run the command: scrapyd, I get the following output in the terminal:
2015-07-14 01:22:02-0400 [-] Log opened. 2015-07-14 01:22:02-0400 [-] twistd 13.2.0 (/usr/bin/python 2.7.6) starting up. 2015-07-14 01:22:02-0400 [-] reactor class: twisted.internet.epollreactor.EPollReactor. 2015-07-14 01:22:02-0400 [-] Site starting on 6800 2015-07-14 01:22:02-0400 [-] Starting factory <twisted.web.server.Site instance at 0x7f762f4391b8> 2015-07-14 01:22:02-0400 [Launcher] Scrapyd 1.1.0 started: max_proc=8, runner='scrapyd.runner'
I believe that the fact that I got this result suggests that violin works; however, when I run the command: scrapyd-deploy, as in docs , I get the error message: scrapyd-deploy: command not found. How is this possible if the installation was successful? I included the following goal in the configuration file:
[deploy:scrapyd2] url = http:
I'm not quite sure how the target works, but I basically copied it from the documents, so I think it will work. Is there something I need to import or configure that I don’t have? Thanks.
source share