Error deploying project using scrapyd

Question

I had several spiders in my project folder and I want to run all the spiders at once, so I decided to start them using the scrapyd service. I started to do it by seeing here

First of all, I'm in the current project folder

• I opened the scrapy.cfg file and uncommented the url line after

  [expand]

• I had a scrapy server command that works fine, and scrapyd works on the server

• I tried this command scrapy deploy -l

  Result: default http://localhost:6800/

• when i tried this scrapy deploy -L scrapyd i got the following output

Result:

 Usage ===== scrapy deploy [options] [ [target] | -l | -L <target> ] deploy: error: Unknown target: scrapyd 

when i tried to deploy the project with this command scrapy deploy scrapyd -p default got the following error

 Usage ===== scrapy deploy [options] [ [target] | -l | -L <target> ] deploy: error: Unknown target: scrapyd 

I really cannot identify serum scraprapid demonstrating the above errors, may lead me to the correct way to deploy the project to scrapyd

Thanks in advance..........

Edited Code :

After looking at Peter Kirby's answer, I named the target in scrapy.cfg and tried the following command in the project folder,

Team

 scrapy deploy ebsite -p ebsite 

then I got the error below

 Building egg of ebsite-1341808241 'build/lib' does not exist -- can't clean it 'build/bdist.linux-x86_64' does not exist -- can't clean it 'build/scripts-2.7' does not exist -- can't clean it zip_safe flag not set; analyzing archive contents... Deploying ebsite-1341808241 to http://localhost:6800/addversion.json Deploy failed: <urlopen error [Errno 111] Connection refused> 

How to solve this .....

Answer 1

From the scrapyd service documentation: (http://scrapy.readthedocs.org/en/latest/topics/scrapyd.html?highlight=scrapyd)

You can define goals by adding them to your scrapy.cfg file ... Here is an example of defining a new target scrapyd2 with limited access through basic HTTP authentication:

 [deploy:scrapyd2] url = http://scrapyd.mydomain.com/api/scrapyd/ username = john password = secret 

Essentially, your mistake means that your "target" name is incorrect. If I remember correctly, the scrapy.cfg file sets the initial name of the target as "default." What you should print is something like:

 scrapy deploy default -p project_name 

Answer 2

Just enter scrapy deploy if you don't have named targets and left default settings!

Answer 3

This scrapyd proc does not have permission! You need to kill proc and then use the root user. Just enter:

 scrapy server 

then a new scrapyd will be launched. Then you can do scrapyd documention .

Answer 4

I got this error when I try to deploy my project without running scrapyd, so just run

 scrapyd 

bug fixed on another terminal