my8100 / files Goto Github PK

我看到 items 是直接访问 scrapyd ，所以这个问题其实也是scrapyd的items 中文支持问题。请问有什么办法使items页面能够支持文中吗

SCRAPYD确定有启动，但始终提示None of your SCRAPYD_SERVERS could be connected.

查看Items页面报错，和scrapy pipeline设置有关系吗？

When I started scrapydweb, I encountered an error:
Unsupported Media Type
Did not attempt to load JSON data because the request Content-Type was not 'application/json'.

I am working on a scrapy project which requires some additional libs other than scrapy and python like Sqlalchemy, psycopg2 ect. Right now everything is working good and now I'd like to deploy the spider to Heroku and for monitoring, scheduling stuff I am trying to use Scrapyd server and ScrapydWeb for web interface. I deployed the scrapyd server on Heroku but for web interface it is showing application error and when I saw the logs error was:

when I tried locally scrapydweb response with 400 bad request. How to fix it?
scrapydweb_settings_v10.py

[2019-04-04 10:22:07,042] DEBUG in scrapydweb.utils.check_app_config: Checking connectivity of SCRAPYD_SERVERS
[2019-04-04 10:22:09,170] ERROR in main: Check app config fail:

Index Group Scrapyd IP:Port Connectivity Auth
None of your SCRAPYD_SERVERS could be connected.
####################################################################################################
Check and update your settings in D:/working/scrapydweb/scrapydweb/scrapydweb_settings_v8.py
1____ None________________ 127.0.0.1:6801________ False______ None

2____ group_______________ localhost:6801________ False______ ('admin', 'zbc12300')
####################################################################################################

I set the basic auth on scrapyd, but when I edit scrapydweb settings file with below:
SCRAPYD_SERVERS = [ ('admin','adminabc','127.0.0.1','6800','group1') ]
but occur exception: ip, port, group = re.search(r'^(.?)(?::(.?))?(?:@(.*?))?$', s.strip()).groups()
AttributeError: 'tuple' object has no attribute 'strip'

Can you help me with this, thanks!

Hello!
Ubuntu 18.04
Created venv with python3.7

pip install scrapydweb
scrapydweb

Changed the config - added scrapyd server, set auth, binding default to 0.0.0.0, port 5000
Run srapudweb again - ok, running.
Add firewall rule to allow 5000 port tcp

When I open server_ip:5000 and enter auth info I come to 400 bad request error.
Details of the error is 'Did not attempt to load JSON data because the request Content-Type was not 'application/json'

How to troubleshoot this?

I want to add new server and delete the old default server,but I did't know how to work,Please tell me ,I will very happy.