demo启动solr的命令运行失败 about anyq

[yinweichong]

执行以下命令时是否有报错信息，贴下报错信息

sh solr_script/anyq_solr.sh solr_script/sample_docs

jdk版本要求1.8以上

[ljch2018]

我的JDK是1.8，以下是起solr服务的日志，好像说JSP类找不到。

0    [main] INFO  org.eclipse.jetty.server.Server  – jetty-8.1.10.v20130312
19   [main] INFO  org.eclipse.jetty.deploy.providers.ScanningAppProvider  – Deployment monitor /home/work/jchluo/AnyQ/build/solr-4.10.3-anyq/example/contexts at interval 0
24   [main] INFO  org.eclipse.jetty.deploy.DeploymentManager  – Deployable added: /home/work/jchluo/AnyQ/build/solr-4.10.3-anyq/example/contexts/solr-jetty-context.xml
1115 [main] INFO  org.eclipse.jetty.webapp.StandardDescriptorProcessor  – NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
1162 [main] INFO  org.apache.solr.servlet.SolrDispatchFilter  – SolrDispatchFilter.init()
1174 [main] INFO  org.apache.solr.core.SolrResourceLoader  – JNDI not configured for solr (NoInitialContextEx)
1174 [main] INFO  org.apache.solr.core.SolrResourceLoader  – solr home defaulted to 'solr/' (could not find system property or JNDI)
1175 [main] INFO  org.apache.solr.core.SolrResourceLoader  – new SolrResourceLoader for directory: 'solr/'
1283 [main] INFO  org.apache.solr.core.ConfigSolr  – Loading container configuration from /home/work/jchluo/AnyQ/build/solr-4.10.3-anyq/example/solr/solr.xml
1346 [main] INFO  org.apache.solr.core.CoresLocator  – Config-defined core root directory: /home/work/jchluo/AnyQ/build/solr-4.10.3-anyq/example/solr

[ljch2018]

@yinweichong

NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet

[zhanghan1992]

可以重新从官网下载jdk, http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html。
或者从我们暂存的地址下载：
wget http://anyq.bj.bcebos.com/jdk-8u171-linux-x64.tar.gz
解压
tar xzvf jdk-8u171-linux-x64.tar.gz
加到系统路径
export PATH=pwd/jdk1.8.0_171/bin:$PATH

[ljch2018]

@zhanghan1992 我使用了以下的命令：

wget http://anyq.bj.bcebos.com/jdk-8u171-linux-x64.tar.gz
解压
tar xzvf jdk-8u171-linux-x64.tar.gz
加到系统路径
export PATH=pwd/jdk1.8.0_171/bin:$PATH

验证如下：

 which java
~/jchluo/jdk1.8.0_171/bin/java

但是还是出来一样的问题，仍然NO JSP Support.

[yinweichong]

看了下，正常solr启动也会有NO JSP Support，确认下是不是你的目录权限问题
正常启动日志如下

0    [main] INFO  org.eclipse.jetty.server.Server  – jetty-8.1.10.v20130312
51   [main] INFO  org.eclipse.jetty.deploy.providers.ScanningAppProvider  – Deployment monitor /AnyQ/build/solr-4.10.3-anyq/example/contexts at interval 0
61   [main] INFO  org.eclipse.jetty.deploy.DeploymentManager  – Deployable added: /AnyQ/build/solr-4.10.3-anyq/example/contexts/solr-jetty-context.xml
1604 [main] INFO  org.eclipse.jetty.webapp.StandardDescriptorProcessor  – NO JSP Support for /solr, did not find org.apache.jasper.servlet.JspServlet
1715 [main] INFO  org.apache.solr.servlet.SolrDispatchFilter  – SolrDispatchFilter.init()
1741 [main] INFO  org.apache.solr.core.SolrResourceLoader  – JNDI not configured for solr (NoInitialContextEx)
1742 [main] INFO  org.apache.solr.core.SolrResourceLoader  – using system property solr.solr.home: ./solr-4.10.3-anyq/example/solr/
1743 [main] INFO  org.apache.solr.core.SolrResourceLoader  – new SolrResourceLoader for directory: './solr-4.10.3-anyq/example/solr/'
1974 [main] INFO  org.apache.solr.core.ConfigSolr  – Loading container configuration from /AnyQ/build/./solr-4.10.3-anyq/example/solr/solr.xml
2096 [main] INFO  org.apache.solr.core.CoresLocator  – Config-defined core root directory: /AnyQ/build/./solr-4.10.3-anyq/example/solr
2108 [main] INFO  org.apache.solr.core.CoreContainer  – New CoreContainer 375457936
2109 [main] INFO  org.apache.solr.core.CoreContainer  – Loading cores into CoreContainer [instanceDir=./solr-4.10.3-anyq/example/solr/]

[SefaZeng]

你好 我在执行sh solr_script/anyq_solr.sh solr_script/sample_docs的时候报错ValueError: No JSON object could be decoded 请问是什么原因呢 看了一下faq目录下面是有json文件的

[SefaZeng]

看了一下好像是读取httperror的时候 报了错

[yinweichong]

贴一下详细的报错信息；
anyq-solr依赖jdk1.8+, 可以从官网或者我们暂存的地址下载；
anyq-solr的数据操纵依赖python2.7；

[SefaZeng]

原始报错信息

File "solr_script/solr_api.py", line 24, in
solr_tools.set_engine_schema(sys.argv[2], sys.argv[3], sys.argv[4], sys.argv[5])
File "/home/zengxianfeng/AnyQ/tools/solr_script/solr_tools.py", line 117, in set_engine_schema
_get_error_message(err.read())
File "/home/zengxianfeng/AnyQ/tools/solr_script/solr_tools.py", line 53, in _get_error_message
respond_dict = json.loads(respond_str.strip())
File "/usr/local/lib/python2.7/json/init.py", line 338, in loads
return _default_decoder.decode(s)
File "/usr/local/lib/python2.7/json/decoder.py", line 366, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/local/lib/python2.7/json/decoder.py", line 384, in raw_decode
raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded
Traceback (most recent call last):
File "solr_script/solr_api.py", line 30, in
solr_tools.clear_documents(sys.argv[2], sys.argv[3], sys.argv[4])
File "/home/zengxianfeng/AnyQ/tools/solr_script/solr_tools.py", line 219, in clear_documents
_get_error_message(err.read())
File "/home/zengxianfeng/AnyQ/tools/solr_script/solr_tools.py", line 53, in _get_error_message
respond_dict = json.loads(respond_str.strip())
File "/usr/local/lib/python2.7/json/init.py", line 338, in loads
return _default_decoder.decode(s)
File "/usr/local/lib/python2.7/json/decoder.py", line 366, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/local/lib/python2.7/json/decoder.py", line 384, in raw_decode
raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded
Exception in thread Thread-1:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/threading.py", line 810, in __bootstrap_inner
self.run()
File "/usr/local/lib/python2.7/threading.py", line 763, in run
self.__target(*self.__args, **self.__kwargs)
File "/home/zengxianfeng/AnyQ/tools/solr_script/solr_tools.py", line 140, in thread_upload
_get_error_message(err.read())
File "/home/zengxianfeng/AnyQ/tools/solr_script/solr_tools.py", line 53, in _get_error_message
respond_dict = json.loads(respond_str.strip())
File "/usr/local/lib/python2.7/json/init.py", line 338, in loads
return _default_decoder.decode(s)
File "/usr/local/lib/python2.7/json/decoder.py", line 366, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/local/lib/python2.7/json/decoder.py", line 384, in raw_decode
raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded

[SefaZeng]

把对应代码处的err打印出来和上面的@luosmart一样是HTTP ERROR 404

[yinweichong]

看日志是，set_schema失败，是solr启动失败；
ps f -ef | grep solr查看solr是否有进程；
请确认使用的jdk版本1.8+；

[SefaZeng]

输入命令显示的内容

12303 pts/2 S+ 0:00 | _ grep solr
3757 pts/2 Sl 0:10 java -DSTOP.PORT=8901 -DSTOP.KEY=secret_key -Djetty.port=8900 -Dsolr.solr.home=./solr-4.10.3-anyq/example/solr/ -Djetty.home=./solr-4.10.3-anyq/example/ -jar ./solr-4.10.3-anyq/example/start.jar

输入java -version显示的是

java version "1.8.0_11"
Java(TM) SE Runtime Environment (build 1.8.0_11-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.11-b03, mixed mode)

[SefaZeng]

上面的命令输错了。。不好意思

528 13033 21818 0 16:18 pts/2 S+ 0:00 | _ grep solr
528 3757 1 0 15:25 pts/2 Sl 0:10 java -DSTOP.PORT=8901 -DSTOP.KEY=secret_key -Djetty.port=8900 -Dsolr.solr.home=./solr-4.10.3-anyq/example/solr/ -Djetty.home=./solr-4.10.3-anyq/example/ -jar ./solr-4.10.3-anyq/example/start.jar

[yinweichong]

可能是jdk版本的问题，我们测试的时候用的1.8.0_171，你可以使用我们提供的jdk版本试一下

wget http://anyq.bj.bcebos.com/jdk-8u171-linux-x64.tar.gz
解压
tar xzvf jdk-8u171-linux-x64.tar.gz
加到系统路径
export PATH=`pwd`/jdk1.8.0_171/bin:$PATH

先将已存在的solr杀掉，然后重启；

[SefaZeng]

按照上面的步骤做了还是报同样的错 ERROR 404

[yinweichong]

看下solr启动过程中是否有ERROR或者WARN之类的日志，在nohup.out里；

ps:
如果条件允许的话，可以通过docker使用anyq；

[SefaZeng]

或者我可以直接将example里的模型导入然后进行测试吗 我看train里面没有导入模型 只有保存模型

[yinweichong]

是想使用anyq提供的语义匹配模型？
example里的模型可以放到simnet里预测，但输入是id，从中文文本需要切词才能转成id，开源的切词可以参考anyq里面的调用方式，或者参考lac的教程

[lullaby-afa]

或者我可以直接将example里的模型导入然后进行测试吗 我看train里面没有导入模型 只有保存模型
请问你的问题解决了吗 我也遇到了同样的问题