Coder Social home page Coder Social logo

dss-linkis-ansible's Introduction

DSS+Linkis Ansible 单机一键安装脚本

一、简介

为解决繁琐的部署流程，简化安装步骤，本脚本提供一键安装最新版本的DSS+Linkis环境；部署包中的软件采用我自己编译的安装包，并且为最新版本：DSS1.1.1 + Linkis1.3.0。

1.1 版本介绍

以下版本及配置信息可参考安装程序hosts文件中的[all:vars]字段。

软件名称 软件版本 应用路径 测试/连接命令
MySQL mysql-5.6 /usr/local/mysql mysql -h 127.0.0.1 -uroot -p123456
JDK jdk1.8.0_171 /usr/local/java java -version
Python python 2.7.5 /usr/lib64/python2.7 python -V
Nginx nginx/1.20.1 /etc/nginx nginx -t
Hadoop hadoop-2.7.2 /opt/hadoop hdfs dfs -ls /
Hive hive-2.3.3 /opt/hive hive -e "show databases"
Spark spark-2.4.3 /opt/spark spark-sql -e "show databases"
dss dss-1.1.1 /home/hadoop/dss http://<服务器IP>:8085
links linkis-1.3.0 /home/hadoop/linkis http://<服务器IP>:8188
zookeeper 3.4.6 /usr/local/zookeeper 无
DolphinScheduler 1.3.9 /opt/dolphinscheduler http://<服务器IP>:12345/dolphinscheduler
Visualis 1.0.0 /opt/visualis-server http://<服务器IP>:9088
Qualitis 0.9.2 /opt/qualitis http://<服务器IP>:8090
Streamis 0.2.0 /opt/streamis http://<服务器IP>:9188
Sqoop 1.4.6 /opt/sqoop sqoop
Exchangis 1.0.0 /opt/exchangis http://<服务器IP>:8028

二、部署前注意事项

要求：

  • 本脚本仅在CentOS 7系统上测试过，请确保安装的服务器为CentOS 7。
  • 仅安装DSS+Linkis服务器内存至少16G，安装全部服务内存至少32G。
  • 安装前请关闭服务器防火墙及SElinux，并使用root用户进行操作。
  • 安装服务器必须通畅的访问互联网，脚本需要yum下载一些基础软件。
  • 保证服务器未安装任何软件，包括不限于java、mysql、nginx等，最好是全新系统。
  • 必须保证服务器除lo:127.0.0.1回环地址外，仅只有一个IP地址，可使用echo $(hostname -I)命令测试。

三、部署方法

本案例部署主机IP为192.168.1.52，以下步骤请按照自己实际情况更改。

3.1 安装前设置

### 安装ansible
$ yum -y install epel-release
$ yum -y install ansible

### 配置免密
$ ssh-keygen -t rsa
$ ssh-copy-id [email protected]

### 关闭防火墙及SELinux
$ systemctl stop firewalld.service && systemctl disable firewalld.service
$ sed -i 's/^SELINUX=enforcing$/SELINUX=disabled/' /etc/selinux/config && setenforce 0

3.2 部署linkis+dss

### 获取安装包
$ git clone https://github.com/wubolive/dss-linkis-ansible.git
$ cd dss-linkis-ansible

### 目录说明
dss-linkis-ansible
├── ansible.cfg    # ansible 配置文件
├── hosts          # hosts主机及变量配置
├── playbooks      # playbooks剧本
├── README.md      # 说明文档
└── roles          # 角色配置

### 配置部署主机（注：ansible_ssh_host的值不能设置127.0.0.1）
$ vim hosts
[deploy]
dss-service ansible_ssh_host=192.168.1.52 ansible_ssh_port=22

### 下载安装包到download目录(如果下载失败，可以手动下载放到该目录)
$ ansible-playbook playbooks/download.yml

### 一键安装Linkis+DSS
$ ansible-playbook playbooks/all.yml
......
TASK [dss : 打印访问信息] *****************************************************************************************
ok: [dss-service] => {
    "msg": [
        "*****************************************************************", 
        "              访问 http://192.168.1.52 查看访问信息                 ", 
        "*****************************************************************"
    ]
}

执行结束后，即可访问：http://192.168.1.52 查看信息页面，上面记录了所有服务的访问地址及账号密码。

image

3.3 部署其它服务

# 安装dolphinscheduler
$ ansible-playbook playbooks/dolphinscheduler.yml
### 注: 安装以下服务必须优先安装dolphinscheduler调度系统
# 安装visualis
$ ansible-playbook playbooks/visualis.yml 
# 安装qualitis
$ ansible-playbook playbooks/qualitis.yml
# 安装streamis
$ ansible-playbook playbooks/streamis.yml
# 安装exchangis
$ ansible-playbook playbooks/exchangis.yml

3.4 维护指南

### 查看实时日志
$ su - hadoop
$ tail -f ~/linkis/logs/*.log ~/dss/logs/*.log

### 启动服务（如服务器重启可使用此命令一建启动）
$ ansible-playbook playbooks/all.yml -t restart
# 启动其它服务
$ sh /usr/local/zookeeper/bin/zkServer.sh start
$ su - hadoop
$ cd /opt/dolphinscheduler/bin &&  sh start-all.sh 
$ cd /opt/visualis-server/bin && sh start-visualis-server.sh
$ cd /opt/qualitis/bin/ && sh start.sh
$ cd /opt/streamis/streamis-server/bin/ && sh start-streamis-server.sh
$ cd /opt/exchangis/sbin/ && ./daemon.sh start server

使用问题请访问官方QA文档：https://docs.qq.com/doc/DSGZhdnpMV3lTUUxq

dss-linkis-ansible's People

Contributors

stdnt-xiao avatar wubolive avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar

Forkers

stdnt-xiao firetoss xxwhite jalena liurenbao niaoshuai kinxdle cxycxh lybigdata ttinfo

dss-linkis-ansible's Issues

linkis-cg-engineplugin微服务启动失败

2023-03-19 17:05:13.050 [ERROR] [Linkis-Default-Scheduler-Thread-1 ] o.a.l.e.s.s.DefaultEngineConnResourceService (117) [apply] - Failed to upload engine conn to bml, now exit! org.apache.linkis.httpclient.exception.HttpClientResultException: errCode: 10905 ,desc: URL /api/rest_j/v1/bml/upload request failed! ResponseBody is {"timestamp":1679216712827,"status":500,"error":"Internal Server Error","message":"","path":"/api/rest_j/v1/bml/upload"}. errCode: 10905 ,desc: URL /api/rest_j/v1/bml/upload request failed! ResponseBody is {"timestamp":1679216712827,"status":500,"error":"Internal Server Error","message":"","path":"/api/rest_j/v1/bml/upload"}. ,ip: dss-service ,port: 9103 ,serviceKind: linkis-cg-engineplugin ,ip: dss-service ,port: 9103 ,serviceKind: linkis-cg-engineplugin
at org.apache.linkis.httpclient.dws.response.DWSResult$$anonfun$set$2.apply(DWSResult.scala:85) ~[linkis-gateway-httpclient-support-1.3.0.jar:1.3.0]
at org.apache.linkis.httpclient.dws.response.DWSResult$$anonfun$set$2.apply(DWSResult.scala:84) ~[linkis-gateway-httpclient-support-1.3.0.jar:1.3.0]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:61) ~[linkis-common-1.3.0.jar:1.3.0]
at org.apache.linkis.httpclient.dws.response.DWSResult$class.set(DWSResult.scala:84) ~[linkis-gateway-httpclient-support-1.3.0.jar:1.3.0]
at org.apache.linkis.bml.response.BmlResult.set(BmlResult.scala:26) ~[linkis-bml-client-1.3.0.jar:1.3.0]
at org.apache.linkis.httpclient.dws.DWSHttpClient$$anonfun$httpResponseToResult$1.apply(DWSHttpClient.scala:83) ~[linkis-gateway-httpclient-support-1.3.0.jar:1.3.0]
at org.apache.linkis.httpclient.dws.DWSHttpClient$$anonfun$httpResponseToResult$1.apply(DWSHttpClient.scala:79) ~[linkis-gateway-httpclient-support-1.3.0.jar:1.3.0]
at scala.Option.map(Option.scala:146) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.httpclient.dws.DWSHttpClient.httpResponseToResult(DWSHttpClient.scala:79) ~[linkis-gateway-httpclient-support-1.3.0.jar:1.3.0]
at org.apache.linkis.httpclient.AbstractHttpClient.responseToResult(AbstractHttpClient.scala:522) ~[linkis-httpclient-1.3.0.jar:1.3.0]
at org.apache.linkis.httpclient.AbstractHttpClient.execute(AbstractHttpClient.scala:168) ~[linkis-httpclient-1.3.0.jar:1.3.0]
at org.apache.linkis.httpclient.AbstractHttpClient.execute(AbstractHttpClient.scala:125) ~[linkis-httpclient-1.3.0.jar:1.3.0]
at org.apache.linkis.bml.client.impl.HttpBmlClient.uploadResource(HttpBmlClient.scala:399) ~[linkis-bml-client-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService.org$apache$linkis$engineplugin$server$service$DefaultEngineConnResourceService$$uploadToBml(DefaultEngineConnResourceService.scala:69) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anonfun$org$apache$linkis$engineplugin$server$service$DefaultEngineConnResourceService$$refresh$2.apply(DefaultEngineConnResourceService.scala:186) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anonfun$org$apache$linkis$engineplugin$server$service$DefaultEngineConnResourceService$$refresh$2.apply(DefaultEngineConnResourceService.scala:180) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.12.jar:?]
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService.org$apache$linkis$engineplugin$server$service$DefaultEngineConnResourceService$$refresh(DefaultEngineConnResourceService.scala:180) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$1$$anonfun$apply$1$$anonfun$apply$mcV$sp$1.apply(DefaultEngineConnResourceService.scala:111) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$1$$anonfun$apply$1$$anonfun$apply$mcV$sp$1.apply(DefaultEngineConnResourceService.scala:108) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at scala.collection.immutable.Map$Map1.foreach(Map.scala:116) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$1$$anonfun$apply$1.apply$mcV$sp(DefaultEngineConnResourceService.scala:108) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$1$$anonfun$apply$1.apply(DefaultEngineConnResourceService.scala:106) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$1$$anonfun$apply$1.apply(DefaultEngineConnResourceService.scala:106) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:47) ~[linkis-common-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$1.apply(DefaultEngineConnResourceService.scala:113) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$1.apply(DefaultEngineConnResourceService.scala:105) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) ~[scala-library-2.11.12.jar:?]
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1.run(DefaultEngineConnResourceService.scala:104) ~[linkis-engineconn-plugin-server-1.3.0.jar:1.3.0]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_171]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_171]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_171]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_171]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_171]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_171]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_171]

2023-03-19 17:05:13.054 [INFO ] [SpringContextShutdownHook ] o.s.c.n.e.s.EurekaServiceRegistry (65) [deregister] - Unregistering application LINKIS-CG-ENGINEPLUGIN with eureka with status DOWN

最新部署出现一个问题，不知道有没影响

TASK [streamis : 启动服务] ******************************************************************************************************************************************************************************************************************************
fatal: [dss-service]: FAILED! => {"changed": true, "cmd": "source /etc/profile ~/.bashrc ; sh bin/start-streamis-server.sh", "delta": "0:00:02.033980", "end": "2022-12-28 00:47:22.310969", "msg": "non-zero return code", "rc": 1, "start": "2022-12-28 00:47:20.276989", "stderr": "", "stderr_lines": [], "stdout": "Streamis Server start succeeded!\nJava HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=500m; support was removed in 8.0", "stdout_lines": ["Streamis Server start succeeded!", "Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=500m; support was removed in 8.0"]}
...ignoring

按现在没有安装包的方式部署报错，是这里代码需要改成服务器IP还是。host文件是改了IP的了

TASK [下载linkis前端包] ******************************************************************************************************************
changed: [dss-service]

TASK [解压linkis前端包] ******************************************************************************************************************
changed: [dss-service]

TASK [创建linkis前端目录] *****************************************************************************************************************
changed: [dss-service]

TASK [linkis : 复制前端代码] **************************************************************************************************************
changed: [dss-service]

TASK [linkis : 创建nginx配置] ***********************************************************************************************************
changed: [dss-service]

TASK [linkis : 重载nginx配置] ***********************************************************************************************************
changed: [dss-service]

TASK [linkis : 检查端口是否运行] ************************************************************************************************************
fatal: [dss-service]: FAILED! => {"changed": false, "elapsed": 10, "msg": "Timeout when waiting for 127.0.0.1:8188"}

在官方群里，有群友说，每个服务都加15秒的延迟后，再启动下一个服务，因为上一个服务还没启动完成

部署dss成功，新建工作流出现警告

部署在阿里云ECS

Warning code(警告码): 50032, Warning message(警告信息): Try to ask Linkis for creating a new contextId failed(向Linkis请求创建一个ContextID失败)! Linkis error msg: HttpClientResultException: errCode: 10905 ,desc: URL /api/rest_j/v1/contextservice/createContextID request failed! ResponseBody is {"method":"/api/rest_j/v1/contextservice/createContextID","status":1,"message":"IllegalArgumentException: Supplied VIP Address cannot be null","data":{"data":null}}. errCode: 10905 ,desc: URL /api/rest_j/v1/contextservice/createContextID request failed! ResponseBody is {"method":"/api/rest_j/v1/contextservice/createContextID","status":1,"message":"IllegalArgumentException: Supplied VIP Address cannot be null","data":{"data":null}}. ,ip: dss-service ,port: 9003 ,serviceKind: dss-framework-orchestrator-server-dev ,ip: dss-service ,port: 9003 ,serviceKind: dss-framework-orchestrator-server-dev.

安装streamis有个ignoring 不知道会不会影响

TASK [streamis : 启动服务] ********************************************************************************************************************************************************************************************************************************
fatal: [dss-service]: FAILED! => {"changed": true, "cmd": "source /etc/profile ~/.bashrc ; sh bin/start-streamis-server.sh", "delta": "0:00:02.040335", "end": "2023-01-06 00:15:24.059053", "msg": "non-zero return code", "rc": 1, "start": "2023-01-06 00:15:22.018718", "stderr": "", "stderr_lines": [], "stdout": "Streamis Server start succeeded!\nJava HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=500m; support was removed in 8.0", "stdout_lines": ["Streamis Server start succeeded!", "Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=500m; support was removed in 8.0"]}
...ignoring

修改后，最新的部署脚本，安装不了nginx，应该是找不到安装包

TASK [安装nginx] ****************************************************************************************************************************************************************************************************************************************
fatal: [dss-service]: FAILED! => {"changed": false, "msg": "No package matching 'nginx' found available, installed or updated", "rc": 126, "results": ["No package matching 'nginx' found available, installed or updated"]}

PLAY RECAP ********************************************************************************************************************************************************************************************************************************************
dss-service : ok=1 changed=0 unreachable=0 failed=1 skipped=0 rescued=0 ignored=0

请教下这个是什么原因

[root@node5 playbooks]# ansible-playbook all.yml
[WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
ERROR! the role 'hadoop' was not found in /opt/dss-linkis-ansible/playbooks/roles:/root/.ansible/roles:/usr/share/ansible/roles:/etc/ansible/roles:/opt/dss-linkis-ansible/playbooks

The error appears to be in '/opt/dss-linkis-ansible/playbooks/all.yml': line 4, column 6, but may
be elsewhere in the file depending on the exact syntax problem.

The offending line appears to be:

roles:

  • hadoop
    ^ here

发现如下错误日志，怎么解决啊？

{
"changed": true,
"cmd": "source /etc/profile ~/.bashrc ; sh bin/linkis-cli -submitUser hadoop -engineType shell-1 -codeType shell -code "whoami"",
"delta": "0:00:18.531338",
"end": "2022-12-22 13:13:24.272918",
"msg": "non-zero return code",
"rc": 255,
"start": "2022-12-22 13:13:05.741580",
"stderr": "",
"stderr_lines": [ ],
"stdout": "=====Java Start Command=====
exec /usr/local/java/bin/java -server -Xms32m -Xmx2048m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/hadoop/linkis/logs/linkis-cli -XX:ErrorFile=/home/hadoop/linkis/logs/linkis-cli/ps_err_pid%p.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80 -XX:+DisableExplicitGC -classpath /home/hadoop/linkis/conf/linkis-cli:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-client/linkis-cli/:/home/hadoop/linkis/lib/linkis-commons/public-module/:.:/usr/local/java/lib/dt.jar:/usr/local/java/lib/tools.jar:/usr/local/java/jre/lib:.:/usr/local/java/lib/dt.jar:/usr/local/java/lib/tools.jar:/usr/local/java/jre/lib: -Dconf.root=/home/hadoop/linkis/conf/linkis-cli -Dconf.file=linkis-cli.properties -Dlog.path=/home/hadoop/linkis/logs/linkis-cli -Dlog.file=linkis-client.hadoop.log.20221222131305804059965 org.apache.linkis.cli.application.LinkisClientApplication '-submitUser hadoop -engineType shell-1 -codeType shell -code whoami'
[INFO] LogFile path: /home/hadoop/linkis/logs/linkis-cli/linkis-client.hadoop.log.20221222131305804059965
[INFO] User does not provide usr-configuration file. Will use default config
[INFO] user does not specify proxy-user, will use current submit-user "hadoop" by default.
[INFO] connecting to linkis gateway:http://127.0.0.1:9001
JobId:1
TaskId:1
ExecId:exec_id018016linkis-cg-entrancedss-service:9104LINKISCLI_hadoop_shell_0
[INFO] Job is successfully submitted!

2022-12-22 13:13:11.013 INFO Program is substituting variables for you
2022-12-22 13:13:11.013 INFO Variables substitution ended successfully
2022-12-22 13:13:13.013 WARN The code you submit will not be limited by the limit
Job with jobId : 1 and execID : LINKISCLI_hadoop_shell_0 submitted
2022-12-22 13:13:14.013 INFO You have submitted a new job, script code (after variable substitution) is
SCRIPT CODE
whoami
SCRIPT CODE
2022-12-22 13:13:14.013 INFO Your job is accepted, jobID is LINKISCLI_hadoop_shell_0 and jobReqId is 1 in ServiceInstance(linkis-cg-entrance, dss-service:9104). Please wait it to be scheduled
job is scheduled.
2022-12-22 13:13:14.013 INFO Your job is Scheduled. Please wait it to run.
Your job is being scheduled by orchestrator.
2022-12-22 13:13:14.013 INFO job is running.
2022-12-22 13:13:14.013 INFO Your job is Running now. Please wait it to complete.
2022-12-22 13:13:15.013 INFO Job with jobGroupId : 1 and subJobId : 1 was submitted to Orchestrator.
2022-12-22 13:13:15.013 INFO Background is starting a new engine for you,execId TaskID_1_otJobId_astJob_0_codeExec_0 mark id is mark_0, it may take several seconds, please wait
2022-12-22 13:13:18.013 ERROR Job with execId-LINKISCLI_hadoop_shell_0 + subJobId : 1 execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dss-service:9101_0 Failed to async get EngineNode ClientException: Load balancer does not have available server for client: linkis-cg-engineplugin ,ip: dss-service ,port: 9104 ,serviceKind: linkis-cg-entrance

2022-12-22 13:13:18.013 INFO job is completed.
2022-12-22 13:13:18.013 INFO Task creation time(任务创建时间): 2022-12-22 13:13:10, Task scheduling time(任务调度时间): 2022-12-22 13:13:14, Task start time(任务开始时间): 2022-12-22 13:13:15, Mission end time(任务结束时间): 2022-12-22 13:13:18
2022-12-22 13:13:18.013 INFO Your mission(您的任务) 1 The total time spent is(总耗时时间为): 7.7 s
2022-12-22 13:13:18.013 INFO Sorry. Your job completed with a status Failed. You can view logs for the reason.

[INFO] Job status is not success but 'FAILED'. Will not try to retrieve any Result
[INFO] Job failed! Will not try get execute result.
============Result:================
TaskId:1
ExecId: exec_id018016linkis-cg-entrancedss-service:9104LINKISCLI_hadoop_shell_0
User:hadoop
Current job status:FAILED
extraMsg:
errDesc: 21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dss-service:9101_0 Failed to async get EngineNode ClientException: Load balancer does not have available server for client: linkis-cg-engineplugin ,ip: dss-service ,port: 9104 ,serviceKind: linkis-cg-e

[INFO] JobStatus is not 'success'. Will not retrieve result-set.
############Execute Error!!!########",
"stdout_lines": [
"=====Java Start Command=====",
"exec /usr/local/java/bin/java -server -Xms32m -Xmx2048m -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/hadoop/linkis/logs/linkis-cli -XX:ErrorFile=/home/hadoop/linkis/logs/linkis-cli/ps_err_pid%p.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=80 -XX:+DisableExplicitGC -classpath /home/hadoop/linkis/conf/linkis-cli:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-client/linkis-cli/:/home/hadoop/linkis/lib/linkis-commons/public-module/:.:/usr/local/java/lib/dt.jar:/usr/local/java/lib/tools.jar:/usr/local/java/jre/lib:.:/usr/local/java/lib/dt.jar:/usr/local/java/lib/tools.jar:/usr/local/java/jre/lib: -Dconf.root=/home/hadoop/linkis/conf/linkis-cli -Dconf.file=linkis-cli.properties -Dlog.path=/home/hadoop/linkis/logs/linkis-cli -Dlog.file=linkis-client.hadoop.log.20221222131305804059965 org.apache.linkis.cli.application.LinkisClientApplication '-submitUser hadoop -engineType shell-1 -codeType shell -code whoami'",
"[INFO] LogFile path: /home/hadoop/linkis/logs/linkis-cli/linkis-client.hadoop.log.20221222131305804059965",
"[INFO] User does not provide usr-configuration file. Will use default config",
"[INFO] user does not specify proxy-user, will use current submit-user "hadoop" by default.",
"[INFO] connecting to linkis gateway:http://127.0.0.1:9001",
"JobId:1",
"TaskId:1",
"ExecId:exec_id018016linkis-cg-entrancedss-service:9104LINKISCLI_hadoop_shell_0",
"[INFO] Job is successfully submitted!",
"",
"2022-12-22 13:13:11.013 INFO Program is substituting variables for you",
"2022-12-22 13:13:11.013 INFO Variables substitution ended successfully",
"2022-12-22 13:13:13.013 WARN The code you submit will not be limited by the limit",
"Job with jobId : 1 and execID : LINKISCLI_hadoop_shell_0 submitted ",
"2022-12-22 13:13:14.013 INFO You have submitted a new job, script code (after variable substitution) is",
"SCRIPT CODE",
"whoami",
"SCRIPT CODE",
"2022-12-22 13:13:14.013 INFO Your job is accepted, jobID is LINKISCLI_hadoop_shell_0 and jobReqId is 1 in ServiceInstance(linkis-cg-entrance, dss-service:9104). Please wait it to be scheduled",
"job is scheduled.",
"2022-12-22 13:13:14.013 INFO Your job is Scheduled. Please wait it to run.",
"Your job is being scheduled by orchestrator.",
"2022-12-22 13:13:14.013 INFO job is running.",
"2022-12-22 13:13:14.013 INFO Your job is Running now. Please wait it to complete.",
"2022-12-22 13:13:15.013 INFO Job with jobGroupId : 1 and subJobId : 1 was submitted to Orchestrator.",
"2022-12-22 13:13:15.013 INFO Background is starting a new engine for you,execId TaskID_1_otJobId_astJob_0_codeExec_0 mark id is mark_0, it may take several seconds, please wait",
"2022-12-22 13:13:18.013 ERROR Job with execId-LINKISCLI_hadoop_shell_0 + subJobId : 1 execute failed,21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dss-service:9101_0 Failed to async get EngineNode ClientException: Load balancer does not have available server for client: linkis-cg-engineplugin ,ip: dss-service ,port: 9104 ,serviceKind: linkis-cg-entrance ",
" ",
"2022-12-22 13:13:18.013 INFO job is completed.",
"2022-12-22 13:13:18.013 INFO Task creation time(任务创建时间): 2022-12-22 13:13:10, Task scheduling time(任务调度时间): 2022-12-22 13:13:14, Task start time(任务开始时间): 2022-12-22 13:13:15, Mission end time(任务结束时间): 2022-12-22 13:13:18",
"2022-12-22 13:13:18.013 INFO Your mission(您的任务) 1 The total time spent is(总耗时时间为): 7.7 s",
"2022-12-22 13:13:18.013 INFO Sorry. Your job completed with a status Failed. You can view logs for the reason.",
"",
"[INFO] Job status is not success but 'FAILED'. Will not try to retrieve any Result",
"[INFO] Job failed! Will not try get execute result.",
"============Result:================",
"TaskId:1",
"ExecId: exec_id018016linkis-cg-entrancedss-service:9104LINKISCLI_hadoop_shell_0",
"User:hadoop",
"Current job status:FAILED",
"extraMsg: ",
"errDesc: 21304, Task is Failed,errorMsg: errCode: 12003 ,desc: dss-service:9101_0 Failed to async get EngineNode ClientException: Load balancer does not have available server for client: linkis-cg-engineplugin ,ip: dss-service ,port: 9104 ,serviceKind: linkis-cg-e",
"",
"[INFO] JobStatus is not 'success'. Will not retrieve result-set.",
"############Execute Error!!!########"
]
}

启动linkis服务出错

首次安装，启动linkis服务出错。删除linkis重新安装，启动正常。
怀疑与连续启动多个服务，服务还未正常启动完毕，后续服务对上述服务有依赖，导致的错误。
是否有参数，可以设置启动服务等待时长

TASK [linkis : 创建token配置] *****************************************************************************************************************
changed: [dss-service]

TASK [linkis : 复制依赖包] *********************************************************************************************************************
changed: [dss-service] => (item=datanucleus-api-jdo-4.2.4.jar)
changed: [dss-service] => (item=datanucleus-rdbms-4.1.19.jar)
changed: [dss-service] => (item=javax.jdo-3.2.0-m3.jar)
changed: [dss-service] => (item=jdo-api-3.0.1.jar)

TASK [启动linkis服务] *************************************************************************************************************************
fatal: [dss-service]: FAILED! => {"changed": true, "cmd": "source /etc/profile ~/.bashrc ; sh sbin/linkis-start-all.sh", "delta": "0:01:25.442314", "end": "2023-04-18 15:31:51.329324", "msg": "non-zero return code", "rc": 1, "start": "2023-04-18 15:30:25.887010", "stderr": "Bad port 'linkis-cg-engineconnmanager'", "stderr_lines": ["Bad port 'linkis-cg-engineconnmanager'"], "stdout": "We will start all linkis applications, it will take some time, please wait\n<-------------------------------->\nBegin to start mg-eureka\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart mg-eureka\nserver mg-eureka is not running\nStart to check whether the mg-eureka is running\nStart server, startup script: /home/hadoop/linkis/sbin/ext/linkis-mg-eureka\n=====Java Start Command=====\nnohup java -DserviceName=linkis-mg-eureka -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-mg-eureka-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-spring-cloud-services/linkis-mg-eureka/:/home/hadoop/linkis/lib/linkis-commons/public-module/ org.apache.linkis.eureka.SpringCloudEurekaApplication --eureka.instance.hostname=dss-service --spring.profiles.active=eureka 2>&1 > /home/hadoop/linkis/logs/linkis-mg-eureka.out &\nserver linkis-mg-eureka start succeeded!\n\u001b[0;32mSucceed\u001b[0m to start mg-eureka\n\n<-------------------------------->\n<-------------------------------->\nBegin to start mg-gateway\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart mg-gateway\nserver mg-gateway is not running\nStart to check whether the mg-gateway is running\nStart server, startup script: /home/hadoop/linkis/sbin/ext/linkis-mg-gateway\n=====Java Start Command=====\nnohup java -DserviceName=linkis-mg-gateway -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-mg-gateway-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-spring-cloud-services/linkis-mg-gateway/:/ org.apache.linkis.gateway.springcloud.LinkisGatewayApplication 2>&1 > /home/hadoop/linkis/logs/linkis-mg-gateway.out &\nserver linkis-mg-gateway start succeeded!\n\u001b[0;32mSucceed\u001b[0m to start mg-gateway\n\n<-------------------------------->\n<-------------------------------->\nBegin to start ps-publicservice\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart ps-publicservice\nserver ps-publicservice is not running\nStart to check whether the ps-publicservice is running\nStart server, startup script: /home/hadoop/linkis/sbin/ext/linkis-ps-publicservice\n=====Java Start Command=====\nnohup java -DserviceName=linkis-ps-publicservice -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-ps-publicservice-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-public-enhancements/linkis-ps-publicservice/:/* org.apache.linkis.filesystem.LinkisPublicServiceApp 2>&1 > /home/hadoop/linkis/logs/linkis-ps-publicservice.out &\nserver linkis-ps-publicservice start succeeded!\n\u001b[0;32mSucceed\u001b[0m to start ps-publicservice\n\n<-------------------------------->\n<-------------------------------->\nBegin to start cg-linkismanager\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-linkismanager\nserver cg-linkismanager is not running\nStart to check whether the cg-linkismanager is running\nStart server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-linkismanager\n=====Java Start Command=====\nnohup java -DserviceName=linkis-cg-linkismanager -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-linkismanager-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-linkismanager/:/* org.apache.linkis.manager.am.LinkisManagerApplication 2>&1 > /home/hadoop/linkis/logs/linkis-cg-linkismanager.out &\nTue Apr 18 15:30:50 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.\nserver linkis-cg-linkismanager start succeeded!\n\u001b[0;32mSucceed\u001b[0m to start cg-linkismanager\n\n<-------------------------------->\nTue Apr 18 15:31:01 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.\n<-------------------------------->\nBegin to start cg-entrance\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-entrance\nserver cg-entrance is not running\nStart to check whether the cg-entrance is running\nStart server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-entrance\n=====Java Start Command=====\nnohup java -DserviceName=linkis-cg-entrance -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-entrance-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-entrance/:/* org.apache.linkis.entrance.LinkisEntranceApplication 2>&1 > /home/hadoop/linkis/logs/linkis-cg-entrance.out &\nserver linkis-cg-entrance start succeeded!\n\u001b[0;32mSucceed\u001b[0m to start cg-entrance\n\n<-------------------------------->\n<-------------------------------->\nBegin to start cg-engineconnmanager\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-engineconnmanager\nserver cg-engineconnmanager is not running\nTue Apr 18 15:31:22 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.\nStart to check whether the cg-engineconnmanager is running\nStart server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-engineconnmanager\n=====Java Start Command=====\nnohup java -DserviceName=linkis-cg-engineconnmanager -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-engineconnmanager-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-engineconnmanager/:/* org.apache.linkis.ecm.server.LinkisECMApplication 2>&1 > /home/hadoop/linkis/logs/linkis-cg-engineconnmanager.out &\nserver linkis-cg-engineconnmanager start succeeded!\n\u001b[0;32mSucceed\u001b[0m to start cg-engineconnmanager\n\n<-------------------------------->\n<-------------------------------->\nBegin to start cg-engineplugin\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-engineplugin\nserver cg-engineplugin is not running\nStart to check whether the cg-engineplugin is running\nStart server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-engineplugin\n=====Java Start Command=====\nnohup java -DserviceName=linkis-cg-engineplugin -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-engineplugin-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-engineplugin/:/* org.apache.linkis.engineplugin.server.LinkisEngineConnPluginServer 2>&1 > /home/hadoop/linkis/logs/linkis-cg-engineplugin.out &\nserver linkis-cg-engineplugin start succeeded!\n\u001b[0;32mSucceed\u001b[0m to start cg-engineplugin\n\n<-------------------------------->\nstart-all shell script executed completely\nStart to check all linkis microservice\n<-------------------------------->\nBegin to check mg-eureka\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status mg-eureka\n70420\nserver mg-eureka is running.\n<-------------------------------->\n<-------------------------------->\nBegin to check mg-gateway\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status mg-gateway\n70480\nserver mg-gateway is running.\n<-------------------------------->\nTue Apr 18 15:31:38 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.\n<-------------------------------->\nBegin to check ps-publicservice\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status ps-publicservice\n70529\nserver ps-publicservice is running.\n<-------------------------------->\n<-------------------------------->\nBegin to check cg-linkismanager\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status cg-linkismanager\n70584\nserver cg-linkismanager is running.\n<-------------------------------->\n<-------------------------------->\nBegin to check cg-entrance\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status cg-entrance\n70685\nserver cg-entrance is running.\n<-------------------------------->\n<-------------------------------->\nBegin to check cg-engineconnmanager\nIs local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status cg-engineconnmanager\nserver cg-engineconnmanager is not running\nERROR: your linkis-cg-engineconnmanager microservice is not start successful !!! ERROR logs as follows :\nPlease check detail log, log path :/home/hadoop/linkis/logs/linkis-cg-engineconnmanager.log\n<---------------------------------------------------->\nIs remote execution:tail -n 50 /home/hadoop/linkis/logs/linkis-cg-engineconnmanager.log\n<---------------------------------------------------->\nPlease check detail log, log path :/home/hadoop/linkis/logs/linkis-cg-engineconnmanager.log", "stdout_lines": ["We will start all linkis applications, it will take some time, please wait", "<-------------------------------->", "Begin to start mg-eureka", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart mg-eureka", "server mg-eureka is not running", "Start to check whether the mg-eureka is running", "Start server, startup script: /home/hadoop/linkis/sbin/ext/linkis-mg-eureka", "=====Java Start Command=====", "nohup java -DserviceName=linkis-mg-eureka -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-mg-eureka-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-spring-cloud-services/linkis-mg-eureka/:/home/hadoop/linkis/lib/linkis-commons/public-module/ org.apache.linkis.eureka.SpringCloudEurekaApplication --eureka.instance.hostname=dss-service --spring.profiles.active=eureka 2>&1 > /home/hadoop/linkis/logs/linkis-mg-eureka.out &", "server linkis-mg-eureka start succeeded!", "\u001b[0;32mSucceed\u001b[0m to start mg-eureka", "", "<-------------------------------->", "<-------------------------------->", "Begin to start mg-gateway", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart mg-gateway", "server mg-gateway is not running", "Start to check whether the mg-gateway is running", "Start server, startup script: /home/hadoop/linkis/sbin/ext/linkis-mg-gateway", "=====Java Start Command=====", "nohup java -DserviceName=linkis-mg-gateway -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-mg-gateway-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-spring-cloud-services/linkis-mg-gateway/:/ org.apache.linkis.gateway.springcloud.LinkisGatewayApplication 2>&1 > /home/hadoop/linkis/logs/linkis-mg-gateway.out &", "server linkis-mg-gateway start succeeded!", "\u001b[0;32mSucceed\u001b[0m to start mg-gateway", "", "<-------------------------------->", "<-------------------------------->", "Begin to start ps-publicservice", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart ps-publicservice", "server ps-publicservice is not running", "Start to check whether the ps-publicservice is running", "Start server, startup script: /home/hadoop/linkis/sbin/ext/linkis-ps-publicservice", "=====Java Start Command=====", "nohup java -DserviceName=linkis-ps-publicservice -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-ps-publicservice-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-public-enhancements/linkis-ps-publicservice/:/* org.apache.linkis.filesystem.LinkisPublicServiceApp 2>&1 > /home/hadoop/linkis/logs/linkis-ps-publicservice.out &", "server linkis-ps-publicservice start succeeded!", "\u001b[0;32mSucceed\u001b[0m to start ps-publicservice", "", "<-------------------------------->", "<-------------------------------->", "Begin to start cg-linkismanager", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-linkismanager", "server cg-linkismanager is not running", "Start to check whether the cg-linkismanager is running", "Start server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-linkismanager", "=====Java Start Command=====", "nohup java -DserviceName=linkis-cg-linkismanager -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-linkismanager-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-linkismanager/:/* org.apache.linkis.manager.am.LinkisManagerApplication 2>&1 > /home/hadoop/linkis/logs/linkis-cg-linkismanager.out &", "Tue Apr 18 15:30:50 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.", "server linkis-cg-linkismanager start succeeded!", "\u001b[0;32mSucceed\u001b[0m to start cg-linkismanager", "", "<-------------------------------->", "Tue Apr 18 15:31:01 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.", "<-------------------------------->", "Begin to start cg-entrance", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-entrance", "server cg-entrance is not running", "Start to check whether the cg-entrance is running", "Start server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-entrance", "=====Java Start Command=====", "nohup java -DserviceName=linkis-cg-entrance -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-entrance-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-entrance/:/* org.apache.linkis.entrance.LinkisEntranceApplication 2>&1 > /home/hadoop/linkis/logs/linkis-cg-entrance.out &", "server linkis-cg-entrance start succeeded!", "\u001b[0;32mSucceed\u001b[0m to start cg-entrance", "", "<-------------------------------->", "<-------------------------------->", "Begin to start cg-engineconnmanager", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-engineconnmanager", "server cg-engineconnmanager is not running", "Tue Apr 18 15:31:22 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.", "Start to check whether the cg-engineconnmanager is running", "Start server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-engineconnmanager", "=====Java Start Command=====", "nohup java -DserviceName=linkis-cg-engineconnmanager -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-engineconnmanager-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-engineconnmanager/:/* org.apache.linkis.ecm.server.LinkisECMApplication 2>&1 > /home/hadoop/linkis/logs/linkis-cg-engineconnmanager.out &", "server linkis-cg-engineconnmanager start succeeded!", "\u001b[0;32mSucceed\u001b[0m to start cg-engineconnmanager", "", "<-------------------------------->", "<-------------------------------->", "Begin to start cg-engineplugin", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh restart cg-engineplugin", "server cg-engineplugin is not running", "Start to check whether the cg-engineplugin is running", "Start server, startup script: /home/hadoop/linkis/sbin/ext/linkis-cg-engineplugin", "=====Java Start Command=====", "nohup java -DserviceName=linkis-cg-engineplugin -Xmx1024M -XX:+UseG1GC -Xloggc:/home/hadoop/linkis/logs/linkis-cg-engineplugin-gc.log -cp /home/hadoop/linkis/conf:/home/hadoop/linkis/lib/linkis-commons/public-module/:/home/hadoop/linkis/lib/linkis-computation-governance/linkis-cg-engineplugin/:/* org.apache.linkis.engineplugin.server.LinkisEngineConnPluginServer 2>&1 > /home/hadoop/linkis/logs/linkis-cg-engineplugin.out &", "server linkis-cg-engineplugin start succeeded!", "\u001b[0;32mSucceed\u001b[0m to start cg-engineplugin", "", "<-------------------------------->", "start-all shell script executed completely", "Start to check all linkis microservice", "<-------------------------------->", "Begin to check mg-eureka", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status mg-eureka", "70420", "server mg-eureka is running.", "<-------------------------------->", "<-------------------------------->", "Begin to check mg-gateway", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status mg-gateway", "70480", "server mg-gateway is running.", "<-------------------------------->", "Tue Apr 18 15:31:38 CST 2023 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.", "<-------------------------------->", "Begin to check ps-publicservice", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status ps-publicservice", "70529", "server ps-publicservice is running.", "<-------------------------------->", "<-------------------------------->", "Begin to check cg-linkismanager", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status cg-linkismanager", "70584", "server cg-linkismanager is running.", "<-------------------------------->", "<-------------------------------->", "Begin to check cg-entrance", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status cg-entrance", "70685", "server cg-entrance is running.", "<-------------------------------->", "<-------------------------------->", "Begin to check cg-engineconnmanager", "Is local execution:sh /home/hadoop/linkis/sbin/linkis-daemon.sh status cg-engineconnmanager", "server cg-engineconnmanager is not running", "ERROR: your linkis-cg-engineconnmanager microservice is not start successful !!! ERROR logs as follows :", "Please check detail log, log path :/home/hadoop/linkis/logs/linkis-cg-engineconnmanager.log", "<---------------------------------------------------->", "Is remote execution:tail -n 50 /home/hadoop/linkis/logs/linkis-cg-engineconnmanager.log", "<---------------------------------------------------->", "Please check detail log, log path :/home/hadoop/linkis/logs/linkis-cg-engineconnmanager.log"]}

PLAY RECAP ********************************************************************************************************************************
dss-service : ok=102 changed=84 unreachable=0 failed=1 skipped=59 rescued=0 ignored=0

[root@dss-service dss-linkis-ansible]# rm -fr /home/hadoop/linkis
[root@dss-service dss-linkis-ansible]# ansible-playbook playbooks/linkis.yml

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.