log as follows:
[INFO][2021-11-03 10:37:40.451][simple_graph_partitioner.cc:108] total partition(s) of graph[torch-jit-export]: 1.
[INFO][2021-11-03 10:37:40.456][opt_graph.cc:206] Create 206 TensorImpl
[INFO][2021-11-03 10:37:40.458][opt_graph.cc:317] added 171 new bridge kernels
[INFO][2021-11-03 10:37:40.483][algo_conv_hmma.cc:116] Compiling Conv_0
[INFO][2021-11-03 10:37:45.786][algo_conv_hmma.cc:116] Compiling Conv_4
[INFO][2021-11-03 10:37:56.366][algo_conv_hmma.cc:116] Compiling Conv_5
[INFO][2021-11-03 10:38:04.654][algo_conv_hmma.cc:116] Compiling Conv_9
[INFO][2021-11-03 10:38:11.969][algo_conv_hmma.cc:116] Compiling Conv_9
[INFO][2021-11-03 10:38:11.979][algo_conv_hmma.cc:116] Compiling Conv_10
[INFO][2021-11-03 10:38:19.334][algo_conv_hmma.cc:116] Compiling Conv_14
[INFO][2021-11-03 10:38:22.449][algo_conv_hmma.cc:116] Compiling Conv_14
[INFO][2021-11-03 10:38:22.458][algo_conv_hmma.cc:116] Compiling Conv_16
[INFO][2021-11-03 10:38:22.462][algo_conv_hmma.cc:116] Compiling Conv_20
[INFO][2021-11-03 10:38:22.471][algo_conv_hmma.cc:116] Compiling Conv_22
[INFO][2021-11-03 10:38:22.473][algo_conv_hmma.cc:116] Compiling Conv_26
[INFO][2021-11-03 10:38:25.715][algo_conv_hmma.cc:116] Compiling Conv_26
[INFO][2021-11-03 10:38:25.719][algo_conv_hmma.cc:116] Compiling Conv_27
[INFO][2021-11-03 10:38:32.929][algo_conv_hmma.cc:116] Compiling Conv_31
[INFO][2021-11-03 10:38:36.166][algo_conv_hmma.cc:116] Compiling Conv_31
[INFO][2021-11-03 10:38:36.169][algo_conv_hmma.cc:116] Compiling Conv_33
[INFO][2021-11-03 10:38:36.171][algo_conv_hmma.cc:116] Compiling Conv_37
[INFO][2021-11-03 10:38:36.178][algo_conv_hmma.cc:116] Compiling Conv_39
[INFO][2021-11-03 10:38:43.604][algo_conv_hmma.cc:116] Compiling Conv_43
[INFO][2021-11-03 10:38:45.240][algo_conv_hmma.cc:116] Compiling Conv_43
[INFO][2021-11-03 10:38:45.243][algo_conv_hmma.cc:116] Compiling Conv_44
[INFO][2021-11-03 10:38:46.794][algo_conv_hmma.cc:116] Compiling Conv_48
[INFO][2021-11-03 10:38:48.354][algo_conv_hmma.cc:116] Compiling Conv_48
[INFO][2021-11-03 10:38:48.357][algo_conv_hmma.cc:116] Compiling Conv_50
[INFO][2021-11-03 10:38:48.358][algo_conv_hmma.cc:116] Compiling Conv_54
[INFO][2021-11-03 10:38:48.361][algo_conv_hmma.cc:116] Compiling Conv_56
[INFO][2021-11-03 10:38:48.362][algo_conv_hmma.cc:116] Compiling Conv_60
[INFO][2021-11-03 10:38:50.086][algo_conv_hmma.cc:116] Compiling Conv_60
[INFO][2021-11-03 10:38:50.090][algo_conv_hmma.cc:116] Compiling Conv_61
[INFO][2021-11-03 10:38:51.999][algo_conv_hmma.cc:116] Compiling Conv_65
[INFO][2021-11-03 10:38:54.211][algo_conv_hmma.cc:116] Compiling Conv_67
[INFO][2021-11-03 10:38:54.212][algo_conv_hmma.cc:116] Compiling Conv_71
[INFO][2021-11-03 10:38:57.143][algo_conv_hmma.cc:116] Compiling Conv_71
[INFO][2021-11-03 10:38:57.145][algo_conv_hmma.cc:116] Compiling Conv_72
[INFO][2021-11-03 10:38:59.957][algo_conv_hmma.cc:116] Compiling Conv_76
[INFO][2021-11-03 10:39:02.925][algo_conv_hmma.cc:116] Compiling Conv_76
[INFO][2021-11-03 10:39:02.927][algo_conv_hmma.cc:116] Compiling Conv_78
[INFO][2021-11-03 10:39:02.929][algo_conv_hmma.cc:116] Compiling Conv_82
[INFO][2021-11-03 10:39:02.929][algo_conv_hmma.cc:116] Compiling Conv_82
[INFO][2021-11-03 10:39:02.931][algo_conv_hmma.cc:116] Compiling Conv_84
[INFO][2021-11-03 10:39:02.933][algo_conv_hmma.cc:116] Compiling Conv_88
[INFO][2021-11-03 10:39:02.934][algo_conv_hmma.cc:116] Compiling Conv_90
[INFO][2021-11-03 10:39:02.936][algo_conv_hmma.cc:116] Compiling Conv_94
[INFO][2021-11-03 10:39:05.646][algo_conv_hmma.cc:116] Compiling Conv_95
[INFO][2021-11-03 10:39:08.061][algo_gemm.cc:113] Compiling Gemm_98
[INFO][2021-11-03 10:39:09.090][opt_graph.cc:592] deleted 167 bridge kernels
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 215] engine config as follows:
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 216] forward type : 0
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 217] mem mode : 0
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 227] input[0]: input
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 237] dim(s): 1 3 224 224
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 238] DataType: FLOAT32
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 239] DataFormat: NDARRAY
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 240] BytesIncludePadding: 602112
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 241] BytesExcludePadding: 602112
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 247] output[0]: probs
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 257] dim(s): 0 1000
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 258] DataType: FLOAT32
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 259] DataFormat: NDARRAY
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 260] BytesIncludePadding: 0
[2021-11-03 10:39:17.023 +08:00] [infer-engine-log] [---I---] [thread 30647] [openppl_engine.cpp printModelInfo 261] BytesExcludePadding: 0
[2021-11-03 10:39:17.024 +08:00] [infer-engine-log] [---I---] [thread 30647] [base_model.cpp loadModel 88] model /disk26b/zhaojd/github_codes/infer_engine_serving/models//test_openppl/1/model.bin loaded success success.
[2021-11-03 10:39:17.034 +08:00] [infer-engine-log] [---I---] [thread 30647] [prometheus_metrics.cpp init 31] prometheus binding address is 0.0.0.0:10098
[2021-11-03 10:39:17.036 +08:00] [infer-engine-log] [---I---] [thread 30647] [server_manager.cpp ServerManager 26] add resource monitor timer task to worker group success.
[2021-11-03 10:39:17.036 +08:00] [infer-engine-log] [---I---] [thread 30647] [server_manager.cpp ServerManager 36] add model update timer task to worker group success
start service....
[2021-11-03 10:39:17.037 +08:00] [infer-engine-log] [---I---] [thread 30647] [infer_engine_server.cpp start 29] http service binding to port 10099
[2021-11-03 10:39:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:39:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:39:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:39:57.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:40:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:40:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:40:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:40:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:40:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:40:57.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:41:07.040 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:41:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:41:27.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:41:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:41:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:41:57.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:42:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:42:17.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:42:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:42:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:42:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:42:57.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:43:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:43:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:43:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:43:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:43:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:43:57.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:44:07.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:44:17.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:44:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:44:37.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:44:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:44:57.040 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:45:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:45:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:45:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:45:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:45:47.041 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:45:57.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:46:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:46:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:46:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:46:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:46:47.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:46:57.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:47:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:47:17.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:47:27.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:47:37.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:47:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:47:57.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:48:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:48:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:48:27.044 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:48:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:48:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:48:57.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:49:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:49:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:49:27.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:49:37.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:49:47.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:49:57.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:50:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:50:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:50:27.039 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:50:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:50:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:50:57.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:51:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:51:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:51:27.040 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:51:37.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:51:47.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:51:57.044 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:52:07.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:52:17.038 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:52:19.931 +08:00] [infer-engine-log] [---I---] [thread 32922] [http_service.cpp operator() 143] 7505367914-->Enter modelInferHandler
[2021-11-03 10:52:19.938 +08:00] [infer-engine-log] [---I---] [thread 32922] [task_info.cpp printTaskInfo 69] task 7505367914 info as follows:
[2021-11-03 10:52:19.938 +08:00] [infer-engine-log] [---I---] [thread 32922] [task_info.cpp printTaskInfo 70] task_type : model_infer
[2021-11-03 10:52:19.938 +08:00] [infer-engine-log] [---I---] [thread 32922] [task_info.cpp printTaskInfo 71] model_name : test_openppl
[2021-11-03 10:52:19.938 +08:00] [infer-engine-log] [---I---] [thread 32922] [task_info.cpp printTaskInfo 72] model_version: 1
[2021-11-03 10:52:19.938 +08:00] [infer-engine-log] [---I---] [thread 32922] [task_info.cpp printTaskInfo 73] model_action :
[2021-11-03 10:52:19.938 +08:00] [infer-engine-log] [---I---] [thread 32922] [task_info.cpp printTaskInfo 79] image shape : 224x224x3
[2021-11-03 10:52:19.938 +08:00] [infer-engine-log] [---I---] [thread 32922] [http_service.cpp execTask 116] 7505367914-->execute model_infer task
[2021-11-03 10:52:19.939 +08:00] [infer-engine-log] [---I---] [thread 32909] [model_manager.cpp processModelInferTask 227] 7505367914-->Exec process_model_infer_task
[2021-11-03 10:52:27.316 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:52:37.312 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:52:47.547 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:53:06.856 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:53:10.127 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:53:22.376 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:53:27.620 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:53:39.003 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:53:49.611 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:54:21.842 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:54:22.715 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:54:23.831 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
[2021-11-03 10:54:35.932 +08:00] [infer-engine-log] [---I---] [thread 32918] [metrics.cpp resourceMonitorTimerTask 26] monitor task timeout, begin to update ...
error: cuModuleLoadDataEx(&module_, source_code_.second.c_str(), 0, 0, 0) failed with error CUDA_ERROR_INVALID_IMAGE
terminate called after throwing an instance of 'std::system_error'
what(): Resource deadlock avoided