Poll failed for model directory 'diabetes_model': Invalid model name: Could not determine backend for model 'diabetes_model' with no backend in model configuration. Expected model name of the form 'model.<backend_name>' about server

[Manishthakur2503]

I tried to print basic information about the model using : print(onnx.helper.printable_graph(onnx_model.graph)) and got this :graph model-onnx (
%float_input[FLOAT, ?x8]
) {
%label, %probabilities = LinearClassifierclasslabels_ints = [0, 1], coefficients = [-1.15231204032898, -3.61196088790894, 0.323476761579514, -0.234493508934975, -0.0497973449528217, -2.38965225219727, -1.12923967838287, -0.840260863304138, 1.15231204032898, 3.61196088790894, -0.323476761579514, 0.234493508934975, 0.0497973449528217, 2.38965225219727, 1.12923967838287, 0.840260863304138], intercepts = [4.81376791000366, -4.81376791000366], multi_class = 0, post_transform = 'LOGISTIC'
%output_label = Castto = 7
%output_probability = ZipMapclasslabels_int64s = [0, 1]
return %output_label, %output_probability
}.

So is there anything I am missing in the config file?

[indrajit96]

Hello @Manishthakur2503 thanks for reaching out, this looks like a model repository error.
Is your model repository accessible inside the container?
Is the structure of your model repository?

/
/
config.pbtxt
/
model.onnx

Before you do
docker run --rm --name tritonserver -p 8000:8000 -p 8001:8001 -p 8002:8002 -v /mnt/host/c/Projects/ML/NvidiaTriton/model_repository:/models nvcr.io/nvidia/tritonserver:23.01-py3 tritonserver --model-repository=/models

Can you check if /models is as expected in the container?

Look at this tutorial https://github.com/triton-inference-server/server/blob/main/docs/getting_started/quickstart.md
This too load a onnx model the way you are trying to.

Thanks,
Indrajit

[Manishthakur2503]

Hi @indrajit96

Thanks for your response.

I checked the model repository structure, and it was correct. However, the issue was with the input dimensions in the config file, which was causing the error. I have fixed it now, and everything is working fine.

Thanks,
Manish Thakur