[clearml-serving] Specification of model platform not possible about clearml-serving

[jkhenning]

Hi @ockaro,

Can you please verify there is a clearml triton pod running?
Also, how did you register the model? What was the clearml-serving command you used?

Side note - can you please move the issue to clearml-serving repo? This seems not to be related to the helm chart, but to the serving itself.

[ockaro]

Hi @jkhenning ,
thanks for moving the issue! Btw I never had an issue registering a model using clearml pro together with the docker container setup. I wasn't even required to name the model 'model.<backend_name>' which is the case with the k8s setup, because I get this error in the triton pod if I don't
Invalid model name: Could not determine backend for model 'advanced_basic_classifier' with no backend in model configuration. Expected model name of the form 'model.<backend_name>'.

The triton pod is up and running. The mentioned error message occurs within the triton pod.

I tried these two commands in order to register the model
clearml-serving --id ad16b8ae3e2840c1b1b6eb94bbcf78f4 model add --engine triton --endpoint "advanced_basic_classifier.pytorch" --preprocess "src/preprocessing/preprocess.py" --model-id 837276fc8d8a443fb91f48d722300b0a --input-size 1 64 --input-name "INPUT__0" --input-type float32 --output-size 1 11 --output-name "OUTPUT__0" --output-type float32 --aux-config platform=pytorch_libtorch

clearml-serving --id ad16b8ae3e2840c1b1b6eb94bbcf78f4 model add --engine triton --endpoint "advanced_basic_classifier.pytorch" --preprocess "src/preprocessing/preprocess.py" --model-id 837276fc8d8a443fb91f48d722300b0a --aux-config .\config.pbtxt

where the config.pbtxt looks like this

  backend: "pytorch"
  platform: "pytorch_libtorch"
  input [
    {
      name: "INPUT__0"
      data_type: TYPE_FP32
      dims: [1, 64]
    }
  ]
  output [
    {
      name: "OUTPUT__0"
      data_type: TYPE_FP32
      dims: [1, 11]
    }
  ]

[ockaro]

Hi @jkhenning, are there any news on this issue? :)