Comments (7)
Hi @amirhmk!
The model extentions are hardcoded based on the framework type of the model in ClearML.
You have 2 options:
- Override the default filename as in the example here, you'll see the config override in the CLI commands
- Or you can manually specify the model framework when you upload it, set framework argument to 'onnx' and it should properly rename it!
EDIT: I just saw that your framework in clearml is properly set. That's weird and probably a bug on our end. Please check if the first fix works for you, we'll investigate the second :)
Hope this helps! :)
from clearml-serving.
Hi @thepycoder, option 1 worked, thanks! Adding default_model_filename: "model.bin"
to config.pbtxt
and passing it as a file was fine. Though regarding your second point, did onnx models use to have the .bin
extention that this is setup like this?
Also as a small aside, I found out that if one passes a file (path) for --aux-config
, it'll completely copy paste the passed in config file, and still add the input/output shapes/types/names to the bottom of the final config file - resulting in errors. I thought it would make sense to only pass the config file, and not have to even pass all the shapes one-by-one in the command. Wdyt?
from clearml-serving.
option 1 worked, thanks!
Excellent!
Though regarding your second point, did onnx models use to have the .bin extention that this is setup like this?
Possibly yes, this might be a remnant of earlier ONNX days, I'll have to check.
I thought it would make sense to only pass the config file, and not have to even pass all the shapes one-by-one in the command. Wdyt?
Yeah, I think that makes sense, I'll discuss it with the devs :) Thanks a lot for the suggestion!
from clearml-serving.
I thought it would make sense to only pass the config file, and not have to even pass all the shapes one-by-one in the command. Wdyt?
@amirhmk Aren't these already optional CLI parameters? i.e. you don't have to specify them if their already specified in the config file.
from clearml-serving.
@ainoam so most of those are, but the input(or output) shapes/types are mandatory.
from clearml-serving.
@amirhmk Can you give an example of your CLI invocation, and mark which parameters seem to be unnecessarily mandatory (i.e. also specified in your aux file)
from clearml-serving.
from clearml-serving.
Related Issues (20)
- Configure options for gRPC (Triton server) HOT 3
- String not supported for Triotn HOT 1
- Error: Failed loading preprocess code for '<>': No module named 'transformers' HOT 1
- Where to find logging for preprocessing Custom model HOT 2
- triton model breaks serving instance HOT 4
- ValueError: dictionary update sequence element #0 has length <>; 2 is required HOT 2
- Error during creation endpoints with config.pbtxt HOT 4
- Docker image not up-to-date HOT 1
- torchserve support? HOT 2
- serving stuck because of deleted model
- Incorrect requests version specifier in requirements.txt HOT 3
- Shared functions across preprocess file HOT 2
- Removing model monitoring in endpoint HOT 1
- Multiple TensorRT handling(plan file per gpu)
- Could not download model in triton container HOT 1
- [Bug] Run clearml serving with clearml server not working HOT 2
- Can not run Toy model (scikit learn) deployment example
- [clearml-serving] Specification of model platform not possible HOT 3
- Deploy YOLOv8 Segmentation model
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clearml-serving.