Optimize, convert and deploy machine learning models as fast inference API using Triton and ORT. Currently support Hugging Face transformers, PyToch, Tensorflow, SKLearn and XGBoost models.
have done some tests and is possible in two ways: ensembles and custom python calls. The fist one works just for simple cases and the python calls works in any case, however are time consuming to develop!