How do I use my own config.properties about sagemaker-huggingface-inference-toolkit

[aj2622]

I was trying to do something like this https://pytorch.org/serve/configuration.html. But I am realizing that hugging face images don't use torch server. 🤦 and that these options might not be available

[philschmid]

The Toolkit is based on MMS. To provide your own config.properties you have to derive the container. You can find the currently used config here: https://github.com/aws/deep-learning-containers/blob/master/huggingface/build_artifacts/inference/config.properties