Seed option feature request and a question about onnx with custom sd model + lora about onnxstream

[vitoplantamura]

hi, 1) yes, I will add the ability to specify the seed in the next few days! 2) yes the procedure is correct and the resulting ONNX should contain all LoRAs in an "immutable" format. The problem is that this ONNX contains Einsum operations, which are not yet supported by OnnxStream. Everything is explained better in this PR: #36 3) yes, I will try to make it easier in the future :-) 4) asking the user to build OnnxStream on his hardware, allows you to use the MAX_SPEED setting. However I will try to make the build easier! Thanks, Vito

[elliot-sawyer]

Can either of you provide an example on how to run the onnx2txt.ipynb script to convert a safetensors model to an onnx format suitable for a Pi4? I've been following along with the dreamshaper_8 model and while it does process to a dreamshaper_8.onnx file and a bunch of bias's and weights in a folder, it won't run on the pi because it's missing tokenizer/vocab.txt. onnx2txt seems to be the missing link there, but I'm not sure how to use the ipynb file to process it. Thanks!

[noah003]

@coldeny Hello, have you successfully converted the "sd model + lora" to onnxstream model?

[noah003]

@coldeny Hello, have you successfully converted the "sd model + lora" to onnxstream model?

@vitoplantamura will it support lora?

[vitoplantamura]

hi, following the guide in the main README, calling the "load_lora_weights" method on the "pipe" object before converting to Onnx, should allow you to produce an OnnxStream model with one or more LoRAs embedded. Vito

[noah003]

hi, following the guide in the main README, calling the "load_lora_weights" method on the "pipe" object before converting to Onnx, should allow you to produce an OnnxStream model with one or more LoRAs embedded. Vito

Thanks vito~