RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x1024 and 768x320) about mlops

[Ambrosiussen]

Could you upload a .hip?

[akre54]

mlops controlnet error.zip

[Ambrosiussen]

What is your MLOPS_MODEL set to? For ControlNet it needs to be 1.5, eg: runwayml/stable-diffusion-v1-5

Check out the example file > controlnet! :)

[akre54]

Ah, I'm just going off of Mo's youtube video which showed it using $MLOPS_MODEL. I didn't change anything about the default models.

    MLOPS                                  C:/Users/adam.krebs/Houdini Packages/MLOPs-main
    MLOPS_MODEL                            C:/Users/adam.krebs/Houdini Packages/MLOPs-main/checkpoints/stabilityai-_-stable-diffusion-2-1
    MLOPS_MODELS                           C:/Users/adam.krebs/Houdini Packages/MLOPs-main/checkpoints

If I change the Unet Model, Scheduler Model and ControlNet model to runwayml/stable-diffusion-v1-5, I get:

OSError: Error no file named config.json found in directory C:/Users/adam.krebs/Houdini Packages/MLOPs-main/checkpoints/runwayml-_-stable-diffusion-v1-5.

Here's the directory listing:

C:\Users\adam.krebs\Houdini Packages\MLOPs-main\checkpoints\runwayml-_-stable-diffusion-v1-5>dir
 Volume in drive C is OS
 Volume Serial Number is ###

 Directory of C:\Users\adam.krebs\Houdini Packages\MLOPs-main\checkpoints\runwayml-_-stable-diffusion-v1-5

04/26/2023  01:14 PM    <DIR>          .
04/26/2023  01:14 PM    <DIR>          ..
04/26/2023  01:14 PM    <DIR>          feature_extractor
04/26/2023  01:14 PM               543 model_index.json
04/26/2023  01:14 PM    <DIR>          safety_checker
04/26/2023  01:14 PM    <DIR>          scheduler
04/26/2023  01:14 PM    <DIR>          text_encoder
04/26/2023  01:14 PM    <DIR>          tokenizer
04/26/2023  01:14 PM    <DIR>          unet
04/26/2023  01:14 PM    <DIR>          vae

[Ambrosiussen]

Is this still unresolved? If so please re-open.

[akre54]

I'm still seeing it, but I ended up just forking the example per your advice. Thanks