ValueError while finetuning about lightning-flash

[kaushikb11]

Hi @Zumbalamambo, this is because you are freezing the backbone (resnet18 here), hence the optimizer receives an empty parameter list while finetuning. A couple of points to note, the default epoch at which it unfreezes in the freeze_unfreeze strategy is 10. Also, you could add a head to your ImageEmbedder Model by

embedder = ImageEmbedder(backbone="resnet18", embedding_dim=1024)

[Zumbalamambo]

@kaushikb11 thank you! Is it possible to increase the input size of the ImageEmbedder ?

[kaushikb11]

@Zumbalamambo What do you mean by input size of the ImageEmbedder? If you mean the Input size of the images, we have default preprocessing transforms in place to resize your input image data :)

[Zumbalamambo]

@kaushikb11 thank you! I have one another doubt, how do you determine the value of embedding_dim? I used vgg16 and selected an embedding_size of 4096 but then it threw the following error ,

RuntimeError: mat1 and mat2 shapes cannot be multiplied (4x512 and 4096x4096)

[kaushikb11]

Hi @Zumbalamambo, I have patched a fix in PR #154. Thanks!

[Zumbalamambo]

@kaushikb11 thank you! :) May I know how I can apply the latest fix? I have installed lightning-flash using pip

[kaushikb11]

Hi @Zumbalamambo, follow the below commands :)

git clone https://github.com/PyTorchLightning/lightning-flash.git
cd lightning-flash
# install in editable mode
pip install -e .