Out of Memory during evaluation about deeplab2

[aquariusjay]

Hi davidblom603,

Based on your provided config, you have set min_resize_value = max_resize_value = 641 and thus the input will be resized to the longest side = 641 on the fly. This resized input will be fed to the network during both training and evaluation. However, one thing to note is that during evaluation, we will further resize the prediction to have the same size as the original groundtruth label (see this line), which makes sure the predictions are evaluated w.r.t. the intact and original groundtruth label.

If your dataset is really large that we could not even fit one image on a GPU during evaluation, maybe you could try to resize them to a smaller size and create a new dataset.

Cheers,

[davidblom603]

Hi @aquariusjay ,

Thanks for your response. Indeed, the issue is that one image cannot fit on a GPU during evaluation due to a very high resolution. What does work is using a high memory CPU node.
Thanks for your help!

Cheers