"CUDA out of memory" for large video file about all-in-one-deflicker

[ChenyangLEI]

Hi,

The preprocess optical flow cannot support high-resolutin images : (

We will try to find a more efficient preprocessing optical flow estimation model.

Another way is to use the CPU instead of GPU to compute the flow but it would be quite slow.

[enn-nafnlaus]

Same problem here. I didn't expect that 24GB of VRAM would be a "not enough memory" situation here to process a 1920x1080 (a common video resolution) file. :(

ED: Looks like I can run at it at 75% of its size (1440x810). Will see how it looks after deflicker + AI upscale.

As for how to "find a more efficient preprocessing optical flow estimation model", have you tried a smaller bit quantization? For most graphics apps, in my experience, there's basically no difference between 16 and 32 bit quantization, and acceptable quality loss with 8 bit (for LLMs you can go a lot lower still, but I'd be surprised if you could get away with less than 8 bit here)

ED2: Oh hey, looks like I can just barely pull off 1920x1080 if I unload StableDiffusion and free up that last couple gigs of VRAM. Yeay! TL/DR: if you want 1920x1080, you really need a full 24GB.

[m0o0scar]

Hi @SlimeVRX , you're welcome, the notebook is still pretty rough now with no documentations or comments what so ever. I'll see if I can make it easier to use :)

[SlimeVRX]

Thank you for implementing Colab, I also want to try it now!

[FurkanGozukara]

Hi,

The preprocess optical flow cannot support high-resolutin images : (

We will try to find a more efficient preprocessing optical flow estimation model.

Another way is to use the CPU instead of GPU to compute the flow but it would be quite slow.

hi. so we cant use 1024x1024 on this?

what is the maximum supported resolution?

I am working on a video to animation tutorial and i plan to use your script to improve flickering

how much vram would be necessary for 1024x1024?