CUDA out of memory about autodistill-seggpt

[nguyenthekhoig7]

I faced the same issue when running with just a extremely small dataset (7 images only), and it could not run on my decent 4GB vRAM GPU(I load the GroundedSAM model not SegGPT, but they all inherit from DetectionBaseModel, so same issue).

I read the code and seems that the way it works is that the code process all images into the RAM(in GPU in this case) at the same time to create a dataset, then the dataset will be saved, this exploded the memory.

If what I found was true, I'm gonna proceed to see if there is a way to process images in a serial way (or, in batches), in order to optimize memory usage for small GPU.

I appreciate any opinion and suggestion!

[adbcode]

Facing similar issues with much lower GPU resources (1x NVIDIA L4).

I have much more labeled data (in 100s) and would like to use them all.

Any way to limit the VRAM usage?