Coder Social home page Coder Social logo

Comments (8)

lucidrains avatar lucidrains commented on August 22, 2024 1

@7Khalil sure! I mean, you just have to download all the images to a folder and run one command

from lightweight-gan.

lucidrains avatar lucidrains commented on August 22, 2024 1

@7Khalil the dataset size doesn't determine the amount of GPU memory used, it's the batch size and image resolution that are the determinants

from lightweight-gan.

ClashLuke avatar ClashLuke commented on August 22, 2024 1

pin_memory=True is set to True. This is a trick used to disable constant freeing and reallocating of memory by PyTorch, therefore improving the training speed by a bit. Usually, pinning the memory improves the speeds by something around 1% to 15%. If you're facing GPU memory issues, perhaps turning this flag off would be a good first step.

from lightweight-gan.

lucidrains avatar lucidrains commented on August 22, 2024

@7Khalil do you really think it needs a colab?

from lightweight-gan.

lil-km avatar lil-km commented on August 22, 2024

@lucidrains actualy i have tried it, and i got with a dataset of ~1300 images, i got GPU memory overflow. after reading your comment i the tried it with a smaller dataset with 500 images and it seems to work well.

from lightweight-gan.

lucidrains avatar lucidrains commented on August 22, 2024

@7Khalil ohh, what sized images did you try to train? you shouldn't overflow with anything below or at 512x512

from lightweight-gan.

lil-km avatar lil-km commented on August 22, 2024

@lucidrainsit seems weird, because both datasets that i used are 1024px resolution. wondering why ?!

from lightweight-gan.

lil-km avatar lil-km commented on August 22, 2024

Ok, @ClashLuke thanks.

from lightweight-gan.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.