Coder Social home page Coder Social logo

Comments (6)

justanhduc avatar justanhduc commented on May 27, 2024 1

Hi @yqtianust. Just FYI, this issue has been fixed following the latest release. There will only be a short delay (30s by default) between two immediately queued GPU jobs.

from task-spooler.

yqtianust avatar yqtianust commented on May 27, 2024

Well it works. Just need to wait for a relative longer time for allocating etc.

Thanks for the tool.

It will be good if we can use floating number for option G. I want to make my GPU can always occupied by two jobs.

from task-spooler.

justanhduc avatar justanhduc commented on May 27, 2024

Hi @yqtianust. Thanks for reaching out. I just wanna elaborate a bit more about your experiences.
First, the slow allocation will happen when jobs are queued too fast (for e.g., when jobs are queued with a script) and no matter how many GPUs you use. And as you noticed, the jobs will be executed nevertheless, but the waiting time is quite long sometimes. One way to avoid this is give it some time between each job queue.

should I use the -S option before any other command?

No you don't have to. You can use -S when you start Task Spooler for the first time (for e.g., when you first boot your pc or after you use -K). Or in case you have to share the server with other people, you can set the number of slots to be smaller than the number of GPUs. It's totally up to your use cases.

It will be good if we can use floating number for option G. I want to make my GPU can always occupied by two jobs.

The GPU support is inspired by SLURM and by default, SLURM does not support multiple jobs per GPU (https://slurm.schedmd.com/gres.html). But I understand sometimes there are powerful GPUs and one job uses only a fraction of their memory/usage. One quick fix might be adding a flag to choose GPUs manually. I will look into it in a future version.

from task-spooler.

yqtianust avatar yqtianust commented on May 27, 2024

Thanks for the elaboration.

from task-spooler.

justanhduc avatar justanhduc commented on May 27, 2024

Well it works. Just need to wait for a relative longer time for allocating etc.

Thanks for the tool.

It will be good if we can use floating number for option G. I want to make my GPU can always occupied by two jobs.

And you can use -g to pass directly GPU IDs as well.

from task-spooler.

yqtianust avatar yqtianust commented on May 27, 2024

Thanks! I will have a try!

from task-spooler.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.