Comments (6)
Hi @yqtianust. Just FYI, this issue has been fixed following the latest release. There will only be a short delay (30s by default) between two immediately queued GPU jobs.
from task-spooler.
Well it works. Just need to wait for a relative longer time for allocating etc.
Thanks for the tool.
It will be good if we can use floating number for option G. I want to make my GPU can always occupied by two jobs.
from task-spooler.
Hi @yqtianust. Thanks for reaching out. I just wanna elaborate a bit more about your experiences.
First, the slow allocation will happen when jobs are queued too fast (for e.g., when jobs are queued with a script) and no matter how many GPUs you use. And as you noticed, the jobs will be executed nevertheless, but the waiting time is quite long sometimes. One way to avoid this is give it some time between each job queue.
should I use the -S option before any other command?
No you don't have to. You can use -S
when you start Task Spooler for the first time (for e.g., when you first boot your pc or after you use -K
). Or in case you have to share the server with other people, you can set the number of slots to be smaller than the number of GPUs. It's totally up to your use cases.
It will be good if we can use floating number for option G. I want to make my GPU can always occupied by two jobs.
The GPU support is inspired by SLURM and by default, SLURM does not support multiple jobs per GPU (https://slurm.schedmd.com/gres.html). But I understand sometimes there are powerful GPUs and one job uses only a fraction of their memory/usage. One quick fix might be adding a flag to choose GPUs manually. I will look into it in a future version.
from task-spooler.
Thanks for the elaboration.
from task-spooler.
Well it works. Just need to wait for a relative longer time for allocating etc.
Thanks for the tool.
It will be good if we can use floating number for option G. I want to make my GPU can always occupied by two jobs.
And you can use -g
to pass directly GPU IDs as well.
from task-spooler.
Thanks! I will have a try!
from task-spooler.
Related Issues (20)
- Advice on how to cancel (kill or remove) task HOT 5
- Prompt to uninstall the apt installation of tsp before running ts in README HOT 1
- install breaks without CUDA HOT 1
- Bug: cannot add a very long command to queue HOT 14
- Structured output HOT 2
- Please edit the README HOT 2
- make cpu giving error: implicitly declaring library function 'snprintf' with type 'int HOT 2
- Evaluate $(...) in commands at run not at enqueue HOT 2
- Separate logging and queueing? HOT 3
- Using `-n` `-f` flags: pass through SIGINT (and other signals?) HOT 1
- ts -F stochastically crashes the server HOT 3
- Contributors HOT 7
- GUI addon link point to 404 HOT 3
- asynchronous launch HOT 6
- Timeout HOT 3
- json format for listing jobs HOT 1
- Unable to redirect output from command line HOT 2
- Enhancement request: support for priorities HOT 2
- Enhancement request: ability to postpone jobs HOT 2
- Enhancement request: bigger queue size HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from task-spooler.