dkormalev / asynqro Goto Github PK

In some cases it is beneficial to group few subpools together so they would each be restricted by their own limits and also will be restricted together.
For example, we have 500 subpools of 2 concurrent jobs each. We don't want to run more than 10 jobs across all subpools. Grouping all 500 of them and setting the limit to 10 would help in this case. Alternative way is to make subpools a tree (need to be checked if will not add too much extra work for cases when it is not needed).

Hi @dkormalev, I've just seen your great talk, and I'm having trouble identifying which "threadpoolcpp" library you mention -- a google search yields more viable repositories than I'd expect. Could you please update all the occurrences of "threadpoolcpp" in your README.md with a proper link to its original source repository? The other libs are well-known enough so that I know exactly which ones you talk about (e.g. in case of boost, TBB, Qt, or folly). Thanks.

How does this compare with Intel TBB? It might worthwhile to compare in your benchmark?

Hi,

I am trying to parallelize a library with a synchronous interface, preserving backwards compatibility. Even if the interface doesn't use Futures, I could still do something like this:

Frame Clip::getFrame() {
    Frame frame = /* */;
    if (task_not_ran)
        frame.plane = queue_task();
    return frame;
}

Plane Frame::getPlane() {
    while (!plane.isCompleted()) {
        wait_first_of(plane, tasks_pending);
        if (!plane.isCompleted())
            run_pending_task();
        else
            break;
    }
    return plane.result();
}

The idea is: since the current task has to wait for a result but cannot be evicted from the thread, it can run pending tasks recursively until the result is ready.

This is obviously worse than having a fully asynchronous interface, but could make it possible to parallelize already existing code and binaries.

Is such a thing possible?

Thanks.

Hi,

this library looks absolutely perfect, just I don't see much examples (mainly for task scheduler) and installation instructions.

Is making of more examples planned in near time?

Thanks

• gamiee