AutoscaledPool cannot grow anymore about crawlee

[mtrunkat]

Thank you for reporting. We will investigate the issue and fix it shortly.

[mtrunkat]

Ad second issue: This is because Autoscaled pool is configured to finish when there is no task in progress and workerFunction returns null. We will add configuration parameter to leave pool running in this case and new method to finish it manually.

Ad first issue: I did some tests and it seems to be working correctly. It looks for spare capacity and tries to run new worker functions everytime some of the function gets finished. And also there is interval every 1s that looks for spare capacity and possible starts new worker functions.

In your example you are adding new task every 900ms and tasks takes 1000s so there should be about 1 task running the most of the time.

[gsouf]

Thanks for the details.

For the first issue I now understand the reason. Would be worth to be mentioned in the docs!

[mtrunkat]

Definitely! Ill update the docs. po 19. 3. 2018 v 17:40 odesílatel Soufiane Ghzal <[email protected]> napsal:

…

Thanks for the details. For the first issue I now understand the reason. Would be worth to be mentioned in the docs! — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#39 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAkTcUyKaR8Fn3vWoBsxEX7sjpcMec_Qks5tf9-XgaJpZM4SuAux> .