[CRITICAL] WORKER TIMEOUT errors in stderr (via Stackdriver) about data-science-on-gcp

[Canas]

This behavior is caused by gunicorn not by Google. Gunicorn has a 30 second default limit that can be overrided by setting the --timeout argument in app.yaml.

Example with 120 seconds timeout:

gunicorn -b :$PORT ingestapp:app --timeout 120

I was having the same issue with worker timeout error until I did this. Hope it helps!

[pdoggi]

@Canas Thank you so much! You're a lifesaver.

[lakshmanok]

Looks like the server was being slow ... if the time to download the file exceeds 10 minutes, it causes deadline exceeded errors in app-engine:

https://cloud.google.com/appengine/articles/deadlineexceedederrors

If you run into this problem in your real-world application, you have a couple of alternatives:
(1) change your architecture to use Cloud Functions. Put all the ingest code in a Cloud Function and launch it off in response to the Cron.
(2) reduce the size of the file being downloaded by increasing the frequency of download. For example, instead of downloading monthly files once a month, download weekly files once a week.

[lakshmanok]

Thanks! Do you want to issue a pull request with the above change (so that you get the attribution), or do you want to me to simply make the change?

…

On Fri, Oct 26, 2018, 7:06 AM Cristobal Silva ***@***.***> wrote: This behavior is caused by gunicorn not by Google. Gunicorn has a 30 second default limit that can be overrided by setting the --timeout argument in app.yaml. Example with 120 seconds timeout: gunicorn -b :$PORT ingestapp:app --timeout 120 I was having the same issue with worker timeout error until I did this. Hope it helps! — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#9 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABqX5yHu2GijJJ_G88v3wijTqA8mpRwnks5uoxbLgaJpZM4SNFkm> .

[Canas]

Just did the pull request with the same timeout parameter as my previous post :)

[lakshmanok]

thanks, Canas. i don't see any pull request though

[Canas]

Sorry I was having issues with Google CLA, now it should be ready. Thanks!

[lakshmanok]

Fixed by Canas in #30