OS: Ubuntu 18.04 unprivileged LXC container.
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.130 13925 flask_celery.py:72] Got lock, running.
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.133 13925 blacklist.py:68] Version max: 200
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.133 13925 blacklist.py:72] Trying version 1
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.135 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13909]: D0502 10:00:00.137 13909 beat.py:227] blacklist.tasks.blacklist.crawl_blacklist sent. id->58287994-ab6e-4d5d-9a41-11b05823c83b
May 2 10:00:00 czbl blacklist[13909]: D0502 10:00:00.137 13909 beat.py:561] beat: Waking up in 5.00 minutes.
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.210 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v1.pdf HTTP/1.1" 404 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.213 13925 blacklist.py:72] Trying version 2
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.216 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.292 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v2.pdf HTTP/1.1" 404 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.295 13925 blacklist.py:72] Trying version 3
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.297 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.373 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v3.pdf HTTP/1.1" 404 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.376 13925 blacklist.py:72] Trying version 4
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.378 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.446 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v4.pdf HTTP/1.1" 404 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.450 13925 blacklist.py:72] Trying version 5
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.452 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.535 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v5.pdf HTTP/1.1" 404 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.539 13925 blacklist.py:72] Trying version 6
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.541 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.609 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v6.pdf HTTP/1.1" 404 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.613 13925 blacklist.py:72] Trying version 7
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.615 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.699 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v7.pdf HTTP/1.1" 200 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.704 13925 blacklist.py:72] Trying version 8
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.707 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.770 13925 connectionpool.py:396] https://www.mfcr.cz:443 "HEAD /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v8.pdf HTTP/1.1" 404 0
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.774 13925 blacklist.py:83] Error thrown for version 8 and version 7 was previously found -> using version 7
May 2 10:00:00 czbl blacklist[13906]: I0502 10:00:00.775 13925 blacklist.py:92] Found PDF https://www.mfcr.cz/assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v7.pdf
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.778 13925 connectionpool.py:826] Starting new HTTPS connection (1): www.mfcr.cz
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.873 13925 connectionpool.py:396] https://www.mfcr.cz:443 "GET /assets/cs/media/Zverejnovane-udaje-ze-Seznamu-nepovolenych-internetovych-her_v7.pdf HTTP/1.1" 200 333773
May 2 10:00:00 czbl blacklist[13906]: D0502 10:00:00.903 13925 flask_celery.py:78] Releasing lock.
May 2 10:00:00 czbl blacklist[13906]: E0502 10:00:00.905 13925 trace.py:248] Task blacklist.tasks.blacklist.crawl_blacklist[58287994-ab6e-4d5d-9a41-11b05823c83b] raised unexpected: PermissionError(13, 'Permission denied')
May 2 10:00:00 czbl blacklist[13906]: Traceback (most recent call last):
May 2 10:00:00 czbl blacklist[13906]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 374, in trace_task
May 2 10:00:00 czbl blacklist[13906]: R = retval = fun(*args, **kwargs)
May 2 10:00:00 czbl blacklist[13906]: File "/usr/lib/python3/dist-packages/flask_celery.py", line 223, in __call__
May 2 10:00:00 czbl blacklist[13906]: return task_base.__call__(self, *_args, **_kwargs)
May 2 10:00:00 czbl blacklist[13906]: File "/usr/lib/python3/dist-packages/celery/app/trace.py", line 629, in __protected_call__
May 2 10:00:00 czbl blacklist[13906]: return self.run(*args, **kwargs)
May 2 10:00:00 czbl blacklist[13906]: File "/usr/lib/python3/dist-packages/flask_celery.py", line 267, in wrapped
May 2 10:00:00 czbl blacklist[13906]: ret_value = func(*args, **kwargs)
May 2 10:00:00 czbl blacklist[13906]: File "/usr/lib/python3/dist-packages/blacklist/tasks/blacklist.py", line 106, in crawl_blacklist
May 2 10:00:00 czbl blacklist[13906]: with open(file_path, 'wb') as f:
May 2 10:00:00 czbl blacklist[13906]: PermissionError: [Errno 13] Permission denied: '/usr/lib/python3/dist-packages/blacklist/static/pdf/ad58d3f193322030f2c5ec8226ab63c417956bdbc3fa75c92dda963bee42b27b.pdf'