The docker-dev build is often failing
The docker-dev build is regularly failing for no real reason.
2 problems are identifed:
- timeouts during directory_ls:
09:56:25 swh-web_1 | [06/Dec/2021 08:56:20] [DEBUG] Traceback (most recent call last):
09:56:25 swh-web_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", line 445, in _make_request
09:56:25 swh-web_1 | six.raise_from(e, None)
09:56:25 swh-web_1 | File "<string>", line 3, in raise_from
09:56:25 swh-web_1 | 172.19.0.6 - - [06/Dec/2021:08:56:20 +0000] "GET /api/1/directory/846f39f7fddd09c3c1ad2c7c9d3149b4fa055ff1/ HTTP/1.0" 500 4996 "-" "curl/7.64.0"
09:56:25 swh-web_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/urllib3/connectionpool.py", line 440, in _make_request
09:56:25 swh-web_1 | httplib_response = conn.getresponse()
09:56:25 swh-web_1 | File "/usr/local/lib/python3.7/http/client.py", line 1373, in getresponse
09:56:25 swh-web_1 | response.begin()
09:56:25 swh-web_1 | File "/usr/local/lib/python3.7/http/client.py", line 319, in begin
09:56:25 swh-web_1 | version, status, reason = self._read_status()
09:56:25 swh-web_1 | File "/usr/local/lib/python3.7/http/client.py", line 280, in _read_status
09:56:25 swh-web_1 | line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
09:56:25 swh-web_1 | File "/usr/local/lib/python3.7/socket.py", line 589, in readinto
09:56:25 swh-web_1 | return self._sock.recv_into(b)
09:56:25 swh-web_1 | socket.timeout: timed out- concurrency issue between the
swh-webandswh-web-cronstartup, probably not blocker
09:53:18 swh-web-cron_1 | Start periodic save code now refresh statuses routine (in background)
09:53:18 swh-web-cron_1 | Mon Dec 6 08:52:56 UTC 2021
09:53:18 swh-web-cron_1 | [06/Dec/2021 08:52:58] [DEBUG] urllib3.connectionpool._new_conn:231 - Starting new HTTP connection (1): swh-scheduler:5008
09:53:18 swh-web-cron_1 | [06/Dec/2021 08:52:58] [DEBUG] urllib3.connectionpool._make_request:461 - http://swh-scheduler:5008 "POST /task_type/get_all HTTP/1.1" 200 5640
09:53:18 swh-web-cron_1 | Traceback (most recent call last):
09:53:18 swh-web-cron_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute
09:53:18 swh-web-cron_1 | return self.cursor.execute(sql, params)
09:53:18 swh-web-cron_1 | psycopg2.errors.UndefinedColumn: column save_origin_request.visit_status does not exist
09:53:18 swh-web-cron_1 | LINE 1: ...ND ("save_origin_request"."visit_date" IS NULL OR "save_orig...
09:53:18 swh-web-cron_1 | ^
09:53:18 swh-web-cron_1 | The above exception was the direct cause of the following exception:
09:53:18 swh-web-cron_1 | Traceback (most recent call last):
09:53:18 swh-web-cron_1 | File "/srv/softwareheritage/venv/bin/django-admin", line 8, in <module>
09:53:18 swh-web-cron_1 | sys.exit(execute_from_command_line())
09:53:18 swh-web-cron_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
09:53:18 swh-web-cron_1 | utility.execute()
09:53:18 swh-web-cron_1 | File "/srv/softwareheritage/venv/lib/python3.7/site-packages/django/core/management/__init__.py", line 375, in execute
09:53:18 swh-web-cron_1 | self.fetch_command(subcommand).run_from_argv(self.argv)
...
09:53:18 swh-web_1 | starting the swh-web server
09:53:18 swh-web_1 | [2021-12-06 08:53:02 +0000] [1] [INFO] Starting gunicorn 20.1.0
09:53:18 swh-web_1 | [2021-12-06 08:53:02 +0000] [1] [INFO] Listening at: http://0.0.0.0:5004 (1)
09:53:18 swh-web_1 | [2021-12-06 08:53:02 +0000] [1] [INFO] Using worker: gthread
09:53:18 swh-web_1 | [2021-12-06 08:53:02 +0000] [42] [INFO] Booting worker with pid: 42
09:53:18 swh-web_1 | [2021-12-06 08:53:02 +0000] [43] [INFO] Booting worker with pid: 43Migrated from T3778 (view on Phabricator)