Diagnose swh-environment build failures
Investigate build failures on the swh-docker and swh-environment build in the ci:
- Several segmentation fault:
15:07:10 Thread 0x00007f8b49570740 (most recent call first):
15:07:10 File "/usr/lib/python3.7/selectors.py", line 415 in select
15:07:10 File "/usr/lib/python3.7/socketserver.py", line 232 in serve_forever
15:07:10 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/werkzeug/serving.py", line 777 in serve_forever
...
15:07:10 File "/usr/lib/python3.7/multiprocessing/context.py", line 277 in _Popen
15:07:10 File "/usr/lib/python3.7/multiprocessing/context.py", line 223 in _Popen
15:07:10 File "/usr/lib/python3.7/multiprocessing/process.py", line 112 in start
15:07:10 File "/home/jenkins/workspace/DENV/tests/swh-core/swh/core/api/tests/server_testing.py", line 74 in start_server
15:07:10 File "/home/jenkins/workspace/DENV/tests/swh-core/swh/core/api/tests/server_testing.py", line 35 in setUp
15:07:10 File "/home/jenkins/workspace/DENV/tests/swh-search/swh/search/tests/test_api_client.py", line 39 in setUp
...
15:07:10 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/_pytest/config/__init__.py", line 185 in console_main
15:07:10 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pytest/__main__.py", line 5 in <module>
15:07:10 File "/usr/lib/python3.7/runpy.py", line 85 in _run_code
15:07:10 File "/usr/lib/python3.7/runpy.py", line 193 in _run_module_as_main
15:07:11 F.........s......... [ 20%]
15:07:22 [ 20%]
15:07:22 swh/search/tests/test_cli.py ..Fatal Python error: Segmentation fault
14:55:36 swh/indexer/tests/test_codemeta.py ..Fatal Python error: Segmentation fault
14:55:36
14:55:36 Current thread 0x00007fa582b57740 (most recent call first):
14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 6542 in freeze
14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 5530 in _get_initial_context
14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 855 in expand
14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pyld/jsonld.py", line 163 in expand
14:55:36 File "/home/jenkins/workspace/DENV/tests/swh-indexer/swh/indexer/codemeta.py", line 131 in expand
14:55:36 File "/home/jenkins/workspace/DENV/tests/swh-indexer/swh/indexer/codemeta.py", line 173 in merge_documents
14:55:36 File "/home/jenkins/workspace/DENV/tests/swh-indexer/swh/indexer/tests/test_codemeta.py", line 86 in test_merge_documents
...
14:55:36 File "/home/jenkins/workspace/DENV/tests/.venv/lib/python3.7/site-packages/pytest/__main__.py", line 5 in <module>
14:55:36 File "/usr/lib/python3.7/runpy.py", line 85 in _run_code
14:55:36 File "/usr/lib/python3.7/runpy.py", line 193 in _run_module_as_main
14:55:38 make: *** [../Makefile.python:20: test] Segmentation fault (core dumped)
14:55:38 python3 -m pytest .
- several deposit failures:
15:00:15 __________________________ test_deposit_loading_ok_2 ___________________________
15:00:15
15:00:15 swh_storage = <swh.storage.proxies.retry.RetryingProxyStorage object at 0x7f89ac1f0240>
15:00:15 deposit_client = <swh.loader.package.deposit.loader.ApiClient object at 0x7f89ac13de80>
15:00:15 requests_mock_datadir = <requests_mock.mocker.Mocker object at 0x7f89ac13d588>
...
15:00:15 # Retrieve the release
15:00:15 release = loader.storage.release_get([hash_to_bytes(release_id)])[0]
15:00:15 assert release
15:00:15 > assert release.date.to_dict() == raw_meta["deposit"]["author_date"]
15:00:15 E AssertionError: assert {'negative_ut...: 1507389428}} == {'negative_ut...: 1507389428}}
15:00:15 E Omitting 3 identical items, use -vv to show
15:00:15 E Left contains 1 more item:
15:00:15 E {'offset_bytes': b'+0000'}
15:00:15 E Use -v to get the full diff
14:55:03 swh/deposit/tests/api/test_deposit_private_read_metadata.py:337:
14:55:03 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/test.py:289: in get
14:55:03 response = super().get(path, data=data, **extra)
14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/test.py:206: in get
14:55:03 return self.generic('GET', path, **r)
14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/test.py:235: in generic
14:55:03 method, path, data, content_type, secure, **extra)
14:55:03 ../.venv/lib/python3.7/site-packages/django/test/client.py:422: in generic
...
14:55:03 ../.venv/lib/python3.7/site-packages/rest_framework/views.py:506: in dispatch
14:55:03 response = handler(request, *args, **kwargs)
14:55:03 swh/deposit/api/private/__init__.py:86: in get
14:55:03 return super().get(request, collection_name, deposit_id)
14:55:03 swh/deposit/api/common.py:1093: in get
14:55:03 json.dumps(content), status=status, content_type=content_type
14:55:03 /usr/lib/python3.7/json/__init__.py:231: in dumps
14:55:03 return _default_encoder.encode(obj)
14:55:03 /usr/lib/python3.7/json/encoder.py:199: in encode
14:55:03 chunks = self.iterencode(o, _one_shot=True)
14:55:03 /usr/lib/python3.7/json/encoder.py:257: in iterencode
14:55:03 return _iterencode(o, 0)
...
14:55:03 > raise TypeError(f'Object of type {o.__class__.__name__} '
14:55:03 f'is not JSON serializable')
14:55:03 E TypeError: Object of type bytes is not JSON serializable
14:55:03
14:55:03 /usr/lib/python3.7/json/encoder.py:179: TypeError
None of these problems occurs on the master builds
Migrated from T3815 (view on Phabricator)