Skip to content

Update scancode

vlorentz requested to merge bump-scancode into master

On Jenkins (only!?) pip can't install a 31.2.5 wheel it just built:

[2024-10-15T08:49:52.698Z] Building wheels for collected packages: scancode-toolkit, luigi
[2024-10-15T08:49:52.698Z]   Building wheel for scancode-toolkit (pyproject.toml): started
[2024-10-15T08:49:52.698Z]   Building wheel for scancode-toolkit (pyproject.toml): still running...
[2024-10-15T08:49:52.698Z]   Building wheel for scancode-toolkit (pyproject.toml): finished with status 'done'
[2024-10-15T08:49:52.698Z]   Created wheel for scancode-toolkit: filename=scancode_toolkit-31.2.5-py3-none-any.whl size=32852751 sha256=de65320d7804d167faaa5dd93d6542895ac59872ed245f272f6d005fa4c6e79b
[2024-10-15T08:49:52.698Z]   Stored in directory: /home/jenkins/.cache/pip/wheels/20/a0/c8/7a4d3f91e634eb236cff93f629578295647dc99cc4918840df
[2024-10-15T08:49:52.698Z]   Building wheel for luigi (setup.py): started
[2024-10-15T08:49:52.698Z]   Building wheel for luigi (setup.py): finished with status 'done'
[2024-10-15T08:49:52.698Z]   Created wheel for luigi: filename=luigi-3.5.1-py3-none-any.whl size=1085893 sha256=1631aa7af6582572a7318c48e212b85f2b8b1edd87fe337e7a56752763ee9cfd
[2024-10-15T08:49:52.698Z]   Stored in directory: /home/jenkins/.cache/pip/wheels/91/37/4f/e085faaa3d69633ba1aa2b169e9a317aa323839b94153a8787
[2024-10-15T08:49:52.698Z] Successfully built scancode-toolkit luigi
[2024-10-15T08:49:52.698Z] Installing collected packages: webencodings, wcwidth, types-click, typecode-libmagic, text-unidecode, systemd-python, sortedcontainers, pytz, py4j, publicsuffix2, plyvel, ply, pkginfo2, parameter-expansion-patched, lockfile, intbitset, extractcode-libarchive, extractcode-7z, confluent-kafka, boolean.py, banal, zipp, xmltodict, wrapt, urlpy, urllib3, typing-extensions, types-tqdm, types-pyyaml, types-pytz, types-psycopg2, types-protobuf, types-deprecated, tqdm, tornado, toml, tenacity, soupsieve, six, redis, pyzstd, pyyaml, python-mimeparse, python-magic, pyparsing, pyorc, pygments, pygmars, pycparser, pyahocorasick, psycopg2, psutil, protobuf, propcache, port-for, pefile, packageurl-python, numpy, mypy-extensions, multidict, msgpack, more-itertools, MarkupSafe, lxml, license-expression, jmespath, javaproperties, itsdangerous, iso8601, idna, gunicorn, grpcio, gemfileparser2, ftfy, frozenlist, fasteners, docutils, dockerfile-parse, colorama, click, charset-normalizer, chardet, certifi, blinker, backports.entry-points-selectable, attrs, aiohappyeyeballs, yarl, Werkzeug, types-requests, sentry-sdk, saneyaml, requests, python-dateutil, python-daemon, pytest-mock, pytest-asyncio, pyarrow, psycopg, pip-requirements-parser, packvers, normality, mypy-protobuf, mirakuru, jsonstreams, jinja2, jaraco.functools, isodate, importlib-metadata, hypothesis, html5lib, grpcio-tools, grpc-stubs, geomet, deprecated, debian-inspector, cffi, binaryornot, Beautifulsoup4, attrs-strict, aiosignal, swh.perfecthash, swh.model, swh.core, requests-mock, rdflib, pytest-postgresql, pymaven-patch, luigi, flask, fingerprints, dparse2, datafusion, cryptography, cassandra-driver, botocore, aiohttp, swh.journal, spdx-tools, s3transfer, pdfminer.six, commoncode, aiohttp-utils, plugincode, container-inspector, boto3, typecode, swh.objstorage, swh.counters, swh.storage, extractcode, swh.dataset, scancode-toolkit
[2024-10-15T08:49:52.698Z] WARNING: Package 'extractcode' has an invalid Requires-Python: Invalid specifier: '>=3.6.*'
[2024-10-15T08:49:52.698Z] ERROR: Exception:
[2024-10-15T08:49:52.698Z] Traceback (most recent call last):
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/cli/base_command.py", line 105, in _run_wrapper
[2024-10-15T08:49:52.698Z]     status = _inner_run()
[2024-10-15T08:49:52.698Z]              ^^^^^^^^^^^^
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/cli/base_command.py", line 96, in _inner_run
[2024-10-15T08:49:52.698Z]     return self.run(options, args)
[2024-10-15T08:49:52.698Z]            ^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/cli/req_command.py", line 67, in wrapper
[2024-10-15T08:49:52.698Z]     return func(self, options, args)
[2024-10-15T08:49:52.698Z]            ^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/commands/install.py", line 457, in run
[2024-10-15T08:49:52.698Z]     installed = install_given_reqs(
[2024-10-15T08:49:52.698Z]                 ^^^^^^^^^^^^^^^^^^^
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/req/__init__.py", line 70, in install_given_reqs
[2024-10-15T08:49:52.698Z]     requirement.install(
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/req/req_install.py", line 867, in install
[2024-10-15T08:49:52.698Z]     install_wheel(
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/operations/install/wheel.py", line 732, in install_wheel
[2024-10-15T08:49:52.698Z]     _install_wheel(
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/operations/install/wheel.py", line 590, in _install_wheel
[2024-10-15T08:49:52.698Z]     file.save()
[2024-10-15T08:49:52.698Z]   File "/var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds/.tox/py311/lib/python3.11/site-packages/pip/_internal/operations/install/wheel.py", line 378, in save
[2024-10-15T08:49:52.698Z]     with self._zip_file.open(zipinfo) as f:
[2024-10-15T08:49:52.698Z]          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-15T08:49:52.698Z]   File "/home/jenkins/.pyenv/versions/3.11.9/lib/python3.11/zipfile.py", line 1605, in open
[2024-10-15T08:49:52.698Z]     raise BadZipFile(
[2024-10-15T08:49:52.698Z] zipfile.BadZipFile: File name in directory 'licensedcode/data/rules/mpl-1.1_52.RULE' and header b'licensedcode/data/rules/mpl-1.1_52' differ.
[2024-10-15T08:49:52.698Z] py311: exit 2 (165.81 seconds) /var/lib/jenkins/agent-workdir/workspace/DGRPH/gitlab-builds> python -I -m pip install aiohttp boto3 click datafusion grpc-stubs grpcio-tools 'luigi!=3.5.2' 'mypy-protobuf<3.3' 'protobuf<5.26.0,>=4.21.11' psutil py4j pyarrow pytest-asyncio pytest-mock pytest-postgresql 'pytest>=8.1' python-magic pyzstd scancode-toolkit==31.2.5 'swh.core[http]>=0.3' 'swh.core[testing]>=3.0.0' swh.dataset 'swh.dataset[luigi]>=v1.2.0' 'swh.model>=6.13.0' swh.storage tqdm types-click types-protobuf types-pyyaml types-requests types-tqdm pid=743

Hopefully 32.2.1 will work better

Merge request reports

Loading