black is considered stable since release 22.1.0 and the version
we are currently using is quite outdated and not compatible with
click 8.1.0, so it is time to bump it to its latest stable release.

Please note that E501 pycodestyle warning related to line length
is replaced by B950 one from flake8-bugbear as recommended by black.
https://black.readthedocs.io/en/stable/the_black_code_style/current_style.html#line-length

Related to T3922

pytest-postgresql 3.1.3 and pytest-redis 2.4.0 added support for
pytest >= 7 so we can now drop the pytest pinning.

Due to test modules being copied in subdirectories of the
build directory by setuptools, it makes pytest fail by raising
ImportPathMismatchError exceptions when invoked from root
directory of the module.

So ignore the build folder to discover tests.

check_config converts the "stored" configuration (with toplevel keys for
most services) into a config suitable for the ``get_vault`` function.

Ensure all tests use the same codepath to make sure it is properly
exercized, and that the vault backend object can be properly initialized
in all cases.

This makes the server "fixtured" config use the production structure,
with storage, objstorage, cache etc. set at the top level instead of
within the vault configuration key.

The azure backend cannot be run in the same thread as an asyncio
event loop: https://forge.softwareheritage.org/T3981

The objstorage no longer implements it.

- add the `get_datastore` function in `swh.vault`
- add the `get_current_version` method in `VaultBackend`,
- remove dbversion management from sql init script
- update tests accordingly

otherwise XXX

To install the new hook:

  $ pre-commit install -t commit-msg

PyPI cannot render :ref: or domain roles

We need to use the original names for commit/tag content to match their hash;
otherwise git-fsck/git-clone would error and make cooked repositories
unusable.

This allows restoring objects as-is, so they match checksums;
even when the parser was lossy.

Related to T3916

Related to D6967

This also drops spurious copyright headers to those files if present.

Related to T3812

A few points were wrong/outdated.

This commit also adds a higher-level overview in the module docstring.

self._seen contains also all the objects on the todo-stacks,
so it's incorrect to use it here.

This divides the total wall time by ~2.

It can be confusing to just have 'Processing...' in the UI for hours.
With this change, a new progress update should be sent every few minutes.

In the swh-web UI, it will show only 'Processing... %d objects processed'
in the main table, but 'Over %d remaining' will be shown when hovering
the progress bar.
This does not show 'Processing... %d/%d' or a percentage, because the
number of remaining objects is not always known.

It seems the broken reference was only about the missing `s` so drop the intermapping
configuration.

Part of the broken build [1]

[1] https://jenkins.softwareheritage.org/job/DDOC/job/dev/6791/console

Related to T3648

This uses `swh-docs/swh/docs/sphinx/conf.py:intersphinx_mapping` config to resolve the
link.

Part of the broken build [1]

[1] https://jenkins.softwareheritage.org/job/DDOC/job/dev/6791/console

Related to T3648

There are too many corrupt objects currently, it's unreasonable
to crash every time there is one in a repository.

We should revert this commit when T3552 is resolved, though.

No change in swh-web will only show the first line;
but this will include the detailed error in notification emails.

Useful in docker to use mailhog instead of actually sending emails

gi-fsck (rightly) does not accept them.

This saves 30KB in the final archive.