That hook can be frustrating as it can discard a long commit message
if it finds a typo in it so better removing it.

Related to T3922

black is considered stable since release 22.1.0 and the version
we are currently using is quite outdated and not compatible with
click 8.1.0, so it is time to bump it to its latest stable release.

Please note that E501 pycodestyle warning related to line length
is replaced by B950 one from flake8-bugbear as recommended by black.
https://black.readthedocs.io/en/stable/the_black_code_style/current_style.html#line-length

Related to T3922

pytest-postgresql 3.1.3 and pytest-redis 2.4.0 added support for
pytest >= 7 so we can now drop the pytest pinning.

Due to test modules being copied in subdirectories of the
build directory by setuptools, it makes pytest fail by raising
ImportPathMismatchError exceptions when invoked from root
directory of the module.

So ignore the build folder to discover tests.

- add the `get_datastore` function in `swh.indexer`
- add the `get_current_version` method in `IndexerBackend`,
- remove dbversion management from sql init script
- update tests accordingly

To install the new hook:

  $ pre-commit install -t commit-msg

Related to T3916

A future release of swh-model will change its constructor's signature (replace 'offset'
and 'negative_utc_offset' with 'offset_bytes).

Related to T3815

This also:
- drops spurious copyright headers to those files if present.
- drops a no longer relevant type ignore
- add another type ignore (to fix later)

Related to T3812

This fixes error instances [1]

[1] https://sentry.softwareheritage.org/share/issue/a5869f724a244fdab2e1cb0303a12fc1/

This fixes occurrences of [1]

[1] https://sentry.softwareheritage.org/share/issue/4b92519efe2a4ddd9455f0d600a614b9/

It renamed db_name to dbname, which is a breaking change.

Enable to check package documentation can be built without producing
sphinx warnings.

The sphinx environment is designed to be used in continuous integration
in order to prevent breaking documentation build when committing changes.

The sphinx-dev environment is designed to be used inside a full swh
development environment.

Related to T3258

The implementation is based on output from cff-converter python library.
Deviation has been made for license and organisation.legalName(replaced with organisation.name)

codemeta dir was updated last time in Jan 2019. In this commit
crosswalk.csv, CITATION and codemeta.jsonld have been updated.

Add testcase to detect CODEMETA.json

Simpler code and less error-prone.

self._index_contents was called multiple times in a loop with the same arguments,
except for the set of hashes to exclude.

It means that, if there were N pages of hashes to exclude, each content was
indexed N times; and the N-1 first iterations didn't even exclude all the
hashes they had to exclude.

The reason for this is to avoid surprises like the indexer journal client stuck
in limbo for a while.

Related to T2821
Related to T2814

Related to D4638

This detected some paper cuts within cli tests for example.

The main goal is to decrease friction when actually deploying indexer related
services (backend, indexers, ...).

The pg backends tests should still be reasonably fast as it's using the
swh.core.db.pytest_plugin (which truncate tables in between tests).

Related to T2821

According to the value_sanitizer docstring, this takes 2 parameters, first is
the object type, the second is the actual dict value to sanitize. As a somewhat
default identity function, this discards the object type and returns directly
the dict value unchanged.

[1] https://forge.softwareheritage.org/source/swh-journal/browse/master/swh/journal/writer/kafka.py$97-100

It will become mandatory in a future version.

This always happens when writing to Kafka, as the Kafka writer sets it
to None at the same it it injects the 'tool' data.

This was not caught by tests because they use the in-mem writer;
which did not call unique_key() at all in swh-journal<=v0.5.1
(but future versions will).

This fixes the indexer debian package build.