It now needs types-click which is indeed a dependency of
swh.core[testing].

stof_on_eof member of JournalClient class was removed and replaced
by on_eof member.

GitLab will display the content of the README file when browsing the
repository. But in case the file is a symlink, it will display the
path pointed by the symlink. There is a 6 year old issue about this:
https://gitlab.com/gitlab-org/gitlab/-/issues/15093

We can workaround the issue by having the content at the root of the
repository and a symlink to this file in the `docs/` directory.

Tested in swh-py-template!27

Related to swh/meta#4960

Related to swh/meta#4959

This fixes python 3.7 support due to poetry, a dependency of isort, that
removed support for that Python version in a recent release.

In order to remove warnings about /apidoc/*.rst files being included
multiple times in toc when building full swh documentation, prefer to
include module indices only when building standalone package documentation.

Related to T4496

- pre-commit from 4.1.0 to 4.3.0,
- codespell from 2.2.1 to 2.2.2,
- black from 22.3.0 to 22.10.0 and
- flake8 from 4.0.1 to 5.0.4. Also freeze flake8 dependencies.

Also change flake8's repo config to github (the gitlab mirror
being outdated).

That hook can be frustrating as it can discard a long commit message
if it finds a typo in it so better removing it.

Related to T3922

black is considered stable since release 22.1.0 and the version
we are currently using is quite outdated and not compatible with
click 8.1.0, so it is time to bump it to its latest stable release.

Please note that E501 pycodestyle warning related to line length
is replaced by B950 one from flake8-bugbear as recommended by black.
https://black.readthedocs.io/en/stable/the_black_code_style/current_style.html#line-length

Related to T3922

pytest-postgresql 3.1.3 and pytest-redis 2.4.0 added support for
pytest >= 7 so we can now drop the pytest pinning.

Due to test modules being copied in subdirectories of the
build directory by setuptools, it makes pytest fail by raising
ImportPathMismatchError exceptions when invoked from root
directory of the module.

So ignore the build folder to discover tests.

To install the new hook:

  $ pre-commit install -t commit-msg

Related to T3916

A future release of swh-model will change its constructor's signature (replace 'offset'
and 'negative_utc_offset' with 'offset_bytes).

This also drops spurious copyright headers to those files if present.

Related to T3812

This reverts commit cd595e71.

The scheduler statistics are used instead

Related to T3659

Process origin messages in order to extract an count
network locations in origin URLs.

Related to T3127

It makes the tests much simpler to read, use of mocks should be avoided
when it is possible.

Journal client can also be used with the in memory counters so use
counters interface for typing instead of redis implementation.

Enable to check package documentation can be built without producing
sphinx warnings.

The sphinx environment is designed to be used in continuous integration
in order to prevent breaking documentation build when committing changes.

The sphinx-dev environment is designed to be used inside a full swh
development environment.

Related to T3258

Motivation:

* This simplifies the CLI, and stops leaking implementation details
  (what field the implementation reads, what keys contains, that
  keys exist at all, etc.) through this interface.

* It also removes the need to have two clients, both reading revisions
  and releases.

This preserves the optimization of not deserializing unneeded values,
by passing raw message values to the worker functions; which can
deserialize it themselves if needed.

Additionally, this commit fixes some mistakes in type annotations.

and use it to count the persons inside the releases and revisions.

Via an new argument 'keys'/'messages' supported by the cli, different
journal client implemtations and worker functions are used.
'keys' is the old behavior counting only the different message keys
of a given topic.

Related to T3251

Add an in memory implementatiom that will be used in the webapp's tests

Related to T3231

It allow the webapp to retrieve all the values it needs for the
homepage in only one rpc call

Related to T3231

It has no effect on pip version but it's not working with
on debian stable

Related to T3165

Flask versions between stable (1.0.2) and pip(1.1.2) have different
behaviors. The oldest version does not automatically handle a dict
as return value.

Related to T3165

Related to T3165

It will avoid the erase the file in case of problem and ensure the
webapp can't download it while it's not completely writtent on disk

Related to T3165

Related to T3165

- Convert the former script managed by puppet to a tested
  implementation of this module
- Add the api endpoint needed by the webapp to retrieve
  the file with static historical data and the live data
  from prometheus aggregated
- Add the api endpoint to build these files, it will be called
  regularly by a crontab

Related to T3165