This fixes python 3.7 support due to poetry, a dependency of isort, that
removed support for that Python version in a recent release.

In order to remove warnings about /apidoc/*.rst files being included
multiple times in toc when building full swh documentation, prefer to
include module indices only when building standalone package documentation.

Related to T4496

- pre-commit from 4.1.0 to 4.3.0,
- codespell from 2.2.1 to 2.2.2,
- black from 22.3.0 to 22.10.0 and
- flake8 from 4.0.1 to 5.0.4. Also freeze flake8 dependencies.

Also change flake8's repo config to github (the gitlab mirror
being outdated).

Use helper fixture loading_task_creation_for_listed_origin_test from
swh-loader-core and remove redundant test.

1. version 3.3.0 introduces Rust code, which requires rustc versions newer
   than available in Debian 11
2. For some reason, pip does not even try to install setuptools-rust on
   the CI, even though it's a build dependency of Breezy

All removed items have either been already addressed or were found to
not matter.

This is adapted from the email about public bzr loader review.

Recent changes in swh-scheduler add new parameters to the celery tasks
produced from swh.scheduler.model.ListedOrigin instances.

So ensure to handle any new parameters by not hardcoding the expected
ones in task signatures.

Remove unsafe use of unnamed task parameters.

Add new tests checking task parameters produced from ListedOrigin
instances do no raise error when attempting to create a bzr loader.

Related to T4187

That hook can be frustrating as it can discard a long commit message
if it finds a typo in it so better removing it.

Related to T3922

black is considered stable since release 22.1.0 and the version
we are currently using is quite outdated and not compatible with
click 8.1.0, so it is time to bump it to its latest stable release.

Please note that E501 pycodestyle warning related to line length
is replaced by B950 one from flake8-bugbear as recommended by black.
https://black.readthedocs.io/en/stable/the_black_code_style/current_style.html#line-length

Related to T3922

pytest-postgresql 3.1.3 and pytest-redis 2.4.0 added support for
pytest >= 7 so we can now drop the pytest pinning.

Fields offset and negative_utc of TimestampWithTimezone model were
deprecated and got removed.

Due to test modules being copied in subdirectories of the
build directory by setuptools, it makes pytest fail by raising
ImportPathMismatchError exceptions when invoked from root
directory of the module.

So ignore the build folder to discover tests.

You can have a branch that does not support tags located in a repository
that has the newest format. This fixes T3963.

The check that the upgrade is actually done is duplicated
in `test_needs_upgrade`, since the test would pass fine with an already
upgraded repo, albeit with a lower coverage.

The loader only supports the latest bzr format (2a) so try to
upgrade old repository formats to it prior the loading process.

Related to T3945

It currently fails in debian stable packaging build [1].

[1] https://jenkins.softwareheritage.org/job/debian/job/packages/job/DLDBZR/job/gbp-buildpackage/5/console

Related to T3915

To install the new hook:

  $ pre-commit install -t commit-msg

The issues weren't noticed before because mypy does not analyze
functions without an annotation in their signature.

Computing a delta from the currently stored snapshot for each revision
is much more efficient than always reading every single file.

We intentionally don't handle the cases where renames or copies are
involved. The complexity of the logic needed to figure out nested or
otherwise conflicting results coupled with the lack of nice primitives
in Breezy itself is really too much to be worth the effort, as revisions
with renames are far from being the majority.

Loading `lp:glamour` on my laptop before this change takes 59 minutes,
less than 3 minutes with this change.

Related to T3915

Related to T3915

`clone` was introduced with Breezy 3.1.0. For our purposes, `branch`
will do just fine since we don't want to get colocated branches (but
only one branch per origin). We can get the same "no tree" and directory
reuse behaviors with a simple flag.

Related to T3916

The work for optimizing the loader has been paved with issues, in
the mean time, this works and seems robust enough on a test run
on all launchpad projects.

The incremental logic will be added in a future patch.

This also updates the requirements file to more explicitly match newer
versions of the swh dependencies.

Superseeds D6806.

This tree still contains the `foo` package from the initial template
run. I will port the fix to the other branch that introduces other
`__init__.py` files.

This also contains a fix for the docs build.