This matches the production Azure-based deployment.

When using the Azure direct download functionality, the content type
gets reset to application/octet-stream, which is valid (albeit
suboptimal) for gzips.

Related to swh/meta#4960

Related to swh/meta#4959

This fixes python 3.7 support due to poetry, a dependency of isort, that
removed support for that Python version in a recent release.

Valentin's fix for iteration of empty tarballs in the tarfile stdlib
module was merged and released in Python 3.11, so we need to handle that
case properly.

We only ever tested the single-origin case, and the CLI endpoint itself was
never adapted to work for multiple origins. Ensure that tests properly
support that case.

In order to remove warnings about /apidoc/*.rst files being included
multiple times in toc when building full swh documentation, prefer to
include module indices only when building standalone package documentation.

Related to T4496

- pre-commit from 4.1.0 to 4.3.0,
- codespell from 2.2.1 to 2.2.2,
- black from 22.3.0 to 22.10.0 and
- flake8 from 4.0.1 to 5.0.4. Also freeze flake8 dependencies.

Also change flake8's repo config to github (the gitlab mirror
being outdated).

- pre-commit from 4.1.0 to 4.3.0,
- black from 22.3.0 to 22.10.0 and
- flake8 from 4.0.1 to 5.0.4. Also freeze flake8 dependencies.

This will allow distributing the 'load' across multiple origins;
so that https://github.com/rdicosmo/parmap does not end up
with thousands of visits (which makes swh-storage time out when
listing visits)

It fails once deployed on the server with a
DistributionNotFound(Requirement.parse('typing'), None) error

Related to T3129

Related to T3129

That hook can be frustrating as it can discard a long commit message
if it finds a typo in it so better removing it.

Related to T3922

black is considered stable since release 22.1.0 and the version
we are currently using is quite outdated and not compatible with
click 8.1.0, so it is time to bump it to its latest stable release.

Please note that E501 pycodestyle warning related to line length
is replaced by B950 one from flake8-bugbear as recommended by black.
https://black.readthedocs.io/en/stable/the_black_code_style/current_style.html#line-length

Related to T3922

pytest-postgresql 3.1.3 and pytest-redis 2.4.0 added support for
pytest >= 7 so we can now drop the pytest pinning.

Due to test modules being copied in subdirectories of the
build directory by setuptools, it makes pytest fail by raising
ImportPathMismatchError exceptions when invoked from root
directory of the module.

So ignore the build folder to discover tests.

The '+' character in the 'after' was not escaped, so the server interpreted
it as a space.

Instead of filtering out after fetching, which won't work when there is
more than one page of results.

This can catch potential errors like file corruption, wrong encoding,
crashes after response headers were sent, etc.

It's a global constant, so it makes more sense to uppercase it.

This will allow more checks later, while keeping the code flow linear.

This adds a download step to the vault end to end check once the API
claims that the cooking was successful.

The download step checks:
 - that the fetch_url is present
 - that the status code is successful
 - that the response is not empty

Just to be safe, though it should not happen as origins are unique.

To install the new hook:

  $ pre-commit install -t commit-msg

Related to T3916

This also drops spurious copyright headers to those files if present.

Related to T3812