will be used to implement several test scenarios in following commits.
Also rename existing sql scripts with a "legit" numbering scheme.

To install the new hook:

  $ pre-commit install -t commit-msg

allowing to keep track of state-machine/workflow like status changes as
statsd gauges.

pre-commit is needed externally, not for the actual swh.core tests

allow to configure statsd tags from environment variable (eg. add
the hostname as tag).

This also drops spurious copyright headers to those files if present.

Related to T3812

defined in pytest_plugin. Also move the FakeSocket class there. It
should make it easier to write statsd-related tests in dependent
packages.

Exception thrown when packing a datetime without tzinfo has been changed
from TypeError to ValueError.

It depends on psycopg 3 instead of psycopg2; but we still use psycopg2 everywhere

Some archive files do not have any extension but we can guess their
format by getting their mime types.

So add a last resort processing step to get archive format from mime
type prior trying to extract it.

Related to T3468

Rust crate files are standard tar.gz archives so add support
to uncompress them through shutil.register_unpack_format.

For the record, those kind of source files archive are processed
by the nixguix loader.

By default shutil.unpack_archive will try to match the archive format
from its extension but it does not do it in a case insensitive way.
Thus trying to extract a file named "archive.ZIP" will fail.

So try to detect archive format in a case insensitive way by processing
the data returned by shutil.get_unpack_formats prior unpacking.

Nothing should be printed to standard output when calling
swh.core.tarball.uncompress.

Related to T3468

It's needed to properly read from storage.directory_get_entries,
which returns None instead of empty iterators when a directory
is not found (so clients can tell the difference with the empty
directory without hardcoding its hash).

Do not leak internal swh.core.tarball implementation in tests.

Also fix swh.core.tarball.uncompress documentation and implementation,
the function should not return a value.

Python zipfile module does not support the unpacking of ZIP archive
with legacy compression type 6 (implode).

Fallback using the unzip command in that case as it supports the
unpacking of such ZIP file.

Closes T3369

Use lowercase only for requirement names and sort them in
lexicographical order.

Move types-* in requirements-test.txt files as they are not
required for execution.

Remove no longer used requirements-test-db.txt file and associated
testing-db extra in setup.py.

This ensures mypy will not produce errors while being able to run tests
regardless pytest-postgresql version (<3 or >=3).

Two changes affect us:

* pytest_postgresql.factories.get_config was moved to pytest_postgresql.config.get_config
* all db_name keywords and attributes were renamed to dbname

For consistency, I renamed db_name to dbname everywhere, so this will
affect other SWH packages.

When building the global swh documentation, all commands defined
in other swh packages will be insterted in the swh.core cli
documentation but we only want to document the root command here.

This also fixes the remaining sphinx warning when building the global
swh documentation.

3.0 breaks backwards compatibility, we should handle the upgrade in a
separate patch, for now this ensures the rest of the pipelines can keep
running.

The previous implementation would not normalize permissions for
files detected as executable. This would make the loader crash when a
file has bogus permissions such as 0o100100 (executable but not
readable).

This adds a test that all possible file permissions properly normalize
to either 0o100644 or 0o100755.

Enable to check package documentation can be built without producing
sphinx warnings.

The sphinx environment is designed to be used in continuous integration
in order to prevent breaking documentation build when committing changes.

The sphinx-dev environment is designed to be used inside a full swh
development environment.

Related to T3258

Related to T2265