This comes with PyPy 3.11 compatibility.

which are rejected by Sphinx

In practice this didn't seem to be an issue thanks to the array being large enough that
it is unlikely two threads write to the same memory page at the same time (up to
cache coherency); but we should not count on that.

This is probably slower, as SWHIDs are 22 bytes, and x86_64 can't lock regions over
16 bytes

This reverts commit d9abf3c2.

So we can publish swh-graph on crates.io

For some reason, datagrams are not always received in order on Jenkins,
even though they go through loopback interfaces should provide this guarantee.

This commit removes the check for datagram order, as it does not matter much
in practice, anyway.

This will be used by swh-provenance, as its tables cannot be queried
efficiently by Athena, and it's faster to upload all tables in parallel
(which we is harder if each table has to have its own Task class).

Graphs compressed with the Rust implementation (2023-09-06 and newer) sort labels
by name, while the Java implementation (2022-12-07 and older) sorted them by
base64(name).

mimalloc is already used in swh-provenance, provides performance on par with jemalloc
(even better by some reports, though with more memory overhead), and compiles
significantly faster than tikv-jemalloctor.

When adding end-to-end tests for graph compression, the new steps were
not integrated in the example dataset generation script, making it not
capable of generating a compressed example graph.

For example, swh-datasets needed this hack to get a `Rust` class that
will use its local executables: https://gitlab.softwareheritage.org/swh/devel/swh-datasets/-/blob/1aab21ff2ea9bc394210d92bec5d518a08edbd8c/swh/datasets/shell.py

with this change, it can be simplified to only adding the
`base_rust_executable_dir` to the arguments passed to the constructor.

Co-authored-by: Valentin Lorentz <vlorentz@softwareheritage.org>

Bump development tools: mypy, codespell, isort, ...

Move all tools configuration in pyproject.toml.

Remove no longer needed mypy overrides.

Move aggregate-dataset, blobs-datasets, filenames, and origin contributors to swh-datasets,
and provenance generation to its own repository