It is required for a pre-commit hook used in repositories containing
rust code but is not installed with a minimal rustup profile.

It enables to not install the rust documentation which takes more
than 600Mb of disk space.

Those are not needed and take more than 2Gb of disk space.

This tools is no longer needed in the SWH development environment
and its installation takes more than 1Gb of disk space.

This is the version deployed in production (I think?) and the current
(outdated) installed version in the docker image is making
swh-loader-core tests fail.

Drop the override to use jdk11, it's no longer relevant.

Refs. swh/infra/sysadm-environment#5558

Antoine Lambert authored 3 months ago and Antoine Lambert committed 2 months ago

nodejs 18 is close to EOL and some swh-web dependencies bump minimal
required nodejs version to 20.

Prefer to install yarn using the corepack tool instead of debian packages.

Align cassandra version with the one used in production.

Cassandra tests from swh-storage package can be successfully
executed with cassandra 5.0.

The --locked option forces Cargo to use the lockfile declared by swh-graph,
which was carefully written to avoid conflicts between two Arrow versions
that are used as transitive dependencies through different packages.

When Cargo tries to update one, it ends up with incompatible versions,
causing a compilation failure.

The swh-graph-grpc-serve executable is required to run provenance
related tests and now has its own crate.

They're not specific to rage anymore.

This mounts a (potentially empty) SCCACHE_REDIS_ENDPOINT and
SCCACHE_REDIS_PASSWORD environment variable into the relevant build
commands to use sccache.

3.5.2 is not available any more on dlcdn.apache.org, plus we run 3.6
in production.

Kafka 3.5.0 has been removed from the Apache CDN.

It is required to run the full swh-environment tests suites.

We no longer build debian packages for swh components so we can
safely remove the build of these docker images.

Debian official package for nodejs 18.x superseeded the one
from nodesource so npm must now be explicitly installed.

Nevertheless, update nodesource package setup but comment it
until we have to bump nodejs version.

See https://github.com/nodesource/distributions#new-update-%EF%B8%8F.

A stage can only appear once per Dockerfile, so `FROM identifier` must
be unique. Move building rage upward for convenience.

Also document why we don’t pin rage to a specific version number.

Testing recovery bundles in swh-alter requires `rage` and `rage-keygen`.
See: https://github.com/str4d/rage/blob/main/rage/Cargo.toml

We use rust official Docker image to build the software via `cargo
install` in a dedicated stage. We then copy the (statically linked)
binaries to our image.

It is required by swh-lister to list CRAN packages.