Deploy swh-scrubber 1.0.1

Completely overhauls the storage schema and command line arguments to support cassandra in addition to postgresql.

Staging & Prod:

• check that the package of the newest version is available
• disable puppet on all scrubbers
• update puppet manifests for new cli arguments: swh/infra/puppet/puppet-swh-site!611 (closed)

Staging:

• stop all workers
• apply swh/scrubber/sql/upgrades/5.sql > swh/devel/swh-scrubber@4400f3e9 (sudo -u swhworker SWH_CONFIG_FILENAME=/etc/softwareheritage/scrubber/storage_primary.yml swh db upgrade --module-config-key scrubber_db scrubber)
• upgrade package
• enable & noop apply puppet
• start one worker
• check sql DB
• restart all workers (without debug logs)

Production:

• stop all workers
• apply swh/scrubber/sql/upgrades/5.sql
• upgrade package
• enable & apply puppet
• restart all workers

(cc. @vlorentz)

changed milestone to %Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]

added activity::Deployment label

assigned to @olasd

Of course the swh-scrubber package fails to build, because swh-graph hasn't built in Debian for ages, and the swh-scrubber tests depend on a recent version it. Sigh.

So, I've fixed the swh.graph Debian build (for version 2.1.2). I've fixed the pipeline for package updates to newer versions. I've triggered the update of the Debian package to 2.2.0 (which is the last version that has successfully built for PyPI, somehow).

On to swh.scrubber...

swh.scrubber debian build fixed with a hammer (skipping the cassandra tests), onwards.

marked the checklist item check that the package of the newest version is available as completed

marked the checklist item disable puppet on all scrubbers as completed

mentioned in commit swh/infra/puppet/puppet-swh-site@2ef2e8ba

mentioned in merge request swh/infra/puppet/puppet-swh-site!611 (closed)

changed the description

mentioned in commit swh/infra/puppet/puppet-swh-site@153d6bbd

marked the checklist item stop all workers as completed

marked the checklist item upgrade package as completed

marked the checklist item enable & noop apply puppet as completed

marked the checklist item start one worker as completed

changed the description

marked the checklist item apply swh/scrubber/sql/upgrades/5.sql > swh/devel/swh-scrubber@4400f3e9 as completed

marked the checklist item check sql DB as completed