Deploy nixguix loader

Even though the implementation is not complete [1], we can deploy a first version of the loader which can already ingest the majority of artifacts.

This will most likely creates partial snapshot most of the time but that's still snapshot that are browsable from the archive.

We can thus deploy it.

This task tracks the actions to do so.

• swh/infra/puppet/puppet-swh-site!214 (closed): Update puppet manifests (only staging is referenced for now).
• Deploy on workers
• Register task-type load-nixguix in scheduler [2]
• Schedule origins to ingest the following sources.json [3]
  • sources-19.09.json
  • sources-20.03.json
  • sources-unstable.json

Note: striken sources are deactivated for now (seen with @lewo).

• [1] As the parent task mentions, for now, some artifacts are not dealt with (they have been mostly filtered out in the sources.json for now)

• [2] Idempotently register new task-types (out of new version of loader packages, noop on existing ones)

SWH_CONFIG_FILENAME=/etc/softwareheritage/scheduler.yml
swh scheduler --config-file $SWH_CONFIG_FILENAME \
  task-type register \
    --plugins loader.nixguix

• [3] Scheduling task (on the right scheduler)

swh scheduler --config-file $SWH_CONFIG_FILENAME \
  task add load-nixguix \
    url=https://nix-community.github.io/nixpkgs-swh/sources-unstable.json

---

Migrated from T2411 (view on Phabricator)