Skip to content

Deploy swh-indexer > v2.6 on staging then production

Staging:

  • Upgrade package on workers
  • Restart workers
  • Reset journal client on the swh.journal.objects.raw_extrinsic_metadata topic (for the new SWORD metadata mapping) [1]
  • Reset journal client on the swh.journal.objects.origin_visit_status topic (for the new Nuget metadata mapping by @VickyMerzOwn) [2]
  • Wait ~10 minutes to make sure they don't crash because of the refactorings

Production:

  • Upgrade package on workers
  • Restart workers
  • so previous puppet changes can be applied
  • Reset journal client on the swh.journal.objects.raw_extrinsic_metadata topic (for the new SWORD metadata mapping)
  • Reset journal client on the swh.journal.objects.origin_visit_status topic (for the new Nuget metadata mapping by @VickyMerzOwn)

No change to swh-indexer-storage since v2.3.0.

  • [1]
root@storage1:~# GROUP_ID=swh.indexer.journal_client.extrinsic_metadata
root@storage1:~# /opt/kafka/bin/kafka-consumer-groups.sh --bootstrap-server $SERVER --reset-offsets --all-topics --to-earliest --group $GROUP_ID --execute
...
  • [2]
root@storage1:~# GROUP_ID=swh.indexer.journal_client.origin_intrinsic_metadata
root@storage1:~# /opt/kafka/bin/kafka-consumer-groups.sh --bootstrap-server $SERVER --reset-offsets --all-topics --to-earliest --group $GROUP_ID --execute
...

Migrated from T4459 (view on Phabricator)

Edited by Antoine R. Dumont