Skip to content

Empty and reindex swh.journal.indexed.origin_extrinsic_metadata

The swh.journal.indexed.origin_extrinsic_metadata topic contains invalid dates, which crash the swh-search journal client, so:

  • staging: Stop indexer journal client (origin extrinsic metadata) -> argocd

  • staging: Stop swh.search @indexed journal client -> search0.internal.staging.swh.network

  • staging: Delete topic swh.journal.indexed.origin_extrinsic_metadata

  • staging: Recreate topic with proper config (number of partitions, etc.)

  • staging: Reset swh.indexer.journal_client.extrinsic_metadata consumer group offsets

  • staging: Reset swh.search.journal_client.indexed-v0.11 consumer group offsets for swh.journal.indexed.origin_extrinsic_metadata

  • staging: Restart swh.indexer journal client -> argocd

  • staging: Restart swh.search journal client -> search0

  • staging done

  • prod: Stop indexer journal client (origin extrinsic metadata) -> indexer-worker*.euwest.azure

  • prod: Stop swh.search @indexed journal client -> search1.internal.softwareheritage.org

  • prod: update swh.search storage backend

  • prod: update swh.indexer storage backend

  • prod: Remove topic swh.journal.indexed.origin_extrinsic_metadata

  • prod: Recreate topic with proper config (number of partitions, replicas, etc.)

  • prod: Reset swh.indexer.journal_client.extrinsic_metadata consumer group offsets

  • prod: Restart swh.indexer journal client -> indexer-worker*.euwest.azure

  • prod: Restart swh.search journal client -> search1.internal.softwareheritage.org

  • prod done

Edited by Nicolas Dandrimont