Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • S sysadm-environment
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 167
    • Issues 167
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Platform
  • Infrastructure
  • sysadm-environment
  • Issues
  • #4658
Closed
Open
Issue created Oct 31, 2022 by vlorentz@vlorentzMaintainer19 of 19 checklist items completed19/19 checklist items

Empty and reindex swh.journal.indexed.origin_extrinsic_metadata

The swh.journal.indexed.origin_extrinsic_metadata topic contains invalid dates, which crash the swh-search journal client, so:

  • staging: Stop indexer journal client (origin extrinsic metadata) -> argocd

  • staging: Stop swh.search @indexed journal client -> search0.internal.staging.swh.network

  • staging: Delete topic swh.journal.indexed.origin_extrinsic_metadata

  • staging: Recreate topic with proper config (number of partitions, etc.)

  • staging: Reset swh.indexer.journal_client.extrinsic_metadata consumer group offsets

  • staging: Reset swh.search.journal_client.indexed-v0.11 consumer group offsets for swh.journal.indexed.origin_extrinsic_metadata

  • staging: Restart swh.indexer journal client -> argocd

  • staging: Restart swh.search journal client -> search0

  • staging done

  • prod: Stop indexer journal client (origin extrinsic metadata) -> indexer-worker*.euwest.azure

  • prod: Stop swh.search @indexed journal client -> search1.internal.softwareheritage.org

  • prod: update swh.search storage backend

  • prod: update swh.indexer storage backend

  • prod: Remove topic swh.journal.indexed.origin_extrinsic_metadata

  • prod: Recreate topic with proper config (number of partitions, replicas, etc.)

  • prod: Reset swh.indexer.journal_client.extrinsic_metadata consumer group offsets

  • prod: Restart swh.indexer journal client -> indexer-worker*.euwest.azure

  • prod: Restart swh.search journal client -> search1.internal.softwareheritage.org

  • prod done

Edited Nov 14, 2022 by Nicolas Dandrimont
Assignee
Assign to
Time tracking