Skip to content

Write a tool to handle the kafka dataset for the mirror E2E tests

Should be able to:

  • reset test topics (topics swh.test.objects. on the staging kafka)
  • fill these topics by loading a set a origins (ideally at least one of each loader type)
  • store in a dedicated topic the expected statistics (number of each object by origin)

Migrated from T4339 (view on Phabricator)

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information