Skip to content
Snippets Groups Projects

Add support for kafka journalization of the ProvenanceStorageInterface

Closed Add support for kafka journalization of the ProvenanceStorageInterface
generated-differential-D8657-source into generated-differential-D8657-target
Closed David Douard requested to merge generated-differential-D8657-source into generated-differential-D8657-target
  1. Oct 11, 2022
    • David Douard's avatar
      Add support for kafka journalization of the ProvenanceStorageInterface · 08f2e604
      David Douard authored 
      the new ProvenanceStorageJournal is a proxy ProvenanceStorageInterface
that will push added objects in a swh-journal (typ. a kafka).

Journal messages are simple dicts with 2 keys: id (the sharding key) and
value (a serialiazable version of the argument of the xxx_add() method).

Use the 'kafka' pytest marker for all kafka-related tests (especially
used for tox, see tox.ini).
      08f2e604