Skip to content
Snippets Groups Projects
  • David Douard's avatar
    08f2e604
    Add support for kafka journalization of the ProvenanceStorageInterface · 08f2e604
    David Douard authored
    the new ProvenanceStorageJournal is a proxy ProvenanceStorageInterface
    that will push added objects in a swh-journal (typ. a kafka).
    
    Journal messages are simple dicts with 2 keys: id (the sharding key) and
    value (a serialiazable version of the argument of the xxx_add() method).
    
    Use the 'kafka' pytest marker for all kafka-related tests (especially
    used for tox, see tox.ini).
    08f2e604
    History
    Add support for kafka journalization of the ProvenanceStorageInterface
    David Douard authored
    the new ProvenanceStorageJournal is a proxy ProvenanceStorageInterface
    that will push added objects in a swh-journal (typ. a kafka).
    
    Journal messages are simple dicts with 2 keys: id (the sharding key) and
    value (a serialiazable version of the argument of the xxx_add() method).
    
    Use the 'kafka' pytest marker for all kafka-related tests (especially
    used for tox, see tox.ini).
test_provenance_journal_writer_kafka.py 1.30 KiB