kafka: improve the message schema for the journal writer
Change the keys for relations to allow topics to be compacted. Entity topics depend on NOT being compacted as outdated data can reach the topic when multiple writers process the same content. Update the replayer accordingly fixing a few behavioural bugs.
Showing
- swh/provenance/storage/journal.py 31 additions, 18 deletionsswh/provenance/storage/journal.py
- swh/provenance/storage/replay.py 22 additions, 7 deletionsswh/provenance/storage/replay.py
- swh/provenance/tests/test_provenance_journal_writer.py 23 additions, 29 deletionsswh/provenance/tests/test_provenance_journal_writer.py
Loading
Please register or sign in to comment