Skip to content

swh.journal: Add backfiller implementation

Antoine R. Dumont requested to merge generated-differential-D1345-source into generated-differential-D1345-target

Backfill for the following object types:

  • content
  • skipped_content
  • directory
  • release
  • revision
  • snaphost
  • origin
  • origin_visit

Support for:

  • sending ranges
  • starting back from a given boundary (depending on the object type, could be a hash or an id).

This is not complete yet (missing directory and snapshot

We'd like to make sure the journal replayer is able to reuse the data sent to the journal.

Test Plan

  • tox
  • run in docker environment (D1346)

Migrated from D1345 (view on Phabricator)

Merge request reports