objstorage_checker: Add support for consuming content ids from journal (!65) · Merge requests · Platform / Development / swh-scrubber · GitLab

Snippets Groups Projects

Merged Antoine Lambert requested to merge anlambert/swh-scrubber:objstorage-checker-journal into master 11 months ago

Apr 11, 2024
- objstorage_checker: Add support for consuming content ids from journal · a4045264
  Antoine Lambert authored 11 months ago
  
  Add ObjectStorageCheckerFromJournal class to consume content ids from a kafka topic in order to check their presence in a given object storage but also to check their integrity by fetching their bytes and recomputing checksums. Related to #4694.
  a4045264
- base_checker: Set statsd constant tags in base checker classes · 5573b1b9
  Antoine Lambert authored 11 months ago
  
  5573b1b9
- tests: Wrap journal writer and client config in pytest fixtures · d8c04aaa
  Antoine Lambert authored 11 months ago
  
  d8c04aaa
- Remove unused interface.py file · 64bbe6bb
  Antoine Lambert authored 11 months ago
  
  64bbe6bb