objstorage_checker: Use check method from object storage interface (!66) · Merge requests · Platform / Development / swh-scrubber · GitLab

Snippets Groups Projects

Merged Antoine Lambert requested to merge anlambert/swh-scrubber:use-objstorage-check into master 11 months ago

Apr 11, 2024
- objstorage_checker: Use check method from object storage interface · 68d754ae
  Antoine Lambert authored 11 months ago
  
  Instead of reinventing the wheel, prefer to use the check method from the object storage interface for verifying content presence and integrity. Related to #4694.
  68d754ae
- objstorage_checker: Add support for consuming content ids from journal · a4045264
  Antoine Lambert authored 11 months ago
  
  Add ObjectStorageCheckerFromJournal class to consume content ids from a kafka topic in order to check their presence in a given object storage but also to check their integrity by fetching their bytes and recomputing checksums. Related to #4694.
  a4045264
- base_checker: Set statsd constant tags in base checker classes · 5573b1b9
  Antoine Lambert authored 11 months ago
  
  5573b1b9
- tests: Wrap journal writer and client config in pytest fixtures · d8c04aaa
  Antoine Lambert authored 11 months ago
  
  d8c04aaa
- Remove unused interface.py file · 64bbe6bb
  Antoine Lambert authored 11 months ago
  
  64bbe6bb