Add an objstorage checker to detect missing and corrupted contents
Add class ObjectStorageChecker to detect missing and corrupted contents in an object storage. It iterates on content objects referenced in a storage instance, check they are available in a given object storage instance then retrieve their bytes from it in order to recompute checksums and detect corruptions. Related to #4694.
Showing
- conftest.py 1 addition, 0 deletionsconftest.py
- swh/scrubber/db.py 13 additions, 14 deletionsswh/scrubber/db.py
- swh/scrubber/objstorage_checker.py 102 additions, 0 deletionsswh/scrubber/objstorage_checker.py
- swh/scrubber/tests/objstorage_checker_tests.py 133 additions, 0 deletionsswh/scrubber/tests/objstorage_checker_tests.py
- swh/scrubber/tests/test_objstorage_memory.py 21 additions, 0 deletionsswh/scrubber/tests/test_objstorage_memory.py
- swh/scrubber/tests/test_objstorage_pathslicing.py 19 additions, 0 deletionsswh/scrubber/tests/test_objstorage_pathslicing.py
Loading
Please register or sign in to comment