Skip to content

Draft: backfill: Add CASSANDRA_RANGE_GENERATORS

vlorentz requested to merge vlorentz/swh-storage:backfill-cass into master

They have a similar role to RANGE_GENERATORS, but produce ranges of Murmur3 hashes, instead of the actual values that would be in the primary key as for PostgreSQL.

They will be used by swh-scrubber, to scrub Cassandra (swh-scrubber#4685 (closed))

This MR contains two commits: first add tests without changing anything, then refactor with very minor changes to tests (1000 -> 1024 as the chunk_size for origin/origin_visit/origin_visit_status). This ensures the behavior does not change for PostgreSQL.

Edited by vlorentz

Merge request reports