Skip to content

cassandra: Use concurrent queries in *_missing() instead of naive grouping

vlorentz requested to merge generated-differential-D6885-source into generated-differential-D6885-target

Instead of grouping ids in queries in arbitrary batches (which forces the server node to coordinate with other nodes to complete the query), this sends queries with one id each, directly to the right node.

This is the 'concurrent' algorithm from https://forge.softwareheritage.org/swh/infra/sysadm-environment#3577 which gives a >=2x speed-up on directories, and a >=8x speed-up on revisions.

This is essentially !727 (closed), minus the option to select other algos.

Migrated from D6885 (view on Phabricator)

Merge request reports