Skip to content

PopularContents: split work into smaller chunks

vlorentz requested to merge vlorentz/swh-graph:Popcont-chunks into master

Each thread handled one 96th of the node id range. But nodes are not homogeneously randomized across that range, so some threads had a lot more work to do than others, causing them to end weeks after, while most CPU cores idled.

By splitting the range this way, threads should have more homogeneous workloads.

Merge request reports

Loading