Skip to content
Snippets Groups Projects
Commit 326618a5 authored by Raphaël Gomès's avatar Raphaël Gomès Committed by Phabricator Migration user
Browse files

Add random directory sampling policy

This makes use of the new discovery algorithm introduced in
``swh-loader-core``, which should help speed up large (think Linux
kernel or way larger) scans.

Most of the time is spend walking the on-disk directory and hashing,
which is where the new optimizations in ``swh-model==6.5.0`` should come
in handy. Python is close to its limit in that regard, some future
endeavor should look into setting up SWH for native extensions.
parent 90534eca
No related branches found
Tags debian/upstream/0.22.2
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment