Skip to content
Snippets Groups Projects
Commit f57b8f3a authored by Antoine Lambert's avatar Antoine Lambert
Browse files

cpan: Improve listing process by querying the metacpan release endpoint

Instead of querying the metacpan distribution endpoint to list origins,
prefer to use the release endpoint instead enabling to list all artifacts
associated to CPAN packages by scrolling results.

Compared to previous implementation, it enables to compute a last_update
date for all CPAN packages but also to obtain artifact sha256 checksums
that will be used by the CPAN loader to check downloads integrity.

As the multiple versions of a module are spread across multiple pages
from the CPAN API, origins are sent to the scheduler once all pages
processed, it is also faster to proceed that way.

Related to T2833
parent 108816f2
No related branches found
No related tags found
No related merge requests found
Showing
with 701 additions and 159 deletions
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment