cran: Update lister implementation to use the METACRAN JSON database
The cran_info_db.rds
file we were using to get all CRAN package
versions is no longer updated since 2024-06-02 so the lister no
longer collected new package versions released since that date.
So update the lister implementation to use the METACRAN JSON database (around 260 Mb to download at time of writing) instead which is guaranteed to be up to date regarding new package releases on CRAN.
Related to #4711.
The CRAN loader also requires some updates, notably to fix some missing release dates and ensure proper ordering of releases.
Merge request reports
Activity
mentioned in merge request swh-loader-core!534
Jenkins job DLS/gitlab-builds #426 succeeded in 3 min 52 sec.
See Console Output, Blue Ocean and Coverage Report for more details.The
cran_info_db.rds
file we were using to get all CRAN package versions is no longer updated since 2024-06-02 so the lister no longer collected new package versions released since that date.The issue was fixed since so this MR is no longer needed but I am keeping it opened just in case.