Introduce bioconductor lister
The way this lister works is that it scrapes origins from pages like:
- https://bioconductor.org/packages/json/3.17/bioc/packages.json
- https://bioconductor.org/packages/json/3.17/workflows/packages.json
- https://bioconductor.org/packages/json/3.18/bioc/packages.json
Note the pattern https://bioconductor.org/packages/json/<release-version>/<category>/packages.json
Here, I've coined the term "category" to represent the 4 possible values: bioc, workflows, data/annotation, and data/experiment.
This packages.json
file is a dictionary of all the packages. We iterate through them and send them to the scheduler.
Related to #4699
Refs. swh/meta#5051
Edited by Antoine R. Dumont