crates: Improve loader implementation
Add incremental support based on sha256 EXTID. Use looseversion.LooseVersion2 to parse crate versions. Manage release date for each versions of a package. Fetch extrinsic metadata for a crate version from crates Web API. Adapt test dataset and add incremental test cases. Related to swh/meta#4104
Showing
- docs/package-loader-specifications.rst 5 additions, 5 deletionsdocs/package-loader-specifications.rst
- requirements.txt 1 addition, 0 deletionsrequirements.txt
- swh/loader/package/crates/loader.py 86 additions, 211 deletionsswh/loader/package/crates/loader.py
- swh/loader/package/crates/tests/data/expected.json 84 additions, 0 deletionsswh/loader/package/crates/tests/data/expected.json
- swh/loader/package/crates/tests/data/fake_crates.sh 2 additions, 13 deletionsswh/loader/package/crates/tests/data/fake_crates.sh
- swh/loader/package/crates/tests/data/https_crates.io/api_v1_crates_hg-core 68 additions, 2 deletions...e/crates/tests/data/https_crates.io/api_v1_crates_hg-core
- swh/loader/package/crates/tests/data/https_crates.io/api_v1_crates_micro-timer 395 additions, 2 deletions...ates/tests/data/https_crates.io/api_v1_crates_micro-timer
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_hg-core_hg-core-0.0.1.crate 0 additions, 0 deletions...https_static.crates.io/crates_hg-core_hg-core-0.0.1.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.1.0.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.1.0.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.1.1.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.1.1.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.1.2.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.1.2.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.2.0.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.2.0.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.2.1.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.2.1.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.3.0.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.3.0.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.3.1.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.3.1.crate
- swh/loader/package/crates/tests/data/https_static.crates.io/crates_micro-timer_micro-timer-0.4.0.crate 0 additions, 0 deletions...atic.crates.io/crates_micro-timer_micro-timer-0.4.0.crate
- swh/loader/package/crates/tests/test_crates.py 344 additions, 130 deletionsswh/loader/package/crates/tests/test_crates.py
- swh/loader/package/crates/tests/test_tasks.py 11 additions, 2 deletionsswh/loader/package/crates/tests/test_tasks.py
Loading
Please register or sign in to comment