Make PyPI lister incremental and complete in regards to last_update
This rewrote the current implementation to actually use pypi's xml-rpc api which allows to be incremental. It also allows to fetch the last release date per package. This last part actually make it possible to update the "last_update" entry in the ListedOrigin model. Related to T3399
parent
698be475
No related branches found
Tags v1.4.0
Showing
- swh/lister/pypi/lister.py 133 additions, 29 deletionsswh/lister/pypi/lister.py
- swh/lister/pypi/tasks.py 2 additions, 2 deletionsswh/lister/pypi/tasks.py
- swh/lister/pypi/tests/data/https_pypi.org/simple 0 additions, 12 deletionsswh/lister/pypi/tests/data/https_pypi.org/simple
- swh/lister/pypi/tests/test_lister.py 207 additions, 59 deletionsswh/lister/pypi/tests/test_lister.py
Loading
-
Some references in the commit message have been migrated:
- T3399 is now #3399 (closed)
-
mentioned in merge request !400 (closed)
Please register or sign in to comment