gitlab: Improve incremental listing
Incremental listing of a GitLab instance will now list repositories modified since last listing date, previously only repositories created since last listing date were listed. We still benefit from GitLab keyset pagination with that extra filtering so it seems those type of queries are well indexed in GitLab database. This should help reducing the lag between archived GitLab repositories and their upstream states.
Showing
- swh/lister/gitlab/lister.py 11 additions, 49 deletionsswh/lister/gitlab/lister.py
- swh/lister/gitlab/tests/data/https_gite.lirmm.fr/api_response_page1.json 3 additions, 3 deletions...ab/tests/data/https_gite.lirmm.fr/api_response_page1.json
- swh/lister/gitlab/tests/data/https_gite.lirmm.fr/api_response_page2.json 2 additions, 2 deletions...ab/tests/data/https_gite.lirmm.fr/api_response_page2.json
- swh/lister/gitlab/tests/data/https_gite.lirmm.fr/api_response_page3.json 2 additions, 2 deletions...ab/tests/data/https_gite.lirmm.fr/api_response_page3.json
- swh/lister/gitlab/tests/test_lister.py 23 additions, 8 deletionsswh/lister/gitlab/tests/test_lister.py
Please register or sign in to comment