deposit: Handle download and aggregation of uploaded tarballs
Instead of using the deposit API raw private endpoint to get aggregated version of tarballs uploaded with a deposit, let the loader handle this possibly costly operation by using the new deposit API upload-urls private endpoint returning URLs for downloading uploaded tarballs. Fixes swh-deposit#4657.
Showing
- swh/loader/package/deposit/loader.py 85 additions, 10 deletionsswh/loader/package/deposit/loader.py
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_555_meta 51 additions, 0 deletions...ata/https_deposit.softwareheritage.org/1_private_555_meta
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_555_upload-urls 1 addition, 0 deletions...ps_deposit.softwareheritage.org/1_private_555_upload-urls
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_666_raw 0 additions, 1 deletion...data/https_deposit.softwareheritage.org/1_private_666_raw
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_666_upload-urls 1 addition, 0 deletions...ps_deposit.softwareheritage.org/1_private_666_upload-urls
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_777_raw 0 additions, 1 deletion...data/https_deposit.softwareheritage.org/1_private_777_raw
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_777_upload-urls 1 addition, 0 deletions...ps_deposit.softwareheritage.org/1_private_777_upload-urls
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_888_raw 0 additions, 1 deletion...data/https_deposit.softwareheritage.org/1_private_888_raw
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_888_upload-urls 1 addition, 0 deletions...ps_deposit.softwareheritage.org/1_private_888_upload-urls
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_999_raw 0 additions, 1 deletion...data/https_deposit.softwareheritage.org/1_private_999_raw
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/1_private_999_upload-urls 1 addition, 0 deletions...ps_deposit.softwareheritage.org/1_private_999_upload-urls
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/uploads_hello-2.10.zip 0 additions, 0 deletions...https_deposit.softwareheritage.org/uploads_hello-2.10.zip
- swh/loader/package/deposit/tests/data/https_deposit.softwareheritage.org/uploads_hello-2.12.tar.gz 0 additions, 0 deletions...ps_deposit.softwareheritage.org/uploads_hello-2.12.tar.gz
- swh/loader/package/deposit/tests/test_deposit.py 37 additions, 7 deletionsswh/loader/package/deposit/tests/test_deposit.py
Loading
Please register or sign in to comment