deposit: Synchronize HTTP read timeout with deposit server
When the deposit loader downloads a deposited tarball, it calls the raw endpoint of deposit private HTTP API. In production, the implementation of that endpoint downloads a set of tarballs from an azure blob storage and return an aggregated version of them.
It has been observed some HTTP read timeouts while downloading tarballs from azure. Those have been fixed in swh-deposit!453 (merged) by increasing the read timeout used to read data from azure.
However, there is still some deposit loader tasks that end up with error as the read timeout used to query the raw endpoint of deposit private API is twice lesser than the read timeout used to download from azure. So ensure those HTTP read timeouts have the same value of 120 seconds.
This should fix SWH-LOADER-CORE-2DH .
Merge request reports
Activity
Jenkins job DLDBASE/gitlab-builds #379 succeeded in 1 min 59 sec.
See Console Output, Blue Ocean and Coverage Report for more details.- Resolved by Antoine Lambert
- Resolved by Antoine Lambert
added 1 commit
- b841711c - deposit: Synchronize HTTP read timeout with deposit server
Jenkins job DLDBASE/gitlab-builds #380 succeeded in 2 min 24 sec.
See Console Output, Blue Ocean and Coverage Report for more details.mentioned in issue swh/infra/sysadm-environment#5536 (closed)