Skip to content
Snippets Groups Projects

deposit: Synchronize HTTP read timeout with deposit server

All threads resolved!

When the deposit loader downloads a deposited tarball, it calls the raw endpoint of deposit private HTTP API. In production, the implementation of that endpoint downloads a set of tarballs from an azure blob storage and return an aggregated version of them.

It has been observed some HTTP read timeouts while downloading tarballs from azure. Those have been fixed in swh-deposit!453 (merged) by increasing the read timeout used to read data from azure.

However, there is still some deposit loader tasks that end up with error as the read timeout used to query the raw endpoint of deposit private API is twice lesser than the read timeout used to download from azure. So ensure those HTTP read timeouts have the same value of 120 seconds.

This should fix SWH-LOADER-CORE-2DH .

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • lgtm, a couple of remarks inline.

  • Antoine R. Dumont approved this merge request

    approved this merge request

  • added 1 commit

    • b841711c - deposit: Synchronize HTTP read timeout with deposit server

    Compare with previous version

  • Antoine Lambert resolved all threads

    resolved all threads

  • Jenkins job DLDBASE/gitlab-builds #380 succeeded in 2 min 24 sec.
    See Console Output, Blue Ocean and Coverage Report for more details.

  • Please register or sign in to reply
    Loading