common/archive: Improve lookup_origin_visits performance

Use new method origin_visit_get_with_statuses from storage interface returning all visits and their statuses instead of querying latest status for each visit.

Also bump the maximum number of visits per page from 50 to 1000.

Related to swh-storage#4090 (closed)

---

Migrated from D7559 (view on Phabricator)

Some references in the commit message have been migrated:

• T4090 is now swh-storage#4090 (closed)

Build is green

Patch application report for D7559 (id=27399)

Rebasing onto 96b38d99...

Current branch diff-target is up to date.

Changes applied before test

commit 731e01f396c45e1455f66eb94022d0c1bad55d07
Author: Antoine Lambert <anlambert@softwareheritage.org>
Date:   Tue Apr 12 13:43:03 2022 +0200

    common/archive: Improve lookup_origin_visits performance
    
    Use new method origin_visit_get_with_statuses from storage interface
    returning all visits and their statuses instead of querying latest
    status for each visit.
    
    Also bump the maximum number of visits per page from 50 to 1000.
    
    Related to swh/devel/swh-storage#4090

See https://jenkins.softwareheritage.org/job/DWAPPS/job/tests-on-diff/1709/ for more details.

mentioned in merge request !792 (closed)

Merge request was accepted

approved this merge request

Merge request was merged

closed