Add forge now - Process https://git.openssl.org/

https://archive.softwareheritage.org/admin/add-forge/request/171/

Type: gitweb

changed milestone to %Extend archive coverage [Roadmap - Collect]

added AddForgeNow label

assigned to @guillaume

On staging environment the first ingestion is completed with some failures, see add-forge-now-requests#49 (closed).

On production environment:

swh@swh-toolbox-5bc8b587cd-qqxj5:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset production \
  register-lister gitweb \
    instance=git.openssl.org
Created 1 tasks

Task 415960421
  Next run: today (2023-11-20T16:42:28.192959+00:00)
  Interval: 1 day, 0:00:00
  Type: list-gitweb
  Policy: recurring
  Args:
  Keyword args:
    instance: 'git.openssl.org'

Check the listed origins:

swh@swh-toolbox-5bc8b587cd-qqxj5:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-listed-origins gitweb git.openssl.org -l
url                                           last_seen                         last_update
--------------------------------------------  --------------------------------  --------------------------------
git://git.openssl.org/archaic-openssl.git     2023-11-20 16:42:43.650934+00:00  2014-11-20 16:42:40.649827+00:00
[...]
git://git.openssl.org/tools.git               2023-11-20 16:42:43.650934+00:00  2023-11-08 16:42:43.641111+00:00

Forge git.openssl.org (gitweb) has 12 listed origins in the scheduler database.

Schedule the first ingestion:

swh@swh-toolbox-5bc8b587cd-qqxj5:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset production \
    schedule-first-visits \
      --type-name git \
      --lister-name gitweb \
      --lister-instance-name git.openssl.org
10000 slots available in celery queue
12 visits to send to celery

The first ingestion is successfully completed:

swh@swh-toolbox-86b9bf8bf-dh9dd:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-ingested-origins gitweb git.openssl.org

Forge git.openssl.org (gitweb) has 12 scheduled ingests in the scheduler.
failed       : 0
None         : 0
not_found    : 0
successful   : 12
total        : 12
success rate : 100.0%

added 30m of time spent

closed