Add forge now - Process https://git.infodrom.org/

changed milestone to %Extend archive coverage [Roadmap - Collect]

On staging environment:

swh@swh-toolbox-75b8779f69-9rq2s:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset staging \
    register-lister gitweb \
      instance=git.infodrom.org
Created 1 tasks

Task 33422609
  Next run: today (2023-09-26T08:06:29.844920+00:00)
  Interval: 1 day, 0:00:00
  Type: list-gitweb
  Policy: oneshot
  Args:
  Keyword args:
    enable_origins: False
    instance: 'git.infodrom.org'
    max_origins_per_page: 10
    max_pages: 3

Check the listed origins:

swh@swh-toolbox-75b8779f69-9rq2s:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-listed-origins gitweb git.infodrom.org -l
url                                                         last_seen                         last_update
----------------------------------------------------------  --------------------------------  --------------------------------
git://git.infodrom.org/debian/hypermail                     2023-09-26 08:08:39.633891+00:00  2017-09-26 08:08:34.218642+00:00
[...]
git://git.infodrom.org/infodrom.org/www.zeitungsliste.de    2023-09-26 08:08:39.633891+00:00  2023-09-12 08:08:39.615167+00:00

Forge git.infodrom.org (gitweb) has 10 listed origins in the scheduler database.

Schedule the first ingestion:

swh@swh-toolbox-75b8779f69-9rq2s:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset staging \
  schedule-first-visits \
    --type-name git \
    --lister-name gitweb \
    --lister-instance-name git.infodrom.org

99 slots available in celery queue
10 visits to send to celery

added 10m of time spent

On staging environment the first ingestion is successfully completed:

swh@swh-toolbox-75b8779f69-9rq2s:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-ingested-origins gitweb git.infodrom.org

Forge git.infodrom.org (gitweb) has 10 scheduled ingests in the scheduler.
failed       : 0
None         : 0
not_found    : 0
successful   : 10
total        : 10
success rate : 100.0%

added 10m of time spent

On production environment:

swh@swh-toolbox-585bc8ddd7-w7zw8:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset production \
  register-lister gitweb \
    instance=git.infodrom.org
Created 1 tasks

Task 415808373
  Next run: today (2023-09-26T08:48:32.006589+00:00)
  Interval: 1 day, 0:00:00
  Type: list-gitweb
  Policy: recurring
  Args:
  Keyword args:
    instance: 'git.infodrom.org'

Check the listed origins:

swh@swh-toolbox-585bc8ddd7-w7zw8:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-listed-origins gitweb git.infodrom.org -l
url                                                         last_seen                         last_update
----------------------------------------------------------  --------------------------------  --------------------------------
git://git.infodrom.org/debian/hypermail                     2023-09-26 08:48:56.213969+00:00  2017-09-26 08:48:44.878378+00:00
[...]
git://git.infodrom.org/misc/kostenrechnung                  2023-09-26 08:48:56.213969+00:00  2011-09-26 08:48:56.204430+00:00

Forge git.infodrom.org (gitweb) has 34 listed origins in the scheduler database.

Schedule the first ingestion:

swh@swh-toolbox-585bc8ddd7-w7zw8:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset production \
    schedule-first-visits \
      --type-name git \
      --lister-name gitweb \
      --lister-instance-name git.infodrom.org

10000 slots available in celery queue
34 visits to send to celery

added 10m of time spent

On production environment the first ingestion is completed with a few failures:

swh@swh-toolbox-8677ddcbc7-d4m2x:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-ingested-origins gitweb git.infodrom.org

Forge git.infodrom.org (gitweb) has 34 scheduled ingests in the scheduler.
failed       : 5
None         : 0
not_found    : 0
successful   : 29
total        : 34
success rate : 85.29411764705883%