Add forge now - Process https://git.videolan.org/

https://archive.softwareheritage.org/admin/add-forge/request/168/

Type: gitweb

changed milestone to %Extend archive coverage [Roadmap - Collect]

added AddForgeNow label

assigned to @guillaume

On staging environment the first ingestion is successfully completed, see add-forge-now-requests#46 (closed).

On production environment:

swh@swh-toolbox-7c7f589985-wbn7f:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset production \
  register-lister gitweb \
    instance=git.videolan.org
Created 1 tasks

Task 415923518
  Next run: today (2023-11-14T08:10:18.736532+00:00)
  Interval: 1 day, 0:00:00
  Type: list-gitweb
  Policy: recurring
  Args:
  Keyword args:
    instance: 'git.videolan.org'

Check the listed origins:

swh@swh-toolbox-7c7f589985-wbn7f:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-listed-origins gitweb git.videolan.org -l
url                                      last_seen                         last_update
---------------------------------------  --------------------------------  --------------------------------
https://git.videolan.org/git/ffmpeg.git  2023-11-14 08:10:33.011256+00:00  2023-11-13 17:10:22.199652+00:00
[...]
https://git.videolan.org/git/x262.git    2023-11-14 08:10:33.011256+00:00  2015-11-14 08:10:32.977631+00:00

Forge git.videolan.org (gitweb) has 25 listed origins in the scheduler database.

Schedule the first ingestion:

swh@swh-toolbox-7c7f589985-wbn7f:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset production \
    schedule-first-visits \
      --type-name git \
      --lister-name gitweb \
      --lister-instance-name git.videolan.org

10000 slots available in celery queue
25 visits to send to celery

The first ingestion is successfully completed:

swh@swh-toolbox-7c7f589985-wbn7f:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-ingested-origins gitweb git.videolan.org

Forge git.videolan.org (gitweb) has 25 scheduled ingests in the scheduler.
failed       : 0
None         : 0
not_found    : 0
successful   : 25
total        : 25
success rate : 100.0%

added 30m of time spent

closed