[Add Forge Now] process https://git.abscue.de

https://webapp.staging.swh.network/admin/add-forge/request/70/
Type: gitlab

Production request: https://archive.softwareheritage.org/admin/add-forge/request/177/

changed milestone to %Extend archive coverage [Roadmap - Collect]

added AddForgeNow label

Request successfully processed in staging environment.
For the pipeline details, see:
https://gitlab.softwareheritage.org/swh/infra/add-forge-now-requests/-/pipelines/5913.

Request completly messed up in production environment.
For the pipeline details, see:
https://gitlab.softwareheritage.org/swh/infra/add-forge-now-requests/-/pipelines/5913.

Jobs inherit artifacts from all the previous jobs that have artifacts not only the last one.
As there are two artifacts (one in first job the other in staging_status job), the last downloaded is used:

Downloading artifacts
00:01
Downloading artifacts for staging_status_successful (19941)...
Downloading artifacts from coordinator... ok        host=gitlab.softwareheritage.org id=19941 responseStatus=200 OK token=64_7TxJw
Downloading artifacts for 01_create_issue_and_register (19934)...
Downloading artifacts from coordinator... ok        host=gitlab.softwareheritage.org id=19934 responseStatus=200 OK token=64_7TxJw
[...]
$ scheduler_schedule_first_visits
1000 slots available in celery queue
10 visits to send to celery

The last downloaded is the staging one, so the first ingestion was scheduled in staging, hence the error:

Forge git.abscue.de has 0 scheduled ingest in the scheduler database.

I scheduled the first ingestion manually:

swh@swh-toolbox-7d985b897b-clfcp:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset production \
    schedule-first-visits \
      --type-name git \
      --lister-name gitlab \
      --lister-instance-name git.abscue.de
10000 slots available in celery queue
38 visits to send to celery

relaunched the failed job and updated the pipeline to use only the right artifact.

Request successfully processed in production environment.
For the pipeline details, see:
https://gitlab.softwareheritage.org/swh/infra/add-forge-now-requests/-/pipelines/5913.

closed

changed the description