Add forge now - Process https://code.ffdn.org

Request: https://archive.softwareheritage.org/admin/add-forge/request/22/

staging:

• Register forge to list [1]
• Trigger scheduling of listed origins [2]
• Checks [3]

production:

• Register forge to list [4]
• Trigger scheduling of listed origins [5]
• Checks [6]

[1]

swhscheduler@scheduler0:~$ SCHEDULER_RPC=http://scheduler0.internal.staging.swh.network:5008/
swhscheduler@scheduler0:~$ LISTER_NAME=gitlab
swhscheduler@scheduler0:~$ LISTER_INSTANCE_NAME=code.ffdn.org
swhscheduler@scheduler0:~$ FORGE_URL=https://$LISTER_INSTANCE_NAME/api/v4
swhscheduler@scheduler0:~$
swhscheduler@scheduler0:~$ swh scheduler --url $SCHEDULER_RPC \
>   add-forge-now --preset staging \
>     register-lister $LISTER_NAME \
>       url=$FORGE_URL

Created 1 tasks

Task 33420196
  Next run: today (2023-01-04T14:56:23.109065+00:00)
  Interval: 90 days, 0:00:00
  Type: list-gitlab-full
  Policy: oneshot
  Args:
  Keyword args:
    enable_origins: False
    max_origins_per_page: 10
    max_pages: 3
    url: 'https://code.ffdn.org/api/v4'

[2]

swhscheduler@scheduler0:~$ swh scheduler --url $SCHEDULER_RPC \
>   add-forge-now --preset staging \
>   schedule-first-visits \
>     --type-name git \
>     --lister-name $LISTER_NAME \
>     --lister-instance-name $LISTER_INSTANCE_NAME
100 slots available in celery queue
20 visits to send to celery

[3]

2023-01-04 15:59:05 swh-scheduler@db1:5432 λ select last_visit_status, count(ovs.url)
from origin_visit_stats ovs
join listed_origins lo USING(url, visit_type)
where lister_id = (select id from listers
                   where name='gitlab' and
                   instance_name='code.ffdn.org')
and visit_type='git'
group by last_visit_status;
+-------------------+-------+
| last_visit_status | count |
+-------------------+-------+
| successful        |     2 |
| (null)            |    18 |
+-------------------+-------+
(2 rows)

Time: 1677.929 ms (00:01.678)

[4]

swhscheduler@saatchi:~$ LISTER_NAME=gitlab
swhscheduler@saatchi:~$ LISTER_INSTANCE_NAME=code.ffdn.org
swhscheduler@saatchi:~$ FORGE_URL=https://$LISTER_INSTANCE_NAME/api/v4
swhscheduler@saatchi:~$ SCHEDULER_RPC=http://saatchi.internal.softwareheritage.org:5008/
swhscheduler@saatchi:~$ swh scheduler --url $SCHEDULER_RPC \
>   add-forge-now \
>     register-lister $LISTER_NAME \
>       url=$FORGE_URL
Created 1 tasks

Task 415264830
  Next run: today (2023-01-04T15:15:46.031637+00:00)
  Interval: 90 days, 0:00:00
  Type: list-gitlab-full
  Policy: recurring
  Args:
  Keyword args:
    url: 'https://code.ffdn.org/api/v4'

Created 1 tasks

Task 415264831
  Next run: tomorrow (2023-01-05T15:15:46.104353+00:00)
  Interval: 1 day, 0:00:00
  Type: list-gitlab-incremental
  Policy: recurring
  Args:
  Keyword args:
    url: 'https://code.ffdn.org/api/v4'

[5]

swhscheduler@saatchi:~$ swh scheduler --url $SCHEDULER_RPC \
>   add-forge-now \
>   schedule-first-visits \
>     --type-name git \
>     --lister-name $LISTER_NAME \
>     --lister-instance-name $LISTER_INSTANCE_NAME
10000 slots available in celery queue
116 visits to send to celery

[6]

2023-01-04 16:17:30 softwareheritage-scheduler@belvedere:5432 λ select last_visit_status, count(ovs.url)
from origin_visit_stats ovs
join listed_origins lo USING(url, visit_type)
where lister_id = (select id from listers
                   where name='gitlab' and
                   instance_name='code.ffdn.org')
and visit_type='git'
group by last_visit_status;
+-------------------+-------+
| last_visit_status | count |
+-------------------+-------+
| successful        |     2 |
| (null)            |   114 |
+-------------------+-------+
(2 rows)

Time: 120403.082 ms (02:00.403)