Add forge now - process https://gitlab.softwareheritage.org/

staging:

Trigger listing scheduling [1]
Trigger ingestion scheduling [2] [3]

[1]

swhscheduler@scheduler0:~$ swh scheduler --config-file $CONFIG \
>   add-forge-now --preset staging \
>     register-lister $LISTER_NAME \
>       url=$FORGE_URL
Created 1 tasks

Task 33420932
  Next run: today (2023-04-03T15:02:40.024966+00:00)
  Interval: 90 days, 0:00:00
  Type: list-gitlab-full
  Policy: oneshot
  Args:
  Keyword args:
    enable_origins: False
    max_origins_per_page: 10
    max_pages: 3
    url: 'https://gitlab.softwareheritage.org/api/v4'

[2]

swhscheduler@scheduler0:~$ swh scheduler --config-file $CONFIG   add-forge-now --preset staging   schedule-first-visits     --type-name git     --lister-name $LISTER_NAME     --lister-instance-name $LISTER_INSTANCE_NAME
100 slots available in celery queue
30 visits to send to celery

Ingestion ongoing:

│ swh             loader-addforgenow-d797564b8-cr88f      ●      1/1                  0 Running            1     148           0         n/a          58         n/a 10.42.233.189       rancher-node-staging-rke2-worker2       3m29s        │
│ swh             loader-addforgenow-d797564b8-hmq78      ●      1/1                  0 Running            1     122           0         n/a          48         n/a 10.42.18.207        rancher-node-staging-rke2-worker3       3m32s        │

changed milestone to %Extend archive coverage [Roadmap - Collect]

production:

listing
ingestion

swhscheduler@saatchi:~$ swh scheduler --config-file $CONFIG \
>   add-forge-now --preset production \
>     register-lister $LISTER_NAME \
>       url=$FORGE_URL
Created 1 tasks

Task 415364363
  Next run: today (2023-04-03T15:20:50.494925+00:00)
  Interval: 90 days, 0:00:00
  Type: list-gitlab-full
  Policy: recurring
  Args:
  Keyword args:
    url: 'https://gitlab.softwareheritage.org/api/v4'

Created 1 tasks

Task 415364364
  Next run: tomorrow (2023-04-04T15:20:50.594769+00:00)
  Interval: 1 day, 0:00:00
  Type: list-gitlab-incremental
  Policy: recurring
  Args:
  Keyword args:
    url: 'https://gitlab.softwareheritage.org/api/v4'

swhscheduler@saatchi:~$ swh scheduler --config-file $CONFIG \
>   add-forge-now --preset production \
>   schedule-first-visits \
>   --type-name git \
>   --lister-name $LISTER_NAME \
>   --lister-instance-name $LISTER_INSTANCE_NAME
10000 slots available in celery queue
354 visits to send to celery

closed

cc @bchauvet ^

added 1h of time spent

assigned to @ardumont

added activity::Processing label

Add forge now - process https://gitlab.softwareheritage.org/

Designs

Child items ...

Activity