Skip to content

Deploy Gogs lister to staging

Deploy Gogs lister to staging. It lists 'git' origins (nothing to do for loader).

Plan:

  • Register task type to scheduler [1]

  • Register swhbot account on the gogs site (try.gogs.io for the tryout)

  • Generate access token and install it in the credential repository

  • Update charts with new lister

  • Schedule a gogs forge to list [2]

  • Checks

    • Does not finish properly, gets stuck behind T4533.
    • Release v3.0.2 with the fix deployed -> 160 origins listed
  • [1]

10:25:14 swh-scheduler@db1:5432=> select * from task_type where type like 'list-gogs%';
+----------------+--------------------------------+----------------------------------------+------------------+--------------+--------------+----------------+------------------+-------------+-------------+
|      type      |          description           |              backend_name              | default_interval | min_interval | max_interval | backoff_factor | max_queue_length | num_retries | retry_delay |
+----------------+--------------------------------+----------------------------------------+------------------+--------------+--------------+----------------+------------------+-------------+-------------+
| list-gogs-full | Full update of a Gogs instance | swh.lister.gogs.tasks.FullGogsRelister | 90 days          | 90 days      | 90 days      |              1 |             1000 |      (null) | (null)      |
+----------------+--------------------------------+----------------------------------------+------------------+--------------+--------------+----------------+------------------+-------------+-------------+
(1 row)

Time: 1159.368 ms (00:01.159)
  • [2]
swhscheduler@scheduler0:~$ swh scheduler --url http://scheduler0.internal.staging.swh.network:5008/ task add list-gogs-full https://try.gogs.io/api/v1/
Created 1 tasks

Task 33419470
  Next run: today (2022-09-13T09:12:08.867813+00:00)
  Interval: 90 days, 0:00:00
  Type: list-gogs-full
  Policy: recurring
  Args:
    'https://try.gogs.io/api/v1/'
  Keyword args:
13:52:08 swh-scheduler@db1:5432=> select now(), visit_type, count(*) from listed_origins where lister_id = ( select id from listers where name='gogs') group by visit_type;
+-------------------------------+------------+-------+
|              now              | visit_type | count |
+-------------------------------+------------+-------+
| 2022-09-21 11:52:14.859315+00 | git        |   160 |
+-------------------------------+------------+-------+
(1 row)

Time: 81.638 ms

Migrated from T4478 (view on Phabricator)

Edited by Antoine R. Dumont