staging: ingest https://gogs.univ-littoral.fr forge

repos available here: https://gogs.univ-littoral.fr/explore/repos

• Listing with v4.0 ok? NO
• Determine where the api is at: <gogs_instance_url>/api/v1/repos/search
• Update code docstring on gogs lister to reference ^
• Patch lister to let public listing happen [1]
• Deploy new version
• Schedule origin [2]
• Check listing output [3]
• Force scheduling of some of those origins [4]
• Await ingestion [5]

[1] https://forge.softwareheritage.org/D8752

[2]

swhscheduler@scheduler0:~$ swh scheduler --url http://scheduler0.internal.staging.swh.network:5008/ task add -p oneshot list-gogs-full url=https://gogs.univ-littoral.fr/api/v1/
Created 1 tasks

Task 33419798
  Next run: today (2022-10-24T11:57:12.775114+00:00)
  Interval: 90 days, 0:00:00
  Type: list-gogs-full
  Policy: oneshot
  Args:
  Keyword args:
    url: 'https://gogs.univ-littoral.fr/api/v1/'

[3]

│ listers [2022-10-24 11:58:00,209: INFO/MainProcess] Connected to amqp://swhconsumer:**@scheduler0.internal.staging.swh.network:5672//                                                                                                       │
│ listers [2022-10-24 11:58:00,311: INFO/MainProcess] lister@lister-gogs-full-5894cdb64f-q5kkm ready.                                                                                                                                         │
│ listers [2022-10-24 11:58:00,318: INFO/MainProcess] Task swh.lister.gogs.tasks.FullGogsRelister[09c5d56d-a3c4-477f-9c86-cf42b5f825e4] received                                                                                              │
│ listers [2022-10-24 11:58:00,671: WARNING/ForkPoolWorker-1] No authentication token set in configuration, using anonymous mode                                                                                                              │
│ listers [2022-10-24 11:58:01,673: INFO/ForkPoolWorker-1] Task swh.lister.gogs.tasks.FullGogsRelister[09c5d56d-a3c4-477f-9c86-cf42b5f825e4] succeeded in 1.175250596832484s: {'pages': 1, 'origins': 12}

14:00:10 swh-scheduler@db1:5432=> select now(), count(*) from listed_origins where lister_id = ( select id from listers where name='gogs' and instance_name='gogs.univ-littoral.fr') ;
+-------------------------------+-------+
|              now              | count |
+-------------------------------+-------+
| 2022-10-24 12:00:23.208886+00 |    12 |
+-------------------------------+-------+
(1 row)

Time: 13.372 ms

[4]

swhscheduler@scheduler0:~$ swh scheduler -C /etc/softwareheritage/scheduler/listener-runner.yml origin send-to-celery --lister-uuid '4e915c1b-746e-423c-9bc3-e6aad3faf9ef' git
3 slots available in celery queue
3 visits to send to celery

[5] https://webapp.staging.swh.network/browse/search/?q=gogs-univ&with_visit=true&with_content=true