Skip to content

Add Forge Now - Process https://git.adrian.geek.nz

https://archive.softwareheritage.org/admin/add-forge/request/15/

staging:

  • Schedule oneshot forge instance listing
  • Disable origins listed
  • Schedule some origins for ingestion
  • Stop once some passed (meaning purge rabbitmq queue) [1]

production (same m.o. than ^):

  • Schedule recurring forge instance listing
  • Schedule origins for ingestion
  • Ensure ingestion started [2]

[1]

loaders [2022-11-08 13:39:46,898: INFO/MainProcess] Task swh.loader.git.tasks.UpdateGitRepository[6a2973cf-8127-4af4-8b0c-a3a610fc7be6] received
loaders [2022-11-08 13:39:47,255: INFO/ForkPoolWorker-1] Load origin 'https://git.adrian.geek.nz/t16-d017-dggs-and-dggs-api-er.git' with type 'git'
loaders [2022-11-08 13:39:55,847: INFO/ForkPoolWorker-1] Listed 1 refs for repo https://git.adrian.geek.nz/t16-d017-dggs-and-dggs-api-er.git
loaders [2022-11-08 13:40:27,412: INFO/ForkPoolWorker-1] Fetched 63 objects; 47 are new
loaders [2022-11-08 13:40:27,523: INFO/ForkPoolWorker-1] Task swh.loader.git.tasks.UpdateGitRepository[6a2973cf-8127-4af4-8b0c-a3a610fc7be6] succeeded in 40.61536749894731s: {'status': 'eventful'}
loaders [2022-11-08 13:40:27,532: INFO/MainProcess] Task swh.loader.git.tasks.UpdateGitRepository[cd73ca76-dfb0-4fe7-bc45-e730aab9d4f9] received
loaders [2022-11-08 13:40:27,819: INFO/ForkPoolWorker-1] Load origin 'https://git.adrian.geek.nz/libdggs.git' with type 'git'
loaders [2022-11-08 13:40:41,436: INFO/ForkPoolWorker-1] Listed 1 refs for repo https://git.adrian.geek.nz/libdggs.git

[2]

14:46:09 softwareheritage-scheduler@belvedere:5432=> select now(), count(distinct url) from listed_origins where lister_id = ( select id from listers where name='cgit' and instance_name='git.adrian.geek.nz') ;
+-------------------------------+-------+
|              now              | count |
+-------------------------------+-------+
| 2022-11-08 13:47:36.069129+00 |    12 |
+-------------------------------+-------+
(1 row)
14:47:36 softwareheritage-scheduler@belvedere:5432=> select now(), last_visit_status, count(ovs.url) from origin_visit_stats ovs join listed_origins lo on lo.url = ovs.url and lo.visit_type = ovs.visit_type where lister_id = (select id from listers where name='cgit' and instance_name='git.adrian.geek.nz') group by last_visit_status;
+------------------------------+-------------------+-------+
|             now              | last_visit_status | count |
+------------------------------+-------------------+-------+
| 2022-11-08 13:47:50.46074+00 | successful        |     8 |
| 2022-11-08 13:47:50.46074+00 | (null)            |     1 |
+------------------------------+-------------------+-------+
(2 rows)
Edited by Antoine R. Dumont