Add Forge Now - Process https://git.adrian.geek.nz
https://archive.softwareheritage.org/admin/add-forge/request/15/
staging:
-
Schedule oneshot forge instance listing -
Disable origins listed -
Schedule some origins for ingestion -
Stop once some passed (meaning purge rabbitmq queue) [1]
production (same m.o. than ^):
-
Schedule recurring forge instance listing -
Schedule origins for ingestion -
Ensure ingestion started [2]
[1]
loaders [2022-11-08 13:39:46,898: INFO/MainProcess] Task swh.loader.git.tasks.UpdateGitRepository[6a2973cf-8127-4af4-8b0c-a3a610fc7be6] received
loaders [2022-11-08 13:39:47,255: INFO/ForkPoolWorker-1] Load origin 'https://git.adrian.geek.nz/t16-d017-dggs-and-dggs-api-er.git' with type 'git'
loaders [2022-11-08 13:39:55,847: INFO/ForkPoolWorker-1] Listed 1 refs for repo https://git.adrian.geek.nz/t16-d017-dggs-and-dggs-api-er.git
loaders [2022-11-08 13:40:27,412: INFO/ForkPoolWorker-1] Fetched 63 objects; 47 are new
loaders [2022-11-08 13:40:27,523: INFO/ForkPoolWorker-1] Task swh.loader.git.tasks.UpdateGitRepository[6a2973cf-8127-4af4-8b0c-a3a610fc7be6] succeeded in 40.61536749894731s: {'status': 'eventful'}
loaders [2022-11-08 13:40:27,532: INFO/MainProcess] Task swh.loader.git.tasks.UpdateGitRepository[cd73ca76-dfb0-4fe7-bc45-e730aab9d4f9] received
loaders [2022-11-08 13:40:27,819: INFO/ForkPoolWorker-1] Load origin 'https://git.adrian.geek.nz/libdggs.git' with type 'git'
loaders [2022-11-08 13:40:41,436: INFO/ForkPoolWorker-1] Listed 1 refs for repo https://git.adrian.geek.nz/libdggs.git
[2]
14:46:09 softwareheritage-scheduler@belvedere:5432=> select now(), count(distinct url) from listed_origins where lister_id = ( select id from listers where name='cgit' and instance_name='git.adrian.geek.nz') ;
+-------------------------------+-------+
| now | count |
+-------------------------------+-------+
| 2022-11-08 13:47:36.069129+00 | 12 |
+-------------------------------+-------+
(1 row)
14:47:36 softwareheritage-scheduler@belvedere:5432=> select now(), last_visit_status, count(ovs.url) from origin_visit_stats ovs join listed_origins lo on lo.url = ovs.url and lo.visit_type = ovs.visit_type where lister_id = (select id from listers where name='cgit' and instance_name='git.adrian.geek.nz') group by last_visit_status;
+------------------------------+-------------------+-------+
| now | last_visit_status | count |
+------------------------------+-------------------+-------+
| 2022-11-08 13:47:50.46074+00 | successful | 8 |
| 2022-11-08 13:47:50.46074+00 | (null) | 1 |
+------------------------------+-------------------+-------+
(2 rows)
Edited by Antoine R. Dumont