[Add Forge Now] process https://git.kyleam.com
https://webapp.staging.swh.network/admin/add-forge/request/67/
Type: cgit
Production request: https://archive.softwareheritage.org/admin/add-forge/request/285/
Activity
- A deleted user
changed milestone to %Extend archive coverage [Roadmap - Collect]
- A deleted user
added AddForgeNow label
Request successfully processed in staging environment.
For the pipeline details, see:
https://gitlab.softwareheritage.org/swh/infra/add-forge-now-requests/-/pipelines/5717.Request successfully processed in production environment.
For the pipeline details, see:
https://gitlab.softwareheritage.org/swh/infra/add-forge-now-requests/-/pipelines/5717.- A deleted user
closed
The production ingestion results are inconsistent, 10 listed origins produce 2 ingested origins.
Checking the database:softwareheritage-scheduler=> select * from task where arguments -> 'kwargs' ->> 'instance' = 'git.kyleam.com' or arguments -> 'kwargs' ->> 'url' like '%git.kyleam.com%'; id | type | arguments | next_run | current_interval | status | policy | retries_left | priority -----------+-----------+----------------------------------------------------------------+-------------------------------+------------------+------------------------+-----------+--------------+---------- 415998446 | list-cgit | {"args": [], "kwargs": {"instance": "git.kyleam.com"}} | 2024-02-03 09:18:24.235471+00 | 64 days | next_run_not_scheduled | recurring | 3 | 411154921 | load-git | {"args": [], "kwargs": {"url": "https://git.kyleam.com/piem"}} | 2022-05-03 11:57:29.658879+00 | 64 days | completed | oneshot | 3 | high (2 rows)softwareheritage-scheduler=> select * from listers where instance_name like '%git.kyleam.com%'; id | name | instance_name | created | current_state | updated --------------------------------------+------+----------------+-------------------------------+---------------+------------------------------- 01cd62d3-bb34-45f5-878d-62da2acb394b | cgit | git.kyleam.com | 2023-12-01 09:18:22.301298+00 | {} | 2023-12-01 09:18:22.301298+00 (1 row)softwareheritage-scheduler=> select url,enabled,last_seen from listed_origins where lister_id = '01cd62d3-bb34-45f5-878d-62da2acb394b'; url | enabled | last_seen -------------------------------------------------+---------+------------------------------- https://git.kernel.org/pub/scm/utils/b4/b4.git/ | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/annexview | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/emacs.d | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/guix-packages | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/ob-stan | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/org-link-edit | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/orgmode-backport-notes | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/piem | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/snakemake-mode | t | 2023-12-01 09:18:24.048733+00 https://github.com/kyleam/bog.git | t | 2023-12-01 09:18:24.048733+00 (10 rows)softwareheritage-scheduler=> select last_visit_status, ovs.url from origin_visit_stats ovs join listed_origins lo USING(url, visit_type) where lister_id = (select id from listers where name='cgit' and instance_name='git.kyleam.com') and visit_type='git'; last_visit_status | url -------------------+--------------------------------------- successful | https://git.kyleam.com/piem successful | https://git.kyleam.com/snakemake-mode (2 rows)After processing all the missing origins with save-code-now:
softwareheritage-scheduler=> select url,enabled,last_seen from listed_origins where lister_id = '01cd62d3-bb34-45f5-878d-62da2acb394b'; url | enabled | last_seen -------------------------------------------------+---------+------------------------------- https://git.kernel.org/pub/scm/utils/b4/b4.git/ | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/annexview | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/emacs.d | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/guix-packages | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/ob-stan | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/org-link-edit | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/orgmode-backport-notes | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/piem | t | 2023-12-01 09:18:24.048733+00 https://git.kyleam.com/snakemake-mode | t | 2023-12-01 09:18:24.048733+00 https://github.com/kyleam/bog.git | t | 2023-12-01 09:18:24.048733+00 (10 rows) softwareheritage-scheduler=> select last_visit_status, ovs.url from origin_visit_stats ovs join listed_origins lo USING(url, visit_type) where lister_id = (select id from listers where name='cgit' and instance_name='git.kyleam.com') and visit_type='git'; last_visit_status | url -------------------+------------------------------------------------- successful | https://git.kernel.org/pub/scm/utils/b4/b4.git/ successful | https://git.kyleam.com/annexview successful | https://git.kyleam.com/emacs.d successful | https://git.kyleam.com/guix-packages successful | https://git.kyleam.com/ob-stan successful | https://git.kyleam.com/org-link-edit successful | https://git.kyleam.com/orgmode-backport-notes successful | https://git.kyleam.com/piem successful | https://git.kyleam.com/snakemake-mode successful | https://github.com/kyleam/bog.git (10 rows)
Please register or sign in to reply