Add forge now - Process https://git.in-ulm.de/
Activity
changed milestone to %Extend archive coverage [Roadmap - Collect]
added AddForgeNow label
assigned to @guillaume
On staging environment:
swhscheduler@scheduler0:~$ swh scheduler --url http://scheduler0.internal.staging.swh.network:5008/ \ > add-forge-now --preset staging \ > register-lister gogs \ > instance=git.in-ulm.de Created 1 tasks Task 33421661 Next run: today (2023-06-22T09:56:29.059403+00:00) Interval: 90 days, 0:00:00 Type: list-gogs-full Policy: oneshot Args: Keyword args: enable_origins: False instance: 'git.in-ulm.de' max_origins_per_page: 10 max_pages: 3Check the registered lister and the listed origins:
swh-scheduler=> select * from listers where name='gogs' and instance_name='git.in-ulm.de'; id | name | instance_name | created | current_state | updated --------------------------------------+------+---------------+-------------------------------+---------------------------------------------------------+------------------------------- 6c5c0b8f-9207-41e8-a55e-c2e111d2919e | gogs | git.in-ulm.de | 2023-06-22 09:35:53.875624+00 | {"last_seen_repo_id": 151, "last_seen_next_link": null} | 2023-06-22 09:56:38.485716+00 (1 row) swh-scheduler=> select lister_id, url, visit_type from listed_origins where lister_id = (select id from listers where name='gogs' and instance_name='git.in-ulm.de'); lister_id | url | visit_type --------------------------------------+------------------------------------------------------------------------------+------------ 6c5c0b8f-9207-41e8-a55e-c2e111d2919e | https://git.in-ulm.de/in-ulm/RemoteSupportTool.git | git 6c5c0b8f-9207-41e8-a55e-c2e111d2919e | https://git.in-ulm.de/verchow/ansible-playbook-smartos-debian-lx-builder.git | git 6c5c0b8f-9207-41e8-a55e-c2e111d2919e | https://git.in-ulm.de/verchow/ansible-role-anaconda.git | git 6c5c0b8f-9207-41e8-a55e-c2e111d2919e | https://git.in-ulm.de/cbiedl/bgpdump.git | git 6c5c0b8f-9207-41e8-a55e-c2e111d2919e | https://git.in-ulm.de/verchow/hanna_rechnet.git | git 6c5c0b8f-9207-41e8-a55e-c2e111d2919e | https://git.in-ulm.de/ulpeters/startup.git | git (6 rows)Schedule first ingests:
swhscheduler@scheduler0:~$ swh scheduler --url http://scheduler0.internal.staging.swh.network:5008/ \ > add-forge-now --preset staging \ > schedule-first-visits \ > --type-name git \ > --lister-name gogs \ > --lister-instance-name git.in-ulm.de 98 slots available in celery queue 6 visits to send to celeryOn staging environment all first ingests are successfully completed:
swh-scheduler=> select visit_type, url, last_visit_status from origin_visit_stats where visit_type='git' and url like 'https://git.in-ulm.de%'; visit_type | url | last_visit_status ------------+------------------------------------------------------------------------------+------------------- git | https://git.in-ulm.de/in-ulm/RemoteSupportTool.git | successful git | https://git.in-ulm.de/verchow/ansible-playbook-smartos-debian-lx-builder.git | successful git | https://git.in-ulm.de/verchow/ansible-role-anaconda.git | successful git | https://git.in-ulm.de/cbiedl/bgpdump.git | successful git | https://git.in-ulm.de/verchow/hanna_rechnet.git | successful git | https://git.in-ulm.de/ulpeters/startup.git | successful (6 rows)On production environment:
swhscheduler@saatchi:~$ swh scheduler --url http://saatchi.internal.softwareheritage.org:5008/ \ > add-forge-now --preset production \ > register-lister gogs \ > instance=git.in-ulm.de Created 1 tasks Task 415502613 Next run: today (2023-06-22T11:48:40.090592+00:00) Interval: 90 days, 0:00:00 Type: list-gogs-full Policy: recurring Args: Keyword args: instance: 'git.in-ulm.de'Check the registered lister and the listed origins:
softwareheritage-scheduler=> select * from listers where name='gogs' and instance_name='git.in-ulm.de'; id | name | instance_name | created | current_state | updated --------------------------------------+------+---------------+-------------------------------+---------------------------------------------------------+------------------------------- 268c4f31-add2-4f59-8927-83d18eca2e7b | gogs | git.in-ulm.de | 2023-06-22 11:49:30.009405+00 | {"last_seen_repo_id": 151, "last_seen_next_link": null} | 2023-06-22 11:49:30.316152+00 (1 row) softwareheritage-scheduler=> select lister_id, url, visit_type from listed_origins where lister_id = (select id from listers where name='gogs' and instance_name='git.in-ulm.de'); lister_id | url | visit_type --------------------------------------+------------------------------------------------------------------------------+------------ 268c4f31-add2-4f59-8927-83d18eca2e7b | https://git.in-ulm.de/cbiedl/bgpdump.git | git 268c4f31-add2-4f59-8927-83d18eca2e7b | https://git.in-ulm.de/in-ulm/RemoteSupportTool.git | git 268c4f31-add2-4f59-8927-83d18eca2e7b | https://git.in-ulm.de/ulpeters/startup.git | git 268c4f31-add2-4f59-8927-83d18eca2e7b | https://git.in-ulm.de/verchow/ansible-playbook-smartos-debian-lx-builder.git | git 268c4f31-add2-4f59-8927-83d18eca2e7b | https://git.in-ulm.de/verchow/ansible-role-anaconda.git | git 268c4f31-add2-4f59-8927-83d18eca2e7b | https://git.in-ulm.de/verchow/hanna_rechnet.git | git (6 rows)Schedule first ingests:
swhscheduler@saatchi:~$ swh scheduler --url http://saatchi.internal.softwareheritage.org:5008/ \ > add-forge-now --preset production \ > schedule-first-visits \ > --type-name git \ > --lister-name gogs \ > --lister-instance-name git.in-ulm.de 10000 slots available in celery queue 6 visits to send to celeryOn production environment all first ingests are successfully completed:
softwareheritage-scheduler=> select last_visit_status, count(ovs.url) from origin_visit_stats ovs join listed_origins lo USING(url, visit_type) where lister_id = (select id from listers where name='gogs' and instance_name='git.in-ulm.de') and visit_type='git' group by last_visit_status; last_visit_status | count -------------------+------- successful | 6 (1 row)mentioned in issue swh/devel/swh-lister#4698 (closed)
Please register or sign in to reply