Add forge now - Process https://git.candlhat.org/
Activity
changed milestone to %Extend archive coverage [Roadmap - Collect]
added AddForgeNow label
assigned to @guillaume
On staging environment the pipeline failed, see add-forge-now-requests#39 (closed).
Therefore process manually with abase_git_urlparameter:swh@swh-toolbox-5b9d9b95bc-x8sl2:~$ swh scheduler -C $SWH_CONFIG_FILENAME \ add-forge-now --preset staging \ register-lister gitweb \ instance=git.candlhat.org \ base_git_url=https://git.candlhat.org Created 1 tasks Task 33423073 Next run: today (2023-11-08T16:15:34.581035+00:00) Interval: 1 day, 0:00:00 Type: list-gitweb Policy: oneshot Args: Keyword args: base_git_url: 'https://git.candlhat.org' enable_origins: False instance: 'git.candlhat.org' max_origins_per_page: 10 max_pages: 3Check the new listed origins:
swh@swh-toolbox-5b9d9b95bc-x8sl2:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-listed-origins gitweb git.candlhat.org -l url last_seen last_update --------------------------------------- -------------------------------- -------------------------------- git://git.candlhat.org/dosfstools.git 2023-11-08 11:17:08.026942+00:00 2023-09-20 11:17:07.017217+00:00 git://git.candlhat.org/parted.git 2023-11-08 11:17:08.026942+00:00 2023-06-08 11:17:07.151668+00:00 git://git.candlhat.org/vanadium.git 2023-11-08 11:17:08.026942+00:00 2023-11-08 11:16:09.307804+00:00 git://git.candlhat.org/xar.git 2023-11-08 11:17:08.026942+00:00 2023-10-18 11:17:07.424873+00:00 git://git.candlhat.org/xas.git 2023-11-08 11:17:08.026942+00:00 2023-10-26 11:17:07.569327+00:00 git://git.candlhat.org/xcc.git 2023-11-08 11:17:08.026942+00:00 2023-05-08 11:17:07.727757+00:00 git://git.candlhat.org/xld.git 2023-11-08 11:17:08.026942+00:00 2023-10-27 11:17:07.850655+00:00 git://git.candlhat.org/xmake.git 2023-11-08 11:17:08.026942+00:00 2023-07-08 11:17:08.003633+00:00 https://git.candlhat.org/dosfstools.git 2023-11-08 16:26:38.491693+00:00 2023-09-20 16:26:37.440525+00:00 https://git.candlhat.org/parted.git 2023-11-08 16:26:38.491693+00:00 2023-06-08 16:26:37.605071+00:00 https://git.candlhat.org/vanadium.git 2023-11-08 16:26:38.491693+00:00 2023-11-08 11:26:37.787315+00:00 https://git.candlhat.org/xar.git 2023-11-08 16:26:38.491693+00:00 2023-10-11 16:26:37.923801+00:00 https://git.candlhat.org/xas.git 2023-11-08 16:26:38.491693+00:00 2023-10-25 16:26:38.113130+00:00 https://git.candlhat.org/xcc.git 2023-11-08 16:26:38.491693+00:00 2023-05-08 16:26:38.263067+00:00 https://git.candlhat.org/xld.git 2023-11-08 16:26:38.491693+00:00 2023-10-27 16:26:38.402563+00:00 https://git.candlhat.org/xmake.git 2023-11-08 16:26:38.491693+00:00 2023-07-08 16:26:38.574327+00:00 Forge git.candlhat.org (gitweb) has 16 listed origins in the scheduler database.Schedule the first ingestion:
swh@swh-toolbox-5b9d9b95bc-x8sl2:~$ swh scheduler -C $SWH_CONFIG_FILENAME \ add-forge-now --preset staging \ schedule-first-visits \ --type-name git \ --lister-name gitweb \ --lister-instance-name git.candlhat.org 998 slots available in celery queue 16 visits to send to celeryThe first ingestion of the
httpsorigins is successfully completed:swh@swh-toolbox-5b9d9b95bc-x8sl2:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-ingested-origins gitweb git.candlhat.org -l url last_visit_status last_visit --------------------------------------- ------------------- -------------------------------- git://git.candlhat.org/dosfstools.git failed 2023-11-08 17:27:10.504031+00:00 git://git.candlhat.org/parted.git failed 2023-11-08 17:29:21.543493+00:00 git://git.candlhat.org/vanadium.git failed 2023-11-08 17:31:32.615654+00:00 git://git.candlhat.org/xar.git failed 2023-11-08 17:33:43.672938+00:00 git://git.candlhat.org/xas.git failed 2023-11-08 17:35:54.772477+00:00 git://git.candlhat.org/xcc.git failed 2023-11-08 17:38:05.845629+00:00 git://git.candlhat.org/xld.git failed 2023-11-08 17:40:16.891178+00:00 git://git.candlhat.org/xmake.git failed 2023-11-08 17:42:01.702868+00:00 https://git.candlhat.org/dosfstools.git successful 2023-11-08 16:34:27.895471+00:00 https://git.candlhat.org/parted.git successful 2023-11-08 16:34:54.278357+00:00 https://git.candlhat.org/vanadium.git successful 2023-11-08 17:14:34.743618+00:00 https://git.candlhat.org/xar.git successful 2023-11-08 17:15:33.579079+00:00 https://git.candlhat.org/xas.git successful 2023-11-08 17:20:59.081590+00:00 https://git.candlhat.org/xcc.git successful 2023-11-08 17:23:47.900945+00:00 https://git.candlhat.org/xld.git successful 2023-11-08 17:25:00.746604+00:00 https://git.candlhat.org/xmake.git successful 2023-11-08 16:32:35.551131+00:00 Forge git.candlhat.org (gitweb) has 16 scheduled ingests in the scheduler. failed : 8 None : 0 not_found : 0 successful : 8 total : 16 success rate : 50.0%On production environment:
swh@swh-toolbox-d966b449c-7r7w2:~$ swh scheduler -C $SWH_CONFIG_FILENAME \ add-forge-now --preset production \ register-lister gitweb \ instance=git.candlhat.org \ base_git_url=https://git.candlhat.org Created 1 tasks Task 415914157 Next run: today (2023-11-09T08:36:07.084200+00:00) Interval: 1 day, 0:00:00 Type: list-gitweb Policy: recurring Args: Keyword args: base_git_url: 'https://git.candlhat.org' instance: 'git.candlhat.org'Check the listed origins:
swh@swh-toolbox-d966b449c-7r7w2:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-listed-origins gitweb git.candlhat.org -l url last_seen last_update --------------------------------------- -------------------------------- -------------------------------- https://git.candlhat.org/dosfstools.git 2023-11-09 08:36:19.485048+00:00 2023-09-21 08:36:18.391655+00:00 [...] https://git.candlhat.org/xmake.git 2023-11-09 08:36:19.485048+00:00 2023-07-09 08:36:19.475807+00:00 Forge git.candlhat.org (gitweb) has 8 listed origins in the scheduler database.Schedule the first ingestion:
swh@swh-toolbox-d966b449c-7r7w2:~$ swh scheduler -C $SWH_CONFIG_FILENAME \ add-forge-now --preset production \ schedule-first-visits \ --type-name git \ --lister-name gitweb \ --lister-instance-name git.candlhat.org 10000 slots available in celery queue 8 visits to send to celeryThe first ingestion is successfully completed:
swh@swh-toolbox-d966b449c-7r7w2:~$ swh scheduler -C $SWH_CONFIG_FILENAME origin check-ingested-origins gitweb git.candlhat.org Forge git.candlhat.org (gitweb) has 8 scheduled ingests in the scheduler. failed : 0 None : 0 not_found : 0 successful : 8 total : 8 success rate : 100.0%
Please register or sign in to reply