Deploy new swh.loader.metadata journal client
Plan:
-
Tag new release 1.0.0 -
swh-apps: Add declaration to build docker image -
Jenkins: Build docker image ^ [2] -
Added credentials to the private repository -
33 swh-charts: Add chart for the loader-metadata (with tests) -
(optional) swh/devel/swh-docs!341 (merged): Update documention on deployment -
(optional) swh/devel/swh-docs!342 (merged): Mention labels in documentation -
Deploy to staging -
Update staging.yaml to reference loader-metadata configuration -
Install 'swh/loader-metadata=true' label on kubernetes nodes -
failing -
10: loader-metadata repository needs to be updated (thx @vlorentz & @olasd) -
Adapt entrypoint.sh -
Rebuild image -
Update values -
Checks -
fixed: missing mandatory configuration key -
fixed: empty password (chart misconfiguration) -
fixed: missing credentials to retrieve from authenticated api -
fixed: misconfigured broker connection port (now that we use authenticated connection for staging as well) -
fixed: misconfigured internal url instead of the public broker
-
-
Consumption ETA on grafana -
Check auto-scaling is fine
-
-
val: Check staging dataset is in the right shape (regarding the runs done started around ~1 week) -
origin metadata [3] got ingested without any associated loader
-
-
Deploy to production -
Create user for loader-metadata journal clients to authenticate -
Install 'swh/loader-metadata=true' label on kubernetes nodes -
swh/infra/ci-cd/swh-charts!40 (merged): Activate loader-metadata in production -
Status: https://grafana.softwareheritage.org/goto/6HYS1fBVk?orgId=1 -
Checks -
2 journal clients are running [4] -
relevant data? [5] [6]
-
-
[1] #4766 (closed)
[2] https://jenkins.softwareheritage.org/job/swh-apps/job/build-docker-image/build?delay=0sec
[4]
│ swh loader-metadata-dcf5dd554-6wzqm ● 1/1 0 Running 0 0 0 n/a 0 n/a 10.42.52.119 rancher-node-metal02 53s │
│ swh loader-metadata-dcf5dd554-vxjwh ● 1/1 0 Running 0 0 0 n/a 0 n/a 10.42.239.190 rancher-node-metal01 37s │
[6]
18:08 <+ardumont> https://archive.softwareheritage.org/api/1/raw-extrinsic-metadata/swhid/swh:1:ori:002d4b4a6233e16d93016518cef3b92cc6c9880e/?authority=forge%20https://github.com
18:08 <+ardumont> this one too
18:08 <+ardumont> https://archive.softwareheritage.org/browse/origin/visits/?origin_url=https://github.com/snichele/scala-code-snippets
18:08 <+ardumont> no visit since 2019
part of swh/meta#4252
Edited by Antoine R. Dumont