Deploy next swh version > v131

Actions:

• Tags impacted modules
  • swh.vault v1.9.2
  • swh.deposit v1.3.1
  • swh.web v0.2.41

Includes:

• swh.deposit 1.3.1
• swh.web 0.2.41
• swh.vault 1.9.2

Dependency:

• Migration of the vault cooked data in the azure objstorage (from double gzipped to gzipped) [1] [2]

staging:

• Prepare migration script (based on [3]) [4] [5]
• Migrate azure vault data [3]
• swh/infra/ci-cd/swh-charts@9874e0aa: swh-charts: Adapt vault cache configuration to no longer use compression
• swh/infra/ci-cd/swh-charts!182 (merged): swh-charts: Merge new versions
• Let argocd deploy
• Tag grafana with "deployment service=vault service=web service=deposit environment=staging"
• Checks
  • Cooking is fine
  • Retrieve the cooked bundle is not though [1] [2]
  • Deployment used a legacy configuration, using a connection string fixed the problem [3]

[1] https://sentry.softwareheritage.org/organizations/swh/issues/108401/?project=13&query=is%3Aunresolved

[2] https://sentry.softwareheritage.org/organizations/swh/issues/108402/?project=11&query=is%3Aunresolved

[3] #5103 (comment 153303)

production:

• Migrate azure vault data [6]
• swh/infra/puppet/puppet-swh-site!656 (merged): swh-site: Adapt vault configuration to use connection string (instead of legacy configuration)
• vangogh: Upgrade packages & run puppet agent
• moma, webapp1: Enable puppet & run puppet agent (should upgrade packages too)
• Tag grafana with "deployment service=vault service=web service=deposit environment=production"
• Checks
  • Cook something
  • #5103 (comment 153369): Download is ok

[1] Related to swh/devel/swh-web#4744 (closed)

[2] Related to swh/devel/swh-vault#885 (closed)

[3] swh/devel/swh-web!1163 (merged)

[4] swh/devel/snippets@a06670e4

[5] migrated-in-staging.txt

[6] migrated-in-production.txt

changed milestone to %MRO 2023

added activity::Deployment label

@anlambert jsyk, I've added this task to deal with the vault (among other things ;)

mentioned in merge request swh/infra/ci-cd/swh-charts!182 (merged)

changed the description

mentioned in merge request swh/devel/swh-web!1163 (merged)

changed the description

mentioned in commit swh/devel/snippets@a06670e4

marked the checklist item Migrate azure vault data [3] as completed

staging: Migrate azure vault data

$ python -m migrate_data --config-file ~/.config/swh-azure/config-staging.yaml
INFO:__main__:Push uncompress blob <4db06de6c9bce2c0e2035356453ea8ea6725277b> in container <contents-uncompressed>
INFO:__main__:Push uncompress blob <660c254007a741ee75d7df49e1e67d3abcf980b9> in container <contents-uncompressed>
INFO:__main__:Push uncompress blob <85cb122a4d834330eba9187ab9eacb9cbe70d74e> in container <contents-uncompressed>
INFO:__main__:Push uncompress blob <919a359a123a58a0fb95edbb3c9b71c1c4056686> in container <contents-uncompressed>
INFO:__main__:Push uncompress blob <b9cfa5c38cbbba71e104d537741c2fd26ca8b2c1> in container <contents-uncompressed>
INFO:__main__:Push uncompress blob <d8b6dcfbad12732ab50e10d324e995369556d6b3> in container <contents-uncompressed>

changed the description

mentioned in commit swh/infra/ci-cd/swh-charts@dcd3040a

mentioned in commit swh/infra/ci-cd/swh-charts@9874e0aa

changed the description

marked the checklist item swh/infra/ci-cd/swh-charts@9874e0aa: swh-charts: Adapt vault cache configuration to no longer use compression as completed

marked the checklist item swh/infra/ci-cd/swh-charts!182 (merged): swh-charts: Merge new versions as completed