Commits · 454956ba40ee2bbfa832f9c6b0331b7b2ac2ea9c · Platform / Infrastructure / CI CD / Helm charts for swh packages

Aug 26, 2024
- swh/counters: Avoid refresh_history cronjob infinite retries · 454956ba
  Vincent Sellier authored 7 months ago
  
  - Use the retry command line - Split the rpc checks from the refresh endpoint call - Fix a couple of minor side issues Related to swh/infra/sysadm-environment#5387
  454956ba
- swh/web: Fix webapp autoscaling condition · 2ead92fe
  Vincent Sellier authored 7 months ago
  
  2ead92fe
- swh: Don't log each call to azure storage in swh objstorages · 08900b6d
  Vincent Sellier authored 7 months ago
  
  08900b6d
Aug 22, 2024
- v351: Release swh.web v0.6.0 · 0b4bf025
  Jenkins for Software Heritage authored 7 months ago and Vincent Sellier committed 7 months ago
  
  0b4bf025
- v350: Release swh.vault v1.12.3 · 323a44df
  Jenkins for Software Heritage authored 7 months ago and Vincent Sellier committed 7 months ago
  
  323a44df
- swh/staging: hardcode the webhook webapp scaling · 8c39cd72
  Vincent Sellier authored 7 months ago
  
  Same reason as for the production
  8c39cd72
- swh/production: hardcode the webhook webapp scaling · 3ff0651c
  Vincent Sellier authored 7 months ago
  
  The number of requests sent to the ingress is known and limited so the number of webapp can be fined managed. It allows to remove all the autoscaling configuration.
  3ff0651c
- (temporarily) Disable scrubbers on the secondary db · d1d3a962
  Nicolas Dandrimont authored 7 months ago
  
  Ref. swh/infra/sysadm-environment#5369
  d1d3a962
Aug 21, 2024
- v349: Release swh.dataset v1.7.0 · 924c08c4
  Jenkins for Software Heritage authored 7 months ago and Vincent Sellier committed 7 months ago
  
  924c08c4
- swh/production: Declare cassandra11 node (monitoring and seed) · 095de42a
  Vincent Sellier authored 7 months ago
  
  Related to swh/infra/sysadm-environment#5386
  095de42a
Aug 20, 2024

components: Reduce false positive ingress alerts · a7976a75

Vincent Sellier authored 7 months ago

Use only 5XX errors to detect errors ratio.
Using the 4XX status can trigger false positive alerting
for some incomplete object storage or the webapp when
quota are exceeded

As there is now only 500 errors, the threshold can be reduced.
During the last month, it seems a the 10% error rate was
reached when real incident happened.

a7976a75

Aug 19, 2024
- swh/web: Expose /static/robots.txt under /robots.txt · 126ee194
  Vincent Sellier authored 7 months ago
  
  Use a dedicated ingress to use a regexp. It adds more flexibility on the static resource management Related to swh/infra/sysadm-environment#5383
  126ee194
- swh/web: Use a real endpoint as probe instead of a 301 redirect · e0d71887
  Vincent Sellier authored 7 months ago
  
  e0d71887
- swh: Reduce rpc services log level to reduce the pressure on the log infra · 8e8fc49a
  Vincent Sellier authored 7 months ago
  
  8e8fc49a
Aug 16, 2024
- staging: Switch deposit db access to the kube managed db · 582d7e15
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5379
  582d7e15
- staging: Manage swh-deposit postgresql db through kubernetes · eeb2e9a6
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5379
  eeb2e9a6
Aug 15, 2024

swh/production: Increase the read-only storage replicas · 223f5590

Vincent Sellier authored 7 months ago

Even if the cpu is not a good metrics, reducing this
ratio allow to start more replicas of the read-only storage.
It seems the webapp slowness are somehow due to slowness
of the read-only storage. More details are in the linked
issue.

swh/infra/sysadm-environment#5373

223f5590

Aug 14, 2024
- cassandraChecks: Stop as we don't monitor them anymore · b5ec4e54
  Antoine R. Dumont authored 7 months ago
  
  b5ec4e54
- deployment/web: Activate gunicorn logging configuration · 469750ff
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  469750ff
- deployment/web: Refactor to correct variable naming convention · 6b1bfa29
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  6b1bfa29
- deployment/deposit: Activate gunicorn logging configuration · 6ce1cba5
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  6ce1cba5
- deployment/graphql: Refactor to correct variable naming convention · 3faa7bc2
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  3faa7bc2
- deployment/graphql: Activate gunicorn logging configuration · d718539f
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  d718539f
- deployment/scheduler: Activate gunicorn logging configuration · 260c3e9c
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  260c3e9c
- deployment/counters: Activate gunicorn logging configuration · d8cd6ed2
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  d8cd6ed2
- deployment/search: Activate gunicorn logging configuration · 7d020341
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  7d020341
- deployment/vault: Activate gunicorn logging configuration · 78b485e9
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  78b485e9
- deployment/indexer-storage: Activate gunicorn logging configuration · 6de18b9b
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  6de18b9b
- indexer-storage/_helper-config.yaml: Rename file · b7af7bd5
  Antoine R. Dumont authored 7 months ago
  
  b7af7bd5
- deployment/indexer-storage: Refactor variable convention naming · 2b0a5568
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  2b0a5568
- deployment/storage: Refactor variable convention naming · a77c34e5
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  a77c34e5
- deployment/objstorage: Refactor variable convention naming · eee72844
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  eee72844
- deployment/objstorage: Refactor configmap checksums · aba0b176
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  aba0b176
- storage: Activate gunicorn logging configuration · afc0a89b
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  afc0a89b
- gunicorn.logging: Extra utility function to ease declaration · e31facc6
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  e31facc6
- storage/_helper-config.yaml: Rename file · 82066c98
  Antoine R. Dumont authored 7 months ago
  
  82066c98
- _helper-config.yaml: Rename file · 830f1d66
  Antoine R. Dumont authored 7 months ago
  
  830f1d66
- local-cluster/objstorage: Activate gunicorn logging configuration · 601974a5
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  601974a5
- objstorage: Bump docker image which uses the logging env variable · 1bfd5cec
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  1bfd5cec
- objstorage: Pass logging configuration through a file · dc4ebdbe
  Antoine R. Dumont authored 7 months ago
  
  Refs. swh/infra/sysadm-environment#5327
  dc4ebdbe