Skip to content

Migrate objstorage-read-only to target the dynamic infra instance

Antoine R. Dumont requested to merge migrate-objstorage-readonly-to-dynamic-infra into production

This exposes the objstorage in the dynamic production cluster.

This impacts the dns server to change the objstorage cname to target the production cluster. This also impacts the moma instance since it's the reverse proxy (varnish) [1]. Varnish will redirect the requests to the objstorage instance running in the dynamic infra [2].

This does not decommission the objstorage service running on moma yet. This will be done in another round after the holidays. [3]

[1]

swh-octodiff pergamon 
diff origin/production/pergamon.softwareheritage.org current/pergamon.softwareheritage.org
*******************************************
- Resource_record[objectorage-ro/CNAME]
*******************************************
+ Resource_record[objstorage-ro/CNAME] =>
   parameters =>
     "data": "k8s-archive-production-rke2.internal.softwareheritage.org.",
     "keyfile": "/etc/bind/keys/local-update",
     "record": "objstorage.internal.softwareheritage.org",
     "type": "CNAME"
*******************************************
*** End octocatalog-diff on pergamon.softwareheritage.org

[2]

swh-octodiff moma 
*** Running octocatalog-diff on host moma.softwareheritage.org
I, [2023-12-19T10:33:46.533478 #1641631]  INFO -- : Catalogs compiled for moma.softwareheritage.org
I, [2023-12-19T10:33:47.064250 #1641631]  INFO -- : Diffs computed for moma.softwareheritage.org
diff origin/production/moma.softwareheritage.org current/moma.softwareheritage.org
*******************************************
  File[/etc/varnish/includes/01_objstorage.vcl] =>
   parameters =>
     content =>
      @@ -7,5 +7,5 @@
       backend objstorage
       {
      -    .host = "moma.internal.softwareheritage.org";
      -    .port = "5003";
      +    .host = "objstorage.internal.softwareheritage.org";
      +    .port = "80";
       }
*******************************************
  Profile::Varnish::Vcl_include[objstorage] =>
   parameters =>
     content =>
      @@ -7,5 +7,5 @@
       backend objstorage
       {
      -    .host = "moma.internal.softwareheritage.org";
      -    .port = "5003";
      +    .host = "objstorage.internal.softwareheritage.org";
      +    .port = "80";
       }
*******************************************
  Profile::Varnish::Vhost[objstorage.softwareheritage.org] =>
   parameters =>
     backend_http_host =>
      - moma.internal.softwareheritage.org
      + objstorage.internal.softwareheritage.org
     backend_http_port =>
      - 5003
      + 80
*******************************************
  Varnish::Vcl[/etc/varnish/includes/01_objstorage.vcl] =>
   parameters =>
     content =>
      @@ -7,5 +7,5 @@
       backend objstorage
       {
      -    .host = "moma.internal.softwareheritage.org";
      -    .port = "5003";
      +    .host = "objstorage.internal.softwareheritage.org";
      +    .port = "80";
       }
*******************************************
*** End octocatalog-diff on moma.softwareheritage.org

[3] !678 (merged)

Refs. swh/infra/sysadm-environment#5192 (closed)

Depends on swh/infra/ci-cd/swh-charts!272 (merged)

Edited by Antoine R. Dumont

Merge request reports