swh/loader-metadata: Reduce the load on coredns to resolve github.com (!418) · Merge requests · Platform / Infrastructure / CI CD / Helm charts for swh packages

Vincent Sellier requested to merge loaders-dns into production Jun 11, 2024
helm dyff
[swh] Comparing changes between branches production and loaders-dns (per environment)...
Your branch is up to date with 'origin/production'.
[swh] Generate config in production branch for environment staging, namespace swh...
[swh] Generate config in production branch for environment staging, namespace swh-cassandra...
[swh] Generate config in production branch for environment staging, namespace swh-cassandra-next-version...
[swh] Generate config in loaders-dns branch for environment staging...
[swh] Generate config in loaders-dns branch for environment staging...
[swh] Generate config in loaders-dns branch for environment staging...
Your branch is up to date with 'origin/production'.
[swh] Generate config in production branch for environment production, namespace swh...
[swh] Generate config in production branch for environment production, namespace swh-cassandra...
[swh] Generate config in production branch for environment production, namespace swh-cassandra-next-version...
[swh] Generate config in loaders-dns branch for environment production...
[swh] Generate config in loaders-dns branch for environment production...
[swh] Generate config in loaders-dns branch for environment production...


------------- diff for environment staging namespace swh -------------

     _        __  __
   _| |_   _ / _|/ _|  between /tmp/swh-chart.swh.3Cu2o8dQ/staging-swh.before, 113 documents
 / _' | | | | |_| |_       and /tmp/swh-chart.swh.3Cu2o8dQ/staging-swh.after, 113 documents
| (_| | |_| |  _|  _|
 \__,_|\__, |_| |_|   returned one difference
        |___/

spec.template.spec.dnsConfig.options.ndots.value  (apps/v1/Deployment/swh/storage-postgresql-read-only)
  ± value change
    - 2
    + 1



------------- diff for environment staging namespace swh-cassandra -------------

     _        __  __
   _| |_   _ / _|/ _|  between /tmp/swh-chart.swh.3Cu2o8dQ/staging-swh-cassandra.before, 391 documents
 / _' | | | | |_| |_       and /tmp/swh-chart.swh.3Cu2o8dQ/staging-swh-cassandra.after, 391 documents
| (_| | |_| |  _|  _|
 \__,_|\__, |_| |_|   returned eleven differences
        |___/

spec.template.spec.containers.loader-metadata  (apps/v1/Deployment/swh-cassandra/loader-metadata)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-add-forge-now)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-add-forge-now-slow)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-cvs)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-deposit)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-git)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-git-checkout)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-oneshot)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-save-code-now)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra/loader-svn)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra.svc.cluster.local

spec.template.spec.dnsConfig.options.ndots.value  (apps/v1/Deployment/swh-cassandra/webhooks-origin-visit-status)
  ± value change
    - 2
    + 1



------------- diff for environment staging namespace swh-cassandra-next-version -------------

     _        __  __
   _| |_   _ / _|/ _|  between /tmp/swh-chart.swh.3Cu2o8dQ/staging-swh-cassandra-next-version.before, 149 documents
 / _' | | | | |_| |_       and /tmp/swh-chart.swh.3Cu2o8dQ/staging-swh-cassandra-next-version.after, 149 documents
| (_| | |_| |  _|  _|
 \__,_|\__, |_| |_|   returned eight differences
        |___/

spec.template.spec.containers.loader-metadata  (apps/v1/Deployment/swh-cassandra-next-version/loader-metadata)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra-next-version/loader-cvs)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra-next-version/loader-deposit)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra-next-version/loader-git)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra-next-version/loader-git-checkout)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra-next-version/loader-oneshot)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra-next-version/loader-save-code-now)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh-cassandra-next-version/loader-svn)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh-cassandra-next-version.svc.cluster.local



------------- diff for environment production namespace swh -------------

     _        __  __
   _| |_   _ / _|/ _|  between /tmp/swh-chart.swh.3Cu2o8dQ/production-swh.before, 412 documents
 / _' | | | | |_| |_       and /tmp/swh-chart.swh.3Cu2o8dQ/production-swh.after, 412 documents
| (_| | |_| |  _|  _|
 \__,_|\__, |_| |_|   returned 28 differences
        |___/

spec.template.spec.containers.loader-metadata  (apps/v1/Deployment/swh/loader-metadata)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-add-forge-now)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-add-forge-now-slow)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-archive)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-bzr)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-content)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-cran)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-cvs)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-debian)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-deposit)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-directory)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-git)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-git-checkout)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-git-large-repository)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-golang)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-hg-checkout)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-maven)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-mercurial)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-npm)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-oneshot)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-opam)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-pubdev)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-pypi)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-save-code-now)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-svn)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.containers.loaders  (apps/v1/Deployment/swh/loader-svn-export)
  + one map entry added:
    dnsConfig:
      options:
      - name: ndots
        value: 1
      searches:
      - cluster.local
      - svc.cluster.local
      - swh.svc.cluster.local

spec.template.spec.dnsConfig.options.ndots.value  (apps/v1/Deployment/swh/storage-postgresql-winery)
  ± value change
    - 2
    + 1

spec.template.spec.dnsConfig.options.ndots.value  (apps/v1/Deployment/swh/webhooks-origin-visit-status)
  ± value change
    - 2
    + 1



------------- diff for environment production namespace swh-cassandra -------------

     _        __  __
   _| |_   _ / _|/ _|  between /tmp/swh-chart.swh.3Cu2o8dQ/production-swh-cassandra.before, 94 documents
 / _' | | | | |_| |_       and /tmp/swh-chart.swh.3Cu2o8dQ/production-swh-cassandra.after, 94 documents
| (_| | |_| |  _|  _|
 \__,_|\__, |_| |_|   returned no differences
        |___/
Adapt the loaders configuration to be able to adapt the default dns configuration.
Use a ndots value at 1 to don't try to resolve github.com locally (cf swh/infra/sysadm-environment#5339 (comment 175160))
swh/loader-metadata: Reduce the load on coredns to resolve github.com

Merge request reports
