staging: Deploy rpc services to dynamic infrastructure

Once the logging and the alerting solutons are in place. It will be time to migrate incrementally swh services as well. First on staging, then on production (after staging lifted papercuts).

This is the issue that deals with the first deployment and papercuts fixing in staging. For production, refer to [1].

Blocking points so far:

• logging
• alerting (somewhat)
• swh/infra/ci-cd/swh-charts!175 (merged): django migrations ( https://www.ghanei.net/django-migrations-on-kubernetes/ )
• swh/infra/ci-cd/swh-charts!177 (merged): Endpoints behind basic http access
• smtp access
• #5102 (closed): Deposit: Adapt backend configuration
• Determine solutions for volume mountpoints [1] (persistent volumes, ...)

Templates (swh-charts) ready:

• swh-scheduler
• #4812 (closed): swh-web
• swh-storage
• swh/infra/ci-cd/swh-charts!167 (closed): swh-vault
• swh/infra/ci-cd/swh-charts!180 (merged): swh-indexer-storage
• swh/infra/ci-cd/swh-charts!181 (merged): swh-search
• swh/infra/ci-cd/swh-charts!194 (merged): Search journal clients (got missed before)
• #5129 (closed): swh-deposit
• #5164 (closed): swh-storage
• #5164 (closed): swh-objstorage
• swh-counter

status:

• #5035 (closed): rpc: swh-scheduler
• swh/infra/ci-cd/swh-charts!178 (merged): rpc: swh-vault
• #5095 (closed): api: swh-web (django)
• swh/infra/ci-cd/swh-charts!185 (merged): rpc: swh-indexer-storage
• swh/infra/ci-cd/swh-charts!186 (merged): rpc: swh-search
• swh/infra/ci-cd/swh-charts!194 (merged): Search journal clients (got missed before)
• api: swh-deposit (django)
• #5164 (closed): rpc: swh-storage
• #5164 (closed): rpc: swh-objstorage
• #5179 (closed): rpc: swh-counter

post-migration, Decommission:

• vault.staging node (gunicorn-swh-vault service)
• webapp.staging node (gunicorn-swh-{webapp,storage,search} services)
• gunicorn-swh-indexer-storage service (in storage1.staging)
• search.staging node (gunicorn-swh-search, search journal-client services)
• deposit.staging node
• #5164 (closed): gunicorn-swh-storage service (in storage1.service)
• #5164 (closed): gunicorn-swh-objstorage service (in storage1.service)
• #5179 (closed): counter services

[1] #5110 (closed)