staging: Deploy new provenance grpc service (>= v0.3)
The previous implementation of the provenance was a rpc server which used graph's grpc service underneath. It's still available.
A new implementation of the backend using parquet files was done. It allows to expose a new grpc service which queries the parquet files underneat to answer grpc queries. All this is exposed through the webapp api under /provenance/where{is,are}.
The goal of this issue is to adapt the deployment to allow this new instance to run in staging.
Plan:
- Review draft deployment spec [1]
- swh-apps!53 (merged): Evolve swh-apps' dockerfile for provenance
- swh/devel/snippets!27 (merged): Deployment Documentation (c4 model)
- swh/infra/ci-cd/swh-charts!559 (closed): Evolve deployment template for the provenance to be able to run the new provenance grpc server (environment: local, next-version)
- Report reality checks in documentation specs ^
- Develop equivalent provenance grafana chart (as the graph's)
- swh/infra/ci-cd/swh-charts!564 (merged): staging: Deploy new provenance grpc server & plug webapi to use this provenance server
- Adjust what's necessary
- Monitor behavior
The production deployment is out of scope of this issue [6]
[1] Draft Deployment spec: https://hedgedoc.softwareheritage.org/scsWvzQZRO2HW2gisANXBw
[2] Draft deployment documentation: https://hedgedoc.softwareheritage.org/6DnDnX6TS6aZ0c-sfTLisg (see [3] for source code doc)
[3] swh/devel/snippets!27 (merged)
[4] https://grafana.softwareheritage.org/goto/aEsOYvoNk?orgId=1
[5] No doc for this but the metrics are the same as the graph https://docs.softwareheritage.org/devel/swh-graph/grpc-api.html#monitoring
[6] #5620