• Lead: vsellier
• Priority: high
• Effort: 2 PM

Description:

Setup a dynamically scalable infrastructure for Software Heritage services

Includes work:

• Setup an elastic workers infrastructure
• Configure Kubernetes clusters
• Monitoring/Alerting solution for container-based services
• Ingest the logs of the dynamic components into the current elk infrastructure

KPIs:

• Dashboard displaying the status of the dynamic components
  • Number of listers running
  • Number of loaders running
  • RPC services status
• Logs ingested and correctly parsed in kibana
• Clusters fully backuped