Skip to content
Snippets Groups Projects
Commit b1cdb499 authored by Guillaume Samson's avatar Guillaume Samson
Browse files

swh/storage-replayer: update configmap to improve pipeline (buffer/filter/retry)

Related to swh/infra/sysadm-environment#4879
parent 504f3edf
No related branches found
No related tags found
1 merge request!57swh/storage-replayer: update configmap to improve pipeline (buffer/filter/retry)
...@@ -17,6 +17,18 @@ data: ...@@ -17,6 +17,18 @@ data:
{{- else if .pipelineFilterRetry }} {{- else if .pipelineFilterRetry }}
cls: pipeline cls: pipeline
steps: steps:
- cls: buffer
min_batch_size:
content: 1000
content_bytes: 52428800 # 50 MB
directory: 1000
directory_entries: 12000
revision: 1000
revision_parents: 2000
revision_bytes: 52428800
release: 1000
release_bytes: 52428800
extid: 1000
- cls: filter - cls: filter
- cls: retry - cls: retry
- cls: {{ .storageClass }} - cls: {{ .storageClass }}
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment