Issues · Platform · GitLab

Snippets Groups Projects

Issue Deploy the journal scrubber in production

swh/infra/sysadm-environment#5139 created 1 year ago by Vincent Sellier Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
- Closed
closed 1 year ago
Issue ValueError: swh:1:dir:18025f166aa970fa5dc4e4e1adf0adcdc5fa1ecf has duplicated entry name: b'_posts'

swh/devel/swh-scrubber#4698 created 1 year ago by Sentry Integration Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
- Closed
closed 1 year ago
Issue Deploy the storage scrubber in elastic production 4 of 5 checklist items completed

swh/infra/sysadm-environment#5152 created 1 year ago by Vincent Sellier Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Deployment
- Closed
closed 1 year ago
Issue Deploy the storage scrubbers in elastic staging 5 of 5 checklist items completed

swh/infra/sysadm-environment#5145 created 1 year ago by Vincent Sellier Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Deployment
- Closed
closed 1 year ago
Issue Deploy the journal scrubbers in staging 3 of 3 checklist items completed

swh/infra/sysadm-environment#5108 created 1 year ago by Vincent Sellier Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
- Closed
closed 1 year ago
Issue Document using luigi to generate datasets

swh/devel/swh-export#4748 created 2 years ago by David Douard Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Documentation
- Closed
closed 1 year ago
Task Implement cassandra scrubber in storage_checker.py

swh/devel/swh-scrubber#4686 created 2 years ago by vlorentz Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
- Closed
closed 1 year ago
Issue Deploy scrubber v2.0 19 of 19 checklist items completed

swh/infra/sysadm-environment#4992 created 1 year ago by Antoine R. Dumont Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Deployment
- Closed
closed 1 year ago
Issue Improve the config-id parameter support

swh/devel/swh-scrubber#4696 created 1 year ago by Vincent Sellier Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
- Closed
closed 1 year ago
Issue [scrubber] Deploy the new version of the storage to fix the duplicate entry error in the storage

swh/infra/sysadm-environment#4858 created 1 year ago by Vincent Sellier Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Deployment
- Closed
closed 1 year ago
Issue Deploy swh-scrubber 1.0.1 14 of 15 checklist items completed

swh/infra/sysadm-environment#4823 created 2 years ago by Nicolas Dandrimont Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Deployment
- Closed
closed 2 years ago
Issue Publish scrubber metrics and create grafana dashboard

swh/devel/swh-scrubber#4684 created 2 years ago by vlorentz Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Epic Datastore Scrubber priority:High
- Closed
closed 1 year ago
Issue Implement storage scrubber for cassandra

swh/devel/swh-scrubber#4685 created 2 years ago by vlorentz Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
activity::Implementation priority:High Storage manager
- Closed
closed 2 years ago
Task Adapt DB schema to support cassandra token (also, future-proofing to support sha1/sha256 when to scrub to objstorage?)

swh/devel/swh-scrubber#4687 created 2 years ago by vlorentz Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
- Closed
closed 2 years ago
Issue Generalize content_get_partition to other object types

swh/devel/swh-storage#4672 created 2 years ago by vlorentz Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
- Closed
closed 2 years ago
Issue Check integrity of directories, revisions, and releases

swh/devel/experiments/swh-db-audit#75 created 9 years ago by Nicolas Dandrimont Regularly scrub journal, storage, and objstorage [Roadmap - Preserve]
Archive content Post FOSDEM'17 consolidation priority:Normal state:wip
- Closed (moved)
closed 2 years ago