swh-alter merge requestshttps://gitlab.softwareheritage.org/swh/devel/swh-alter/-/merge_requests2024-03-28T12:49:46Zhttps://gitlab.softwareheritage.org/swh/devel/swh-alter/-/merge_requests/22Add `swh alter list-candidates` to help masking operations2024-03-28T12:49:46ZJérémy Bobbio (Lunar)Add `swh alter list-candidates` to help masking operationsThis new command will list candidates for an altering operation (e.g.
removal) on the standard output.
Candidates referenced by objects in the graph outside the set of candidates
will be filtered out, unless `--no-omit-referenced` is gi...This new command will list candidates for an altering operation (e.g.
removal) on the standard output.
Candidates referenced by objects in the graph outside the set of candidates
will be filtered out, unless `--no-omit-referenced` is given.
Depends !19
See also swh-storage!1112Tooling for takedown notices [Roadmap - Collect]Jérémy Bobbio (Lunar)Jérémy Bobbio (Lunar)https://gitlab.softwareheritage.org/swh/devel/swh-alter/-/merge_requests/20Draft: Add some progress bars for long-running operations2024-03-20T12:58:50ZJérémy Bobbio (Lunar)Draft: Add some progress bars for long-running operationsMore progress bars could probably be added. It seems to work for the couple added here:
```
Removing origins from search “main”…
[####################################] 100%
1 origins removed from search “main”.
Removing objects from ...More progress bars could probably be added. It seems to work for the couple added here:
```
Removing origins from search “main”…
[####################################] 100%
1 origins removed from search “main”.
Removing objects from storage “postgresql”…
431 objects removed from storage “postgresql”.
Removing objects from storage “cassandra”…
431 objects removed from storage “cassandra”.
Removing objects from journal “main”…
Objects removed from journal “main”.
Removing objects from objstorage “extra”…
[####################################] 100%
204 objects removed from objstorage “extra”.
Removing objects from objstorage “primary”…
[####################################] 100%
204 objects removed from objstorage “primary”.
```
Depends !19
TODO:
- [ ] Add more progress bars
- [ ] Add some testsTooling for takedown notices [Roadmap - Collect]Jérémy Bobbio (Lunar)Jérémy Bobbio (Lunar)https://gitlab.softwareheritage.org/swh/devel/swh-alter/-/merge_requests/19Allow resuming a removal from a recovery bundle2024-03-28T12:45:46ZJérémy Bobbio (Lunar)Allow resuming a removal from a recovery bundle``swh alter recovery-bundle resume-removal`` will remove from the archive
all objects contained in a recovery bundle. This can be useful after
using `swh alter remove --dry-run=stop-before-removal` or in case
of failures from external re...``swh alter recovery-bundle resume-removal`` will remove from the archive
all objects contained in a recovery bundle. This can be useful after
using `swh alter remove --dry-run=stop-before-removal` or in case
of failures from external resources during the removal operation.
The bundle decryption key needs to be provided.
Thus, `swh alter remove` will now print the decryption key to the
standard output so this can be of any practical use.
This is implemented by opening the recovery bundle and registering
all objects again to a fresh `operations.Remover` instance.
`remove()` can then be called just as if we had just created the
recovery bundle.
Closes #15
*Commits from the merge request should be reviewed individually.*Tooling for takedown notices [Roadmap - Collect]Jérémy Bobbio (Lunar)Jérémy Bobbio (Lunar)