Tags

Release swh.scrubber 4.0.0

Breaking changes: migrate PostgreSQL connections to psycopg3.

Release swh.scrubber 3.1.1

 - Use composite object id based APIs for swh.objstorage
 - Update swh-py-template to 0.3.3 (updating black, flake8 and mypy)

v3.1.0

- remove support for the 'local' config cls
- update to swh.core 3.6: declare the backend in the entrypoint
- adapt to swh.mode 6.13
- fix checked_partition_get_running SQL query

version 3.0.0

Release swh.scrubber 2.3.0

Adapt to pytest-postgresql 5

v2.2.0

- Migrate to copier, PEP420 and pyproject.toml based packaging.
- Add a cli too to get stats for a given config enctry.
- Fix a crash in the journal checker.

v2.1.0

- improve data model: use config_id instead of datastore id in
  missing_object, missing_object_reference and corrupt_object DB tables;
  This comes with a non-trivial migration script, should be played
  carefully if upgrading and existing DB.
- allow to run hash configuration and reference validation checkers
  independently; uses the 2 new `check_hashes` and `check_references`
  flags in the configuration entry.

v2.0.3

- scrubber.cli: Ensure to retrieve the correct datastore configuration
- db: Allow to retrieve a configuration per name and optional datastore

v2.0.2

- cli: Fix typo in raised exception

v2.0.1

Fix test for older click version

v2.0.0

New checker data model & cli.

Warning: configuration file & deployment method must be updated.

v1.0.3

* storage_checker: Fix crash on directory with duplicate entries

Release swh.scrubber v1.0.2

 - Fix 5.sql upgrade script

v1.0.1

* docs: Add CLI

v1.0.0

* Add support for checking swh-storage backed by Cassandra:
  * Use '*_get_partition' endpoints instead of querying postgres directly
  * Change the SWHID range-based CLI and DB schema with opaque
    partition ids
* Fix deprecation warnings, bumplinters
* cli: Rename config key 'journal_client' to 'journal'

v0.1.2

* docs: Include module indices only when building standalone package doc
* sql: Fix typos detected by codespell
* pre-commit, tox: Bump pre-commit, codespell, black and flake8
* storage_checker: Retry on postgresql errors from swh-storage

v0.1.1

* Add checkpointing on storage_checker to avoid rechecking objects at
  the beginning of ranges again and again

This release contains a database migration, that must be applied before
restarting workers.

0.1.1

* Add checkpointing on storage_checker to avoid rechecking objects at
  the beginning of ranges again and again

This release contains a database migration, that must be applied before
restarting workers.

Release swh.scrubber 0.1.0

 - Add missing_object-related tables
 - Add metrics and reduce logging for production purposes

v0.0.6

Wrap queries in transaction