Tags

v0.37.0

- Allow filtering extids per extid_version/extid_type when reading
- migrate_extrinsic_metadata: Fix edge cases (missing f-stringification, remaining pypi
- issues, ...)
- cassandra: Make directory_ls fetch contents in batch instead of one-by-one
- cassandra: Add option to select (hopefully) more efficient batch insertion algos
- cassandra: Remove stat_counters.
- cassandra: generate statsd metrics on method calls
- content_get: Fetch rows concurrently
- directory_entry_add_batch: Remove the temporary prepared statement entirely
- directory_entry_add_batch: Reduce churn of prepared statements
- postgresql: Fix a column order mismatch between the query and object builder
- Add counting storage proxy

v0.36.0

changelog:
- Add cvs as supported revision_type
- Add test for origin_visit_get_latest in presence of mismatched id and date orders
- cassandra: Bump next_visit_id when origin_visit_add is called by a replayer
- cassandra: Make content_missing query in batches
- backfill: add extra where clause to use the right index for extid requests

v0.35.1

* cassandra: Fix crash when using _missing() functions with more than 100 ids with ScyllaDB.

v0.35.0

- Implement storage of the ExtID.extid_version field

v0.34.0

- cassandra: allow to configure the consistency level

v0.33.0

* Add endpoint raw_extrinsic_metadata_get_authorities

v0.32.0

* cassandra: Add support for non-ASCII origin 'URLs'.

v0.31.0

* cassandra: Add partial support for ScyllaDB
* mypy: Fix errors with release >= v0.900 (but breaks older mypy versions)
* Add endpoints to access REMD by id

v0.30.1

- Finalize the config "local" deprecation in favor of "postgresql"
- tests: Make test parameters order deterministic, so they don't crash pytest-xdist
- test_cassandra: Improve error when the process is started but not listening

v0.30.0

Release swh.storage 0.29.1

 - Add missing db migration

v0.29.0

* Make the TenaciousProxyStorage retry when a single object add fails
* Move all proxy storages in swh/storage/proxies/
* Deprecate the "local" storage cls in favor of "postgresql"
* cassandra: Add tests checking directory_add and snapshot_add are atomic.
* Add endpoint directory_get_entries, to quickly list a directory's entries
* content_get: Add support for queries by sha1_git

v0.28.0

* Normalize all Storage.xxx_add() methods to return a summary
* cassandra: Add 'check_missing' option, to allow updating objects
* cassandra: Add a test of a 'complex' migration, with a PK update
* Add a new TenaciousProxyStorage
* Make postgresql's origin_add not raise an error in case of conflict
* Stop storing authority/fetcher metadata.
* tenacious: Document potential issues about objects being dropped
* Use swh.core 0.14

version 0.27.4

version 0.27.3

v0.27.2

v0.27.1

* buffer: Add support for 'extid'

v0.27.0

* origin_visit_status_add: Fix inconsistent/incorrect errors when type is None and visit is missing.
* extid: remove unicity on (extid_type, extid) and (target_type, target)

Release swh.storage v0.26.0

Move raw_extrinsic_metadata deduplication to use a new id column.

version 0.25.0