Deploy swh-indexer v2.9.1 on staging and prod
tag v2.8.0
Tagger: Valentin Lorentz <vlorentz@softwareheritage.org>
Date: Wed Nov 23 08:57:20 2022 +0100
v2.8.0
* journal writer: only flush kafka once per batch
* origin_head: Do not fetch complete snapshots for non-FTP visits
* ExtrinsicMetadataIndexer: Add support for metadata with origin in context
This only requires resetting offsets of the indexer consumer on swh.journal.objects.raw_extrinsic_metadata
, so it can pick up metadata from deposits.
tag v2.9.0
Tagger: Valentin Lorentz <vlorentz@softwareheritage.org>
Date: Tue Nov 29 15:28:28 2022 +0100
v2.9.0
* storage: Insert from temporary tables in consistent order
* Drop content_language and content_ctags tables and related SQL functions
tag v2.9.1
Tagger: Valentin Lorentz <vlorentz@softwareheritage.org>
Date: Wed Nov 30 11:46:40 2022 +0100
v2.9.1
* Fix ordering and idempotence in the 136 -> 137 upgrade script
* docs: Remove remaining references to ctags and content_language
* Fix 'Invalid IPv6 URL' crash
* Fix crash when indexing two REMD objects from the same deposit
Checklist:
staging:
-
staging: stop indexer journal clients -
staging: storage backend schema migrations -
staging: update storage backend service -
staging: reset raw_extrinsic_metadata offsets for reindexing -
staging: restart indexer journal clients
prod:
-
prod: stop indexer journal clients -
prod: storage backend schema migrations -
prod: update storage backend service -
prod: upgrade indexer journal client [1] -
prod: reset raw_extrinsic_metadata offsets for reindexing -
prod: restart indexer journal clients [2]
[1]
root@pergamon:~# clush -b -w @indexer-workers "dpkg -l python3-swh.indexer*" | grep ii
ii python3-swh.indexer 2.9.1-1~swh1~bpo10+1 all Software Heritage Content Indexer
ii python3-swh.indexer.storage 2.9.1-1~swh1~bpo10+1 all Software Heritage Content Indexer Storage
[2] https://grafana.softwareheritage.org/goto/qJV7VBFVz?orgId=1
Edited by Antoine R. Dumont