Skip to content

Publish origin_intrinsic_metadata to Kafka.

So swh-search can use a Kafka client to fill its DB with metadata.

Controversial points:

  • It adds a new Kafka topic, of objects that are not part of the data model
  • Only this idx-storage endpoint writes to Kafka (because I don't think we need the other ones) -> inconsistency

Depends on !194 (closed) ^ implementation detail (some tests are currently failing in that diff because of data validation issue which are being fixed in this 1958)


Migrated from D1959 (view on Phabricator)

Merge request reports