Index extrinsic metadata from the journal in swh-search/Elasticsearch
Migrated from T2073 (view on Phabricator)
Designs
- swh-indexer #4273
- #4249Collect and index forge metadata [Roadmap - Collect]
- swh/meta #2064
- swh/meta #3097Design presentation of Metadata on Web UI [Roadmap - Share]
Activity
marked this issue as related to swh/meta#2064 (closed)
added Archive search Metadata workflow priority:Normal labels
assigned to @vlorentz
marked this issue as related to swh/meta#3097
I'm tempted to postpone this issue until we resolve swh-scheduler#2063...
! In #2073 (closed), @vlorentz wrote: I'm tempted to postpone this issue until we resolve swh-scheduler#2063...
I don't think we're "resolving" swh-scheduler#2063 until we need to process tasks that can't reasonably be handled by celery. On the other hand, journal clients are sort of a resolution to swh-scheduler#2063.
Would a "simple" journal client, which would be able to mangle known metadata types into something that can be fed into elasticsearch be appropriate here?
-
On the other hand, journal clients are sort of a resolution to swh-scheduler#2063.
Yes, they are. I just want to make sure we explicitly decide to go that way.
Would a "simple" journal client, which would be able to mangle known metadata types into something that can be fed into elasticsearch be appropriate here?
Yes.
marked this issue as related to #4249 (closed)
marked this issue as related to swh-indexer#4273 (closed)
marked this issue as related to #4396 (closed)
mentioned in merge request !39 (closed)