Merge requests · Platform

Origin metadata pipeline.

swh/devel/swh-indexer!18 · created Oct 15, 2018 by vlorentz generated-differential-D537-target
- Closed
- 41
updated Jan 07, 2023
Include and load codemeta's crosswalk table.

swh/devel/swh-indexer!22 · created Oct 24, 2018 by vlorentz generated-differential-D587-target
- Closed
- 3
- Approved
updated Jan 07, 2023
Make mappings into a hierarchy of classes that can be easily extended.

swh/devel/swh-indexer!23 · created Oct 24, 2018 by vlorentz generated-differential-D591-target
- Closed
- 6
- Approved
updated Jan 07, 2023
Add the origin intrinsic metadata storage database.

swh/devel/swh-indexer!20 · created Oct 22, 2018 by vlorentz generated-differential-D557-target
- Closed
- 9
- Approved
updated Jan 07, 2023
Add the origin intrinsic metadata indexer

swh/devel/swh-indexer!21 · created Oct 22, 2018 by vlorentz generated-differential-D558-target
- Closed
- 15
- Approved
updated Jan 07, 2023
Use swh.scheduler instead of celery in the OriginHeadIndexer.

swh/devel/swh-indexer!423 · created Oct 26, 2018 by vlorentz generated-differential-D608-target
- Closed
- 5
- Approved
updated Jan 07, 2023
Use swh.scheduler instead of celery in the MimetypeIndexer.

swh/devel/swh-indexer!424 · created Oct 26, 2018 by vlorentz generated-differential-D609-target
- Closed
- 3
- Approved
updated Jan 07, 2023
swh.scheduler.utils: Allow to add more task information

swh/devel/swh-scheduler!308 · created Oct 26, 2018 by Antoine R. Dumont generated-differential-D613-target
- Closed
- 9
- Approved
updated Jan 07, 2023
sql/40-swh-data: Update new indexer task types for local db

swh/devel/swh-scheduler!309 · created Oct 26, 2018 by Antoine R. Dumont generated-differential-D615-target
- Closed
- 9
- Approved
updated Jan 07, 2023
swh-site: indexer/orchestrator configuration adaptations

swh/infra/puppet/puppet-swh-site!160 · created Oct 26, 2018 by Antoine R. Dumont generated-differential-D614-target
- Closed
- 2
- Approved
updated Jan 07, 2023
Fix pytest warnings.

swh/devel/swh-indexer!30 · created Oct 29, 2018 by vlorentz generated-differential-D618-target
- Closed
- 2
- Approved
updated Jan 07, 2023
Always output valid JSON-LD.

swh/devel/swh-indexer!29 · created Oct 29, 2018 by vlorentz generated-differential-D617-target
- Closed
- 11
- Approved
updated Jan 07, 2023
Translate authors from package.json

swh/devel/swh-indexer!31 · created Oct 29, 2018 by vlorentz generated-differential-D619-target
- Closed
- 11
- Approved
updated Jan 07, 2023
Translate from pom.xml and codemeta.json.

swh/devel/swh-indexer!32 · created Oct 30, 2018 by vlorentz generated-differential-D620-target
- Closed
- 9
- Approved
updated Jan 07, 2023
Don't share the same config across different indexers.

swh/devel/swh-indexer!430 · created Nov 15, 2018 by vlorentz generated-differential-D662-target
- Closed
- 3
- Approved
updated Jan 07, 2023
Add swh_indexer_origin_head.

swh/devel/swh-indexer!429 · created Nov 15, 2018 by vlorentz generated-differential-D661-target
- Closed
- 3
- Approved
updated Jan 07, 2023
Add fulltext search on origin intrinsic metadata.

swh/devel/swh-indexer!428 · created Nov 15, 2018 by vlorentz generated-differential-D658-target
- Closed
- 20
- Approved
updated Jan 07, 2023
Add an empty tool configuration for the orig-int-meta-indexer.

swh/devel/swh-indexer!46 · created Nov 23, 2018 by vlorentz generated-differential-D702-target
- Closed
- 6
- Approved
updated Jan 07, 2023
Make the OriginMetadataIndexer fetch rev metadata from the storage instead of getting them via the scheduler.

swh/devel/swh-indexer!48 · created Nov 23, 2018 by vlorentz generated-differential-D705-target
- Closed
- 6
- Approved
updated Jan 07, 2023
Make the 'result_name' key of 'next_step' optional.

swh/devel/swh-indexer!47 · created Nov 23, 2018 by vlorentz generated-differential-D704-target
- Closed
- 3
- Approved
updated Jan 07, 2023