Merge requests · Platform / Development / swh-dataset · GitLab

luigi: Add support for downloading exports in parallel

!99 · created Sep 05, 2023 by vlorentz
- Merged
- Approved
- 2
updated Sep 06, 2023
luigi: Work around absence of metadata files in old exports

!98 · created Sep 05, 2023 by vlorentz
- Merged
- Approved
- 2
updated Sep 06, 2023
luigi: Delete all files in the root dir instead of the root dir itself

!97 · created Aug 07, 2023 by vlorentz
- Merged
- Approved
- 3
updated Aug 07, 2023
docs: Add links to Terms of Use and 'How to use SWH data'

!96 · created May 05, 2023 by vlorentz
- Merged
- Approved
- 4
updated May 10, 2023
luigi: Fix sphinx warnings related to undefined labels

!95 · created Apr 19, 2023 by Antoine Lambert
- Merged
- Approved
- 1
updated Apr 19, 2023
Advertise the 'history and history' compressed graph

!94 · created Apr 06, 2023 by vlorentz
- Merged
- 1
updated Apr 06, 2023
luigi: Make AthenaDatabaseTarget check tables exist

!93 · created Mar 16, 2023 by vlorentz
- Merged
- Approved
- 4
updated Mar 16, 2023
Advertize 2022-12-07 dataset

!92 · created Mar 03, 2023 by vlorentz
- Merged
- Approved
- 2
updated Mar 14, 2023
luigi: Actually check whether RunExportAll is complete.

!91 · created Mar 01, 2023 by vlorentz
- Merged
- Approved
- 4
updated Mar 06, 2023
luigi: Clarify the meaning of 'object_types'

!90 · created Mar 01, 2023 by vlorentz
- Merged
- 1
updated Mar 01, 2023
Rename 'object_type' to 'object_types' in export metadata

!89 · created Feb 23, 2023 by vlorentz
- Merged
- 2
updated Mar 02, 2023
mypy: Bump to 1.0 and fix new typing errors

!88 · created Feb 17, 2023 by Antoine Lambert
- Merged
- 4
updated Feb 17, 2023
Update tox configuration for version 4

!87 · created Feb 16, 2023 by Jérémy Bobbio (Lunar)
- Merged
- 2
updated Feb 16, 2023
luigi.UploadExportToS3: Skip upload of already-uploaded files

!86 · created Dec 16, 2022 by vlorentz generated-differential-D8966-target
- Closed
- Approved
- 5
updated Dec 20, 2022
luigi: Dynamically list directories instead of using object_types

!85 · created Dec 16, 2022 by vlorentz generated-differential-D8965-target
- Closed
- Approved
- 5
updated Dec 20, 2022
luigi: Read meta/export.json instead of relying on stamp files

!84 · created Dec 16, 2022 by vlorentz generated-differential-D8963-target
- Closed
- Approved
- 5
updated Dec 20, 2022
luigi.RunExportAll: Default to exporting all formats

!83 · created Dec 06, 2022 by vlorentz generated-differential-D8926-target
- Closed
- Approved
- 3
updated Dec 07, 2022
luigi.CreateAthena: Fix validation of DB name

!82 · created Dec 06, 2022 by vlorentz generated-differential-D8925-target
- Closed
- Approved
- 3
updated Dec 07, 2022
exporters/orc: Fix crash on visit status with no type

!81 · created Dec 06, 2022 by vlorentz generated-differential-D8924-target
- Closed
- Approved
- 3
updated Dec 07, 2022
luigi: Send progress reports to the scheduler

!80 · created Nov 29, 2022 by vlorentz generated-differential-D8901-target
- Closed
- Approved
- 3
updated Nov 29, 2022

Prev
1
2
3
4
5
Next