Merge requests · Platform / Development / swh-dataset · GitLab

journalprocessor: save final offsets to a text file

!53 · created Apr 12, 2022 by Antoine Pietri generated-differential-D7558-target
- Closed
- Approved
- 3
updated Apr 12, 2022
Reduce cli's loading time by moving import statements in commands

!51 · created Apr 07, 2022 by David Douard generated-differential-D7519-target
- Closed
- Approved
- 6
updated Apr 08, 2022
Add support for blob in content export

!48 · created Mar 29, 2022 by David Douard generated-differential-D7465-target
- Closed
- Approved
- 17
updated Apr 07, 2022
Keep each ORC table in a dedicated directory

!49 · created Mar 31, 2022 by David Douard generated-differential-D7476-target
- Closed
- Approved
- 4
updated Mar 31, 2022
Improve the progress reporting look and feel

!47 · created Mar 29, 2022 by David Douard generated-differential-D7464-target
- Closed
- Approved
- 10
updated Mar 30, 2022
Delay the unsubscribe to the end of handle_messages

!46 · created Mar 29, 2022 by David Douard generated-differential-D7463-target
- Closed
- Approved
- 10
updated Mar 30, 2022
Move exporter config entries in dedicated sections

!45 · created Mar 29, 2022 by David Douard generated-differential-D7462-target
- Closed
- Approved
- 7
updated Mar 30, 2022
Add support for limited row numbers in ORC files

!44 · created Mar 29, 2022 by David Douard generated-differential-D7461-target
- Closed
- Approved
- 13
updated Mar 30, 2022
Add the raw_manifest column for revision, release and directory ORC files

!43 · created Mar 18, 2022 by David Douard generated-differential-D7389-target
- Closed
- Approved
- 13
updated Mar 29, 2022
Export revision extra headers in a dedicated ORC file

!42 · created Mar 18, 2022 by David Douard generated-differential-D7388-target
- Closed
- Approved
- 16
updated Mar 29, 2022
Add the type fields for revision and origin_visit_status ORC table

!41 · created Mar 18, 2022 by David Douard generated-differential-D7387-target
- Closed
- Approved
- 14
updated Mar 29, 2022
Write related ORC files in the same directory using the same UUID

!39 · created Mar 18, 2022 by David Douard generated-differential-D7385-target
- Closed
- Approved
- 15
updated Mar 29, 2022
Add some user metadata in generated ORC files

!38 · created Mar 18, 2022 by David Douard generated-differential-D7384-target
- Closed
- Approved
- 16
updated Mar 29, 2022
Implement test_orc exporter as a simple function instead of a fixture

!37 · created Mar 18, 2022 by David Douard generated-differential-D7383-target
- Closed
- Approved
- 14
updated Mar 29, 2022
Make the kafka group_id prefix configurable in the config file

!36 · created Mar 18, 2022 by David Douard generated-differential-D7382-target
- Closed
- Approved
- 13
updated Mar 29, 2022
Use a named logger for journalprocessor.py

!35 · created Mar 18, 2022 by David Douard generated-differential-D7381-target
- Closed
- Approved
- 13
updated Mar 29, 2022
Update JournalClientOffsetRanges for swh.journal 0.9

!34 · created Mar 18, 2022 by David Douard generated-differential-D7380-target
- Closed
- Approved
- 13
updated Mar 29, 2022
Use the same 'id' column name everywhere in ORC files

!40 · created Mar 18, 2022 by David Douard generated-differential-D7386-target
- Closed
- Approved
- 14
updated Mar 29, 2022
Exporters: add option to write in a deterministic location

!32 · created Mar 08, 2022 by Antoine Pietri generated-differential-D7322-target
- Closed
- Approved
- 8
updated Mar 29, 2022
Encode TimestampWithTimezone as (sec, usec, offset) in ORC file

!33 · created Mar 18, 2022 by David Douard generated-differential-D7379-target
- Closed
- Approved
- 19
updated Mar 29, 2022

Prev
1
2
3
4
5
Next