- Mar 13, 2017
-
-
Antoine R. Dumont authored
Related T494
-
- Mar 09, 2017
-
-
Antoine Pietri authored
-
Antoine Pietri authored
-
Antoine Pietri authored
-
- Mar 07, 2017
-
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
This will allow us to handle another storage backend for the storage of the archiver data.
-
Nicolas Dandrimont authored
-
- Mar 03, 2017
-
-
Antoine R. Dumont authored
Permits to batch update content rows (with or without optional new columns). Limited to contents (table content only, table skipped_content is not dealt with). Related T692 Closes D185
-
- Mar 02, 2017
-
-
Nicolas Dandrimont authored
By default we would try to copy objects from all the archives, even those for which we didn't have a configuration.
-
Nicolas Dandrimont authored
The default value for content copies is "missing", so we don't need to make it explicit.
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
-
Antoine R. Dumont authored
Implementation wise, this uses COPY statement and drop duplicates if encountered for content_archive insertion.
-
Antoine R. Dumont authored
Use the same insertion pattern as swh.storage.content_add.
-
Antoine R. Dumont authored
This also has the benefit to hide some celery name (which is an implementation detail from swh.scheduler).
-
Antoine R. Dumont authored
Related: T494
-
Antoine R. Dumont authored
This use case cannot happen with ArchiverWithRetentionPolicyDirector: - If a row entry is referenced in the archiver db, it's present in the objstorage - And if a row entry is not referenced in the archiver db, it won't be listed as missing since it's the archiver db which is read for listing the contents we want to archive.
-
Antoine R. Dumont authored
Related T494 Related T569
-
Antoine R. Dumont authored
Related T494
-
- Feb 23, 2017
-
-
Antoine Pietri authored
-
- Feb 22, 2017
-
-
Antoine Pietri authored
-
- Feb 21, 2017
-
-
Antoine Pietri authored
-
- Feb 20, 2017
-
-
Antoine Pietri authored
-
- Feb 16, 2017
-
-
Antoine Pietri authored
-
Nicolas Dandrimont authored
-
- Feb 15, 2017
-
-
Antoine R. Dumont authored
-
- Feb 14, 2017
-
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
To make sure corruptions such as T680 don't happen again, use the same normalization function as swh.model before inserting timestamps into our database. This makes swh.storage reject non-integer timestamp values as well. Update tests to reflect this change.
-
- Feb 09, 2017
-
-
Nicolas Dandrimont authored
Close T672
-
Nicolas Dandrimont authored
-
Antoine Pietri authored
-
Antoine Pietri authored
-
Antoine Pietri authored
-
- Feb 07, 2017
-
-
Nicolas Dandrimont authored
The buckets are using the last two bytes of the object id, so that we spread the load across different lines on sequential archivings.
-
- Feb 01, 2017
-
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
By default, return data from the latest visit instead of returning data from all visits, which doesn't make much sense.
-
Nicolas Dandrimont authored
-