- Sep 22, 2016
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Closes T569
-
- Sep 21, 2016
-
-
Antoine R. Dumont authored
-
- Sep 20, 2016
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
If you want the archiver to have cloud abilities, install the package python3-swh.objstorage.cloud on the server as well.
-
- Sep 17, 2016
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Logging an entry about it
-
Antoine R. Dumont authored
- Only read the storage key once. - Improve the logging error.
-
- Sep 16, 2016
-
-
Antoine R. Dumont authored
Also, adds a force_copy flag in the configuration file to avoid checking preexistence of sha1. This is to be efficient for the first time copy in a new backend.
-
Antoine R. Dumont authored
The initial director and worker had split configuration files. Now it's unified to be both archiver/worker.yml file
-
- Sep 15, 2016
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
- Sep 14, 2016
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Drop unused archive.url column. Simplify associated tests setup on the archiver with retention policy.
-
Antoine R. Dumont authored
Actions storage: - Open cache_content_get to retrieve contents in cache - sql/upgrades/080: Add stored procedure to read contents from cache Actions archiver: - d/control: Add dependency to archiver on python3-swh.objstorage.cloud - Renamed Archiver(Director|Worker) to ArchiverWithRetentionPolicy(Director|Worker) - Add ArchiverToBackend(Director|Worker) - Add new celery task dedicated for new workers - Update docstring details Related T555
-
- Sep 06, 2016
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
- Aug 31, 2016
-
-
Antoine R. Dumont authored
As for python3-swh.storage.archiver, the runtime dependency on python3-swh.core is the implicit one from python3-swh.storage. The same note about splitting repository and adding explicit dependency applies. Related T557
-
- Aug 29, 2016
-
-
Antoine R. Dumont authored
-
- Aug 25, 2016
-
-
Antoine R. Dumont authored
-
- Aug 23, 2016
-
-
Antoine R. Dumont authored
-
- Aug 19, 2016
-
-
Nicolas Dandrimont authored
-
- Aug 16, 2016
-
-
Quentin Campos authored
content_archive.num_present act like a cache for the number of copies where the content is present. This allow to make a much faster request when retrieving the contents that have fewer copies than expected.
-
- Aug 03, 2016
-
-
Nicolas Dandrimont authored
-
Quentin Campos authored
-
Quentin Campos authored
-
Quentin Campos authored
-
Quentin Campos authored
Additional configuration was passed from director to the worker at initialization. We remove it so the queued messages in celery are only lists of sha1 with no dict to pack/unpack.
-
Quentin Campos authored
-
Quentin Campos authored
The arguments for these objects are now parsed from a configuration file instead of being passed as rguments
-
Quentin Campos authored
-
Quentin Campos authored
Those changes allow the archiver to use any storage as a source or a destination making it the central point of all archival. Also, the archiver's mecanisms and code are simplified. See T512 for new architecture. Closes T512
-
- Aug 01, 2016
-
-
Quentin Campos authored
Reviewers: #reviewers!, olasd, zack Maniphest Tasks: T512 Differential Revision: https://forge.softwareheritage.org/D88
-
Quentin Campos authored
Before the archiver copy a content, it have to check if it is valid. If it's not the case, the content status is updated to reflect his invalid state.
-
- Jul 27, 2016
-
-
Quentin Campos authored
Summary: As the api of RemoteObjStorage have been fixed (See D83) and is now aligned to the base ObjStorage one, places where the remote API were used directly must be updated. Related D83 Reviewers: #reviewers!, olasd Maniphest Tasks: T513 Differential Revision: https://forge.softwareheritage.org/D84
-
- Jul 25, 2016
-
-
Nicolas Dandrimont authored
-