This also has the benefit to hide some celery name (which is an
implementation detail from swh.scheduler).

To make sure corruptions such as T680 don't happen again, use the same
normalization function as swh.model before inserting timestamps into our
database.

This makes swh.storage reject non-integer timestamp values as well.

Update tests to reflect this change.

Closes T646

Related T646

Related T646

Related T613

The check_config method allows a dynamic check of the configuration for
a running storage. We can make sure that we have proper permissions on
the object storage as well as the database before running things.

- Fix docstring typos
- Some function calls were not renamed.

Quentin Campos authored 8 years ago and Antoine R. Dumont committed 8 years ago

Summary: Make some updates to the vault in order to prepare the next arrival of the revision cooker.

Reviewers: #reviewers, ardumont

Reviewed By: #reviewers, ardumont

Subscribers: ardumont

Maniphest Tasks: T531

Differential Revision: https://forge.softwareheritage.org/D115

Closes D115

If you want the archiver to have cloud abilities, install the
package python3-swh.objstorage.cloud on the server as well.

Actions storage:
- Open cache_content_get to retrieve contents in cache
- sql/upgrades/080: Add stored procedure to read contents from cache

Actions archiver:
- d/control: Add dependency to archiver on python3-swh.objstorage.cloud
- Renamed Archiver(Director|Worker) to
ArchiverWithRetentionPolicy(Director|Worker)
- Add ArchiverToBackend(Director|Worker)
- Add new celery task dedicated for new workers
- Update docstring details

Related T555

Summary:
This API currently only concern the directories as it uses the first draft of the cooker.

Ref T532
Depends on D102

Reviewers: #reviewers!

Maniphest Tasks: T532

Differential Revision: https://forge.softwareheritage.org/D108

Summary:
This first version does create a compressed folder of an archive
directory but is not linked to any API or notification system.

This diff is submitted for architecture and code review and will evolve.

Reviewers: #reviewers!

Differential Revision: https://forge.softwareheritage.org/D102

As for python3-swh.storage.archiver, the runtime dependency on
python3-swh.core is the implicit one from python3-swh.storage.

The same note about splitting repository and adding explicit dependency
applies.

Related T557

Closes T460

Update the setup.py file in order to add the new created directory 'swh/storage/checker'

Closes T404