To make sure corruptions such as T680 don't happen again, use the same
normalization function as swh.model before inserting timestamps into our
database.

This makes swh.storage reject non-integer timestamp values as well.

Update tests to reflect this change.

Closes T646

Related T646

Related T646

Related T613

The check_config method allows a dynamic check of the configuration for
a running storage. We can make sure that we have proper permissions on
the object storage as well as the database before running things.

- Fix docstring typos
- Some function calls were not renamed.

Quentin Campos authored 8 years ago and Antoine R. Dumont committed 8 years ago

Summary: Make some updates to the vault in order to prepare the next arrival of the revision cooker.

Reviewers: #reviewers, ardumont

Reviewed By: #reviewers, ardumont

Subscribers: ardumont

Maniphest Tasks: T531

Differential Revision: https://forge.softwareheritage.org/D115

Closes D115

If you want the archiver to have cloud abilities, install the
package python3-swh.objstorage.cloud on the server as well.

Actions storage:
- Open cache_content_get to retrieve contents in cache
- sql/upgrades/080: Add stored procedure to read contents from cache

Actions archiver:
- d/control: Add dependency to archiver on python3-swh.objstorage.cloud
- Renamed Archiver(Director|Worker) to
ArchiverWithRetentionPolicy(Director|Worker)
- Add ArchiverToBackend(Director|Worker)
- Add new celery task dedicated for new workers
- Update docstring details

Related T555

Summary:
This API currently only concern the directories as it uses the first draft of the cooker.

Ref T532
Depends on D102

Reviewers: #reviewers!

Maniphest Tasks: T532

Differential Revision: https://forge.softwareheritage.org/D108

Summary:
This first version does create a compressed folder of an archive
directory but is not linked to any API or notification system.

This diff is submitted for architecture and code review and will evolve.

Reviewers: #reviewers!

Differential Revision: https://forge.softwareheritage.org/D102

As for python3-swh.storage.archiver, the runtime dependency on
python3-swh.core is the implicit one from python3-swh.storage.

The same note about splitting repository and adding explicit dependency
applies.

Related T557

Closes T460

Update the setup.py file in order to add the new created directory 'swh/storage/checker'

Closes T404