- Mar 22, 2023
-
-
David Douard authored
- Drop the AzureCloudObjStorage in favor of using the PrefixedAzureObjStorage (with "" prefix) - Drop support for (deprecated) configuration based on account name and key - Adapt a bit the Azurite based tests and add a couple of test cases (especially non-sha1 primary hash and a 32 bits prefix test case).
-
David Douard authored
Simplify a bit the cloud provider logic behinf CloudObjStorage: - get rid of the _get_provider() method in favor of a simple constructor "provider" argument, - deprecate the 2 specialized classes AwsCloudObjStorage and OpenStackCloudObjStorage; one should directly use the CloudObjStorage instead, - deprecate "s3" and "swift" objstorage factory cls, - adapt tests accordingly.
-
David Douard authored
this will allow to use this name to add a statsd probe counting which backend has been successful in a multiplexed backend.
-
David Douard authored
The primary hash (aka the has used as primary key for the objstorage backend) used to be hardcoded as sha1, this makes it configurable among supported hashes (sha1, sha1_git, sha256 and blake2s256). For the remote api to work, a new `/config` endpoint has been added allowing a RPC client to ask the server for a config (generic dict), in which the "primary_hash" key is used to configure the client with the same primary hash as the server. If not such endpoint is available, defaults to "sha1".
-
- Mar 20, 2023
-
-
David Douard authored
-
David Douard authored
This can be helpful when using a seaweedfs objstorage with many threads.
-
- Feb 20, 2023
-
-
tox version 4 recommends using the `run` subcommand to run specific environments: https://tox.wiki/en/latest/upgrading.html#updating-usage-with-e
-
- Feb 17, 2023
-
-
Antoine Lambert authored
Related to swh/meta#4960
-
- Feb 16, 2023
-
-
Jérémy Bobbio (Lunar) authored
Related to swh/meta#4959
-
- Feb 02, 2023
-
-
Antoine Lambert authored
This fixes python 3.7 support due to poetry, a dependency of isort, that removed support for that Python version in a recent release.
-
- Jan 17, 2023
-
-
vlorentz authored
The existing type, {obj_id: content} did not allow composite obj_ids, because composite obj_ids are dicts so they are not hashable.
-
- Jan 16, 2023
-
-
David Douard authored
this actually requires quite some refactoring in the seaweedfs backend, mostly to support the (somewhat useless) `list_content()` and iterator methods.
-
David Douard authored
This method is mostly used for tests, and since we do not have any upper hard limit, it does not make it more dangerous to accept unlimited calls to this method, which on the other hand can be handy for tests with an objstorage having more objects than the DEFAULT_LIMIT value.
-
David Douard authored
-
- Jan 13, 2023
-
-
David Douard authored
-
- Jan 12, 2023
-
-
David Douard authored
-
- Dec 19, 2022
-
-
Antoine Lambert authored
In order to remove warnings about /apidoc/*.rst files being included multiple times in toc when building full swh documentation, prefer to include module indices only when building standalone package documentation. Also include them the proper sphinx way. Related to T4496
-
- Oct 25, 2022
-
-
vlorentz authored
In addition to add support for multi-hashes, we will need to use more advanced features of the Azure Blob Storage, so using only mock-based tests will be less reliable. This commit adds the option to run the test suite with Azurite, a clone of the Azure Blob Storage API, which is a standard tool used in tests.
-
- Oct 19, 2022
-
-
Antoine Lambert authored
-
- Oct 18, 2022
-
-
David Douard authored
- pre-commit from 4.1.0 to 4.3.0, - codespell from 2.2.1 to 2.2.2, - black from 22.3.0 to 22.10.0 and - flake8 from 4.0.1 to 5.0.4. Also freeze flake8 dependencies. Also change flake8's repo config to github (the gitlab mirror being outdated).
-
- Jul 13, 2022
-
- Jul 04, 2022
-
-
vlorentz authored
To conform to the existing signature
-
vlorentz authored
They are not used anywhere
-
vlorentz authored
For now, any hash algo other than ID_HASH_ALGO ("sha1") is ignored. This changes the network protocol used by `list_content` from a concatenation of fixed-length hashes to a stream of msgpacked dictionaries.
-
- Jun 23, 2022
- Jun 22, 2022
-
-
vlorentz authored
-
vlorentz authored
-
vlorentz authored
And this is necessary to make the function type-check.
-
vlorentz authored
It is not used anymore.
-
vlorentz authored
-
vlorentz authored
The return value was useless, as the same ObjId has to be passed as argument. And as far as I can tell, no other package depends on this return value.
-
- Jun 21, 2022
-
-
vlorentz authored
-
vlorentz authored
Like other backends. Allowing None will be an issue once we add type annotations to methods which use self.compression.
-
vlorentz authored
For consistency with ObjStorage.add()
-
vlorentz authored
In practice, it is not very useful to recompute it in the objstorage, as callers already know it.
-
Nicolas Dandrimont authored
-
- May 09, 2022
-
-
Pratyush authored
-
- Apr 26, 2022
-
-
vlorentz authored
-
- Apr 21, 2022
-
-
Antoine Lambert authored
That hook can be frustrating as it can discard a long commit message if it finds a typo in it so better removing it.
-