- Mar 26, 2025
-
-
Nicolas Dandrimont authored
-
- Feb 17, 2025
-
-
Antoine Lambert authored
Bump development tools: mypy, codespell, isort, ... Move all tools configuration in pyproject.toml. Remove no longer needed mypy overrides.
-
- Nov 26, 2024
-
-
Nicolas Dandrimont authored
We already log a final failure, having failures that will be retried get logged, especially at ERROR level, is confusing when glancing at logs.
-
- Aug 27, 2024
-
-
David Douard authored
-
David Douard authored
-
- Jul 23, 2024
-
-
Antoine Lambert authored
Some recent changes in the tenacity package broke the tests in the test_replay_errors file, so adapt the implementation of the copy_object_q function to make them pass again.
-
- May 28, 2024
-
-
Antoine Lambert authored
-
- Apr 02, 2024
-
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
This will let us do a "passive" scrub of the source objstorage before populating the destination objstorage. This will also avoid replicating the "wrong" object when replicating an object subject to a sha1 collision.
-
Nicolas Dandrimont authored
This will allow reusing the error logging outside of a retried function.
-
- Mar 29, 2024
-
-
Antoine Lambert authored
They were previously stored in binary format making them not exploitable from the sentry web UI.
-
David Douard authored
-
- Mar 13, 2024
-
-
David Douard authored
This reverts commit ebf20c2d. The actual fix for this is to make swh.objstorage an actual namespace instead of a package, aka remove the (empty) __init__.py file in swh.objstorage. It seems this "package used a s a namespace" used to work, but not any more.
-
- Feb 13, 2024
-
-
Antoine Lambert authored
As swh.objstorage.replayer is a sub-package in the swh.objstorage implicit namespace, pytest could not import the swh.objstorage.replayer modules as it could not find the swh.objstorage.replayer one. To fix that issue and ensure than tests can be run in a local venv but also with tox, remove the use of the `--import-mode=importlib` pytest option and use relative imports instead of absolute ones when required.
-
- Feb 05, 2024
-
-
Antoine Lambert authored
Related to swh/meta#5075.
-
- Dec 13, 2023
-
-
Nicolas Dandrimont authored
Stop relying on the implicit assumption that object storages can be accessed with bare sha1 hashes. Keep the sha1-exclude-file mechanism as the S3 inventory for which it was introduced still relies on sha1, at least for now. To pave the way for future changes in swh.objstorage, also adapt tests to remove the assumption that InMemoryObjStorage state will remain keyed by sha1 (by using the _state_key function). This changes the key in the redis failure reporter to reference all hashes instead of just sha1.
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
-
- Dec 05, 2023
-
-
David Douard authored
-
David Douard authored
-
- Dec 03, 2023
-
-
David Douard authored
-
- Nov 30, 2023
-
-
David Douard authored
-
- Nov 20, 2023
-
-
David Douard authored
-
- Nov 16, 2023
-
-
David Douard authored
Convert README from markdown to ReST to make it embeddable in docs/index.rst
-
- Jul 07, 2023
-
-
David Douard authored
It now needs types-click which is indeed a dependency of swh.core[testing].
-
David Douard authored
- add config entry in pyproject.toml - add a section in tox.ini (not executed by default for now) - fix test_cli.py to please ruff (C401 rule)
-
- May 12, 2023
-
-
vlorentz authored
-
- Mar 08, 2023
-
-
David Douard authored
and classify as Production/Stable.
-
- Mar 07, 2023
-
-
David Douard authored
this allows to make it actually benefit from multithreading, by not sharing objstorage instances between threads. Note: the doctest formely in process_replay_objects_content's docstring has been moved to a proper test in test_replay.py; the required mocking to make it work is not suitable for docstring anymore.
-
- Feb 17, 2023
-
-
Antoine Lambert authored
Related to swh/meta#4960
-
- Feb 16, 2023
-
-
Jérémy Bobbio (Lunar) authored
Related to swh/meta#4959
-
- Feb 02, 2023
-
-
Antoine Lambert authored
This fixes python 3.7 support due to poetry, a dependency of isort, that removed support for that Python version in a recent release.
-
- Jan 09, 2023
-
-
- Dec 19, 2022
-
-
Antoine Lambert authored
In order to remove warnings about /apidoc/*.rst files being included multiple times in toc when building full swh documentation, prefer to include module indices only when building standalone package documentation. Also include them the proper sphinx way. Related to T4496
-
- Dec 16, 2022
-
-
David Douard authored
This option allows to set a maximum size for content objects to be replicated in the destination objstorage.
-
- Dec 09, 2022
-
-
David Douard authored
-
David Douard authored
Add a few debug logging statements and improve the info-level summary statement at the end of `process_replay_objects_content()`. Fix tests accordingly.
-
David Douard authored
to make it a bit more robust and give more details on what's going on in case of errors. Add tests for those error situations.
-
- Oct 27, 2022
-
-
Antoine Lambert authored
Side effect of rDJNL1d879f1dd6247b74d7e58dd0b4bd7b498ab506f0.
-
- Oct 18, 2022
-
-
David Douard authored
- pre-commit from 4.1.0 to 4.3.0, - codespell from 2.2.1 to 2.2.2, - black from 22.3.0 to 22.10.0 and - flake8 from 4.0.1 to 5.0.4. Also freeze flake8 dependencies. Also change flake8's repo config to github (the gitlab mirror being outdated).
-