"README.rst" did not exist on "27860f4d50e84cf2d575cfbd01cf23f84500c7f7"
- Sep 23, 2022
-
-
Pierre-Yves David authored
This ensure we don't have any remaining `generic_type_validator` call that have not been optimized away.
-
Pierre-Yves David authored
This indirection seems useless and is probably the remains of some long forgotten rituals.
-
Pierre-Yves David authored
This should reduces function calls and speeds things up. It might be useful to introduce even more specialized validator in the future. It would also be useful to skip the intermediate try/except. Some of this will be done in later changesets.
-
Pierre-Yves David authored
This is currently doing nothing, but prepare for actually changing the generic validator into faster specialized variants.
-
Pierre-Yves David authored
Before this change we would do the following : 1) translate from_disk's object into `dict`, 2) sort these dict, 3) feed the list to `Directory.from_dict`, 4) create DirectoryEntry from these dict. Skipping the directory creating and directly creating the DirectoryEntries provide us with a small but stable and noticeable performance win. We tested this change on simple information of the Mercurial loader, with a noop-loader stockage: swh loader run mercurial https://foss.heptapod.net/mercurial/mercurial-devel directory=/data/repos/mercurial-devel = Median time of 3 run = before: 11 minute 56 seconds aftere: 11 minute 50 seconds On a profile of the same run, the `to_model` call of the from_disk's `Directory` class took the following percentage: before: 17% after: 15%
-
Pierre-Yves David authored
Do not create model object while sorting entry before creating model object. This is another case of "let us create object X to prepare the creation of object X", slowing things down. In practice, we will likely skip this code-path after the next changeset, however this seems useful to get this performance footgun out the way. We tested this change on simple information of the Mercurial loader, with a noop-loader stockage: swh loader run mercurial https://foss.heptapod.net/mercurial/mercurial-devel directory=/data/repos/mercurial-devel = Median time of 3 run = before 12 minutes 59 seconds after: 11 minute 56 seconds On a profile of the same run, the `to_model` call of the from_disk's `Directory` class took the following percentage: before: 24% after: 17%
-
Pierre-Yves David authored
Before this change, a Directory object was built to compute the `id` of we fed to the Directory object we built for `to_model`. We tested this change on simple information of the Mercurial loader, with a noop-loader stockage: swh loader run mercurial https://foss.heptapod.net/mercurial/mercurial-devel directory=/data/repos/mercurial-devel = Median time of 3 run = before: 17 minutes 48 seconds after: 12 minutes 59 seconds On a profile of the same run, the `to_model` call of the from_disk's `Directory` class took the following percentage: before: 43% after: 24%
-
- Aug 30, 2022
-
- Aug 08, 2022
-
-
vlorentz authored
This is needed by swh-scrubber when recomputing the hash of such snapshots.
- Aug 04, 2022
- Jul 19, 2022
-
- Jul 11, 2022
-
- Jul 06, 2022
-
-
vlorentz authored
It will be used by swh.storage.backfiller (so indirectly, swh.scrubber) to load directories from the postgresql database, whose schema accidentally allowed directories with duplicate entries -- without corrupting the shape of the directory too much.
-
- Jul 04, 2022
-
-
vlorentz authored
-
- May 01, 2022
-
-
John Ericson authored
We can use `format_git_object_from_parts` inside it.
-
- Apr 27, 2022
-
-
John Ericson authored
This would be useful for the IPFS bridge, and seems good to complete the API in any sense.
-
- Apr 11, 2022
-
-
David Douard authored
it's a piece of information used several times in the swh stack.
-
- Apr 08, 2022
-
-
Antoine Lambert authored
Related to T3922
-
- Mar 31, 2022
-
-
Antoine R. Dumont authored
-
- Mar 30, 2022
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Hypothesis: This makes the documentation build fail.
-
Antoine R. Dumont authored
This changes the deprecated :show-nested: instruction to the :nested: one [1]. This also fixes warning about misdefined block [2] [1] https://sphinx-click.readthedocs.io/en/latest/usage/#directive-click [2] ``` 10:38:38 Warning, treated as error: 10:38:38 /var/lib/jenkins/workspace/DMOD/tests-on-diff/docs/cli.rst:14:Literal block expected; none found. 10:38:38 make: *** [../../swh-docs/Makefile.sphinx:32: sphinx/html] Error 2 10:38:38 make: Leaving directory '/var/lib/jenkins/workspace/DMOD/tests-on-diff/docs' 10:38:38 ERROR: InvocationError for command '/usr/bin/make -I ../.tox/sphinx/src/swh-docs/swh/ -C docs' (exited with code 2) ```
-
- Mar 23, 2022
-
- Mar 18, 2022
-
-
David Douard authored
these fields are computed attributes and may be removed from the backend storage. Helps writing tests.
-
- Mar 16, 2022
-
-
vlorentz authored
This will be used by swh.storage.backfill's tests.
-
vlorentz authored
This reverts commit a0f54362. This means this commit removes the 'offset' and 'negative_utc' arguments. It also removes the 'negative_utc' attribute (which is not used anymore), but keeps an 'offset' property, which is an alias to 'offset_minutes()'. This is only to keep this commit readable; the next commit will remove this alias.
-
- Feb 10, 2022
-
-
vlorentz authored
This should slightly reduce the memory used by dir/rev/rel objects
-
- Jan 26, 2022
- Jan 21, 2022
-
- Jan 17, 2022
-
-
vlorentz authored
-
- Jan 14, 2022
-
- Jan 13, 2022
-
-
vlorentz authored
'offset' becomes a property instead of an attribute and constructor argument. This also removes both from the output of `.to_dict()`. This is step 6 of https://forge.softwareheritage.org/T3752 This will break packages that still use the constructor directly, ie. swh-storage and swh-loader-git (and tests of swh-loader-core and swh-loader-svn)
-
- Jan 12, 2022
-
-
vlorentz authored
-
- Jan 07, 2022
-