- Apr 20, 2020
-
-
Antoine R. Dumont authored
Related to T2367
-
- Apr 08, 2020
-
-
David Douard authored
-
David Douard authored
- blackify all the python files, - enable black in pre-commit, - add a black tox environment.
-
- Mar 27, 2020
-
-
David Douard authored
-
Antoine R. Dumont authored
This aligns with other journal clients. This lets the main loop being done by the journal client base class.
-
- Mar 26, 2020
-
-
Antoine R. Dumont authored
Origin model no longer allows types. Related to f533f62bbf114cfcc29f7c72307c4dfbe99cf048
-
vlorentz authored
The option was renamed in swh-journal v0.0.27
-
- Mar 16, 2020
-
-
Antoine R. Dumont authored
Related to D2820
-
- Mar 08, 2020
-
-
Antoine R. Dumont authored
Old task have a parse_ids passed in their kwargs arguments, which pass through the index_list. This is no longer used but currently break. This commit fixes the behavior to allow the task to continue its work. Related https://sentry.softwareheritage.org/share/issue/5ccef623905747b7b4cff7de859aaceb/
-
- Mar 06, 2020
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Prior to this commit, this used the storage ones.
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
The decorator @process_metrics is already doing this job. The send_metric function is for the other endpoints which do not return a summary.
-
Antoine R. Dumont authored
-
- Mar 05, 2020
-
-
-
Antoine R. Dumont authored
Prior to this commit, this ended up running twice the insertion query. First time, on conflict actually inserting data, then running again. The second extra time being a noop (plus costing extra time), thus returning a summary of no new elements inserted. The tests must be improved to actually check the insertion output. It's not the case or it would have been caught already.
-
Antoine R. Dumont authored
-
- Mar 04, 2020
-
-
Antoine R. Dumont authored
-
vlorentz authored
The codemeta module was missing 'merge_values' even though it was the logical place, and its tests were scattered around multiple other modules' tests. This commit moves all these in codemeta.py and test_codemeta.py.
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
This also tries to type a tad better the indexers.
-
- Mar 03, 2020
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
This will allow to send metrics at some point.
-
Antoine R. Dumont authored
This allowed to chain indexers together. It's not used, so to simplify maintenance, remove it.
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
- Feb 27, 2020
-
-
Antoine R. Dumont authored
This also clarifies the intent.
-
Antoine R. Dumont authored
Similarly to what we do in the swh.storage. Related to D2580
-
- Feb 25, 2020
-
-
Antoine R. Dumont authored
`storage.origin_get` can return None as origin. This adds the behavior to skip those None origin instead of failing the indexing task. Related https://sentry.softwareheritage.org/share/issue/8551b4a0ed694e09ad1ad7bde047e48f/
-
- Feb 24, 2020
-
-
Antoine R. Dumont authored
This should improve the textual content reading queries. Related to T1788
-
Antoine R. Dumont authored
In production, the previous query version takes too long to finish. This ended up with timeouts (with query still running in the pg backend). Accumulating similar new queries. Counter-intuitively, specifying twice the range query to use (both in content_mimetype and content_fossology_license), the execution now returns immediately. Close T1788
-
- Feb 18, 2020
-
-
vlorentz authored
And re-raise them through the RPC layer. This is now required by swh-core, as exceptions are no longer pickled.
-
- Feb 12, 2020