- May 03, 2017
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
- May 02, 2017
-
-
Antoine R. Dumont authored
Related T713
-
Antoine R. Dumont authored
Related T713
-
Antoine R. Dumont authored
Related T712
-
- Apr 28, 2017
-
-
Antoine R. Dumont authored
Related T712
-
Antoine R. Dumont authored
Related T712
-
Antoine R. Dumont authored
If there are no hashes to recompute, do not read the content from objstorage. This optimization will only be useful for the case of the parameter recompute_checksum being false (which is the case in production for now) Related T712
-
- Apr 27, 2017
-
-
Antoine R. Dumont authored
Related T712
-
- Apr 26, 2017
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Related T712
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
- Mar 21, 2017
-
-
Antoine R. Dumont authored
Related T692
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Related T692 Closes D186
-
Antoine R. Dumont authored
The default behavior being to send directly hashes. This adaptation permits to send a dict whose key is specified as parameter of the script. Related T692
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Related T692
-
Antoine R. Dumont authored
For all contents: - 'compute_checksums' option define checksums to (re)compute - check the content's already defined checksums against that list - If some are in 'compute_checksums' and already defined for that content, recompute those only if recompute_checksums is true. - Compute all other checksums mentioned in 'compute_checksums' for that content - update the content's metadata in db Related T692
-
Antoine R. Dumont authored
- Rename module from recompute to rehash - Rename options with more appropriate names - Improve methods' docstring and respect naming conventions - Fix wrong type value for option (use a boolean) - Fix wrong configuration key call Related T692
-
Antoine R. Dumont authored
This no longer fetches metadata from contents. The contents passed as parameter should be self-contained and in adequation with the 'primary_key' configuration option. As of now, that primary key is 'sha1'. Unknown or corrupted contents are skipped. Add some other improvments: - Improve docstrings - Align option names with _ as per usual conventions - Add a batch_size to retrieve contents' blobs - Add another batch_size for the update contents operations Related T692
-
Antoine R. Dumont authored
Related T692
-
Antoine R. Dumont authored
Related T692
-
- Mar 17, 2017
-
-
Antoine R. Dumont authored
Related T700
-
- Feb 09, 2017
-
-
Antoine Pietri authored
-
- Dec 02, 2016
-
-
Antoine R. Dumont authored
Related T610
-
Antoine R. Dumont authored
Related T610
-
- Nov 18, 2016
-
-
Antoine R. Dumont authored
Related T574
-
- Nov 15, 2016
-
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Default queue is the orchestrator's. Now, we can send messages to other indexer queues. Related T596
-
Antoine R. Dumont authored
Related T596
-
- Nov 14, 2016
-
-
Antoine R. Dumont authored
Related T596
-
Antoine R. Dumont authored
Related T596
-
- Nov 10, 2016
-
-
Antoine R. Dumont authored
Align behavior with other indexers
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
Add tool information to provide to swh storage endpoint
-
- Nov 09, 2016
-
-
Antoine R. Dumont authored
Related T596
-
Antoine R. Dumont authored
Related T596
-