- Aug 31, 2021
-
-
Jenkins for Software Heritage authored
Update to upstream version '0.11.4' with Debian dir fb0cb09fad2c04bab635a09285e3837e48aa12e5
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
-
vlorentz authored
-
Nicolas Dandrimont authored
-
Jenkins for Software Heritage authored
Update to upstream version '0.11.3' with Debian dir c3507b513bc6c456110f68601baad86618a82ae0
- Aug 26, 2021
-
-
vlorentz authored
.so is still built, but only for binary distributions (it can be built from a source distribution). To do this, we now include intermediary files (parser.c in particular) in the source distribution. They are not really source file, but this allows to remove the dependency on a nodejs runtime to install from pypi.
-
Antoine Lambert authored
It enables to return the origin counts per visit type. It also enables to get all available visit types dynamically in other components like swh-web. The underlying elasticsearch query has been tested on production cluster and it is pretty efficient. Related to T3441.
- Aug 19, 2021
-
-
Antoine Lambert authored
The swh_sql.so file must be built prior running the tests.
-
- Aug 18, 2021
-
-
Jenkins for Software Heritage authored
Update to upstream version '0.11.2' with Debian dir 2708a39592f7190b53b2ddec5ab37e5b416be8f8
-
Kumar Shivendu authored
- Export grammar tokens through tokens.js file (so that swh-web can use them) - Improvements in the grammar to better handle sort_by and limit - Introduce annotateFilter function in grammar.js to assign tree-sitter fields to different parts of a filter (field, op, value)
- Aug 17, 2021
-
-
Kumar Shivendu authored
Add support for rpc server in swh-search cli (Like other swh services)
-
- Aug 16, 2021
-
-
Jenkins for Software Heritage authored
Update to upstream version '0.11.1' with Debian dir 2f9c8a5295a6813a1b7fe77878ba7c3be5c9d472
- Aug 13, 2021
-
-
vlorentz authored
and rewrite them in Python, with error checking (instead of failing silently)
-
Jenkins for Software Heritage authored
Update to upstream version '0.11.0' with Debian dir 44679c4ae667c196a25b27be64677cc9c37033c7
-
Vincent Sellier authored
Related to T3484
-
- Aug 09, 2021
-
- Aug 06, 2021
-
-
Kumar Shivendu authored
Integrate the query language translator in the Elasticsearch implementation
-
- Jul 30, 2021
-
-
vlorentz authored
Putting it in a subdirectory that isn't a subpackage should make it undiscoverable.
-
Kumar Shivendu authored
Translate swh search query language queries into Elasticsearch DSL
-
- Jul 28, 2021
-
-
vlorentz authored
Like this: ``` ql_rel_paths = [ "swh_ql.so", # installed "../../query_language/swh_ql.so", # development ] for ql_rel_path in ql_rel_paths: ql_path = resource_filename("swh.search", ql_rel_path) if os.path.exists(ql_path): break else: assert False, 'not found' search_ql = Language(ql_path, "swh_search_ql") ``` `data_files` is not designed to be accessed from the same Python package, but to write files in standard locations (typically `.desktop` files in /usr/share) that other packages read with their own discovery mechanisms.
-
vlorentz authored
-
- Jul 26, 2021
-
-
Kumar Shivendu authored
The grammar should not allow using sort_by and limit more than once throughout the query. Unlike other filters, these two must not be concatenated by 'and' or 'or'
-
Kumar Shivendu authored
This revision defines the grammar for the search query language and prepares swh.search for a smoother development of the grammar. The parsers generated from the proposed grammar serve two different purposes: - Translation of search queries into elasticsearch DSL in swh.search (or any other search backend that we may use in the future) - Autocompletion of the queries in the swh.web (Archive UI) tree-sitter has been selected for the task because it has bindings for python (swh.search) as well as wasm (swh.web).
-
- Jul 23, 2021
-
-
Nicolas Dandrimont authored
Sometimes, in a very loaded situation, the producer can return and let the consumer start before the topic is actually created. Adding a `producer.flush()` avoids that race condition.
-
- Jul 22, 2021
-
-
Kumar Shivendu authored
Documentation for the proposed search query language
-
- Jul 21, 2021
-
-
Nicolas Dandrimont authored
The origin_visit_status topic now contains the `type` key, which is all the information that we used in the origin_visit topic; We can stop processing that topic altogether.
-