Skip to content
Snippets Groups Projects
  1. Jan 11, 2022
  2. Jan 10, 2022
  3. Dec 16, 2021
  4. Dec 13, 2021
  5. Nov 23, 2021
  6. Nov 19, 2021
  7. Oct 26, 2021
    • Antoine Lambert's avatar
      search: Ensure CodeMeta dates are properly formatted · edb812ab
      Antoine Lambert authored
      Some date values that can be found in codemeta.json files (dateCreated,
      dateModified, datePublished) might be in a format not parsable by
      elasticsearch which prevents successfull update of origin intrinsic
      metadata in elasticsearch indices.
      
      For instance, the date 2021-7-23 cannot be parsed by elasticsearch
      as it expects 2021-07-23 instead.
      
      So ensure to properly format CodeMeta dates to avoid such indexing
      errors.
      edb812ab
  8. Sep 29, 2021
  9. Sep 28, 2021
  10. Sep 08, 2021
  11. Sep 07, 2021
  12. Sep 03, 2021
  13. Sep 02, 2021
    • Antoine Lambert's avatar
      Remove Makefile.local · abf46aa8
      Antoine Lambert authored
      Tree-sitter parser compilation is now handled in setup.py or
      directly in the code so that file can be removed.
      
      It also fixes make test invocation.
      abf46aa8
  14. Aug 31, 2021
  15. Aug 26, 2021
    • vlorentz's avatar
      Add support for 'development' installs · 4f01acc1
      vlorentz authored
      aka. 'pip install -e' or 'python3 setup.py develop'.
      
      This is done by compiling a temporary .so at runtime.
      v0.11.3
      4f01acc1
    • vlorentz's avatar
      Remove .wasm from all distributions, and .so from source distributions · 3940daa8
      vlorentz authored
      .so is still built, but only for binary distributions (it can be built
      from a source distribution).
      
      To do this, we now include intermediary files (parser.c in particular)
      in the source distribution.
      They are not really source file, but this allows to remove the dependency
      on a nodejs runtime to install from pypi.
      3940daa8
    • Antoine Lambert's avatar
      search: Add visit_types_count to interface · 3893e39e
      Antoine Lambert authored
      It enables to return the origin counts per visit type.
      
      It also enables to get all available visit types dynamically in
      other components like swh-web.
      
      The underlying elasticsearch query has been tested on production
      cluster and it is pretty efficient.
      
      Related to T3441.
      3893e39e
  16. Aug 19, 2021
  17. Aug 18, 2021
    • Kumar Shivendu's avatar
      grammar.js: Improve grammar and export tokens · db47029f
      Kumar Shivendu authored
      - Export grammar tokens through tokens.js file (so that swh-web can use them)
      - Improvements in the grammar to better handle sort_by and limit
      - Introduce annotateFilter function in grammar.js to assign tree-sitter fields to
        different parts of a filter (field, op, value)
      v0.11.2
      db47029f
  18. Aug 17, 2021
  19. Aug 16, 2021
  20. Aug 13, 2021
  21. Aug 09, 2021
  22. Aug 06, 2021
  23. Jul 30, 2021
  24. Jul 28, 2021
  25. Jul 26, 2021
    • Kumar Shivendu's avatar
      grammar.js: Segregate sort_by and limit from filters · 05efa541
      Kumar Shivendu authored
      The grammar should not allow using sort_by and limit more than once throughout
      the query.
      
      Unlike other filters, these two must not be concatenated by 'and' or 'or'
      05efa541
    • Kumar Shivendu's avatar
      query_language: Setup tree-sitter and grammar.js · 2edbbbe8
      Kumar Shivendu authored
      This revision defines the grammar for the search query language and
      prepares swh.search for a smoother development of the grammar.
      
      The parsers generated from the proposed grammar serve two different purposes:
      - Translation of search queries into elasticsearch DSL in swh.search (or any
      other search backend that we may use in the future)
      - Autocompletion of the queries in the swh.web (Archive UI)
      
      tree-sitter has been selected for the task because it has bindings for
      python (swh.search) as well as wasm (swh.web).
      2edbbbe8
  26. Jul 23, 2021
    • Nicolas Dandrimont's avatar
      Always flush kafka producers in tests · 122d7caf
      Nicolas Dandrimont authored
      Sometimes, in a very loaded situation, the producer can return and let
      the consumer start before the topic is actually created.
      
      Adding a `producer.flush()` avoids that race condition.
      122d7caf
  27. Jul 22, 2021
  28. Jul 21, 2021
Loading