Skip to content
Snippets Groups Projects
  1. Jun 03, 2022
  2. Jun 02, 2022
  3. Jun 01, 2022
  4. May 31, 2022
  5. May 25, 2022
    • vlorentz's avatar
      Add support for indexing directly from the journal client · ecc84f37
      vlorentz authored
      Before this commit, the journal client only created scheduler tasks,
      which then run the indexers.
      
      This commit adds support for a new flow: skipping the scheduler,
      to run indexers directly.
      This new behavior is triggered by adding a new argument on the CLI,
      which is the name of the indexer to run (currently, only
      `origin-intrinsic-metadata`).
      
      This has the following consequences:
      
      * a crash in an indexer will now hang the whole thing (which is
        arguably good)
      * the journal client will probably need to be parallelized to
        keep up with the load
      * we can remove an existence check for origins
      
      In term of deployment:
      
      1. stop the old journal client
      2. wait for all tasks to finish
      3. stop and remove celery workers and queues
      4. start the new journal client (it can reuse the group_id to avoid
         re-indexing, but I think it is a good opportunity to reindex because
         of all the temporary failures we had over time)
      v1.1.0
      ecc84f37
    • vlorentz's avatar
      Refactor base indexers to provide a process_journal_objects method · 35ff46ef
      vlorentz authored
      It will be used in a future commit to run indexers directly from
      a journal client.
      35ff46ef
    • vlorentz's avatar
      Convert test_metadata from unittest to pytest · 32236e69
      vlorentz authored
      A future commit will need pytest parametrization
      32236e69
  6. May 24, 2022
  7. May 12, 2022
  8. May 09, 2022
  9. May 02, 2022
  10. Apr 26, 2022
  11. Apr 21, 2022
  12. Apr 19, 2022
  13. Apr 08, 2022
  14. Apr 06, 2022
  15. Mar 22, 2022
    • Antoine Lambert's avatar
      pytest: Exclude build directory for tests discovery · 620e3a02
      Antoine Lambert authored
      Due to test modules being copied in subdirectories of the
      build directory by setuptools, it makes pytest fail by raising
      ImportPathMismatchError exceptions when invoked from root
      directory of the module.
      
      So ignore the build folder to discover tests.
      620e3a02
  16. Feb 24, 2022
  17. Feb 10, 2022
  18. Feb 07, 2022
  19. Jan 21, 2022
  20. Jan 11, 2022
  21. Dec 21, 2021
  22. Dec 16, 2021
  23. Jun 09, 2021
  24. May 28, 2021
  25. May 06, 2021
Loading