Skip to content
Snippets Groups Projects
  1. Jan 31, 2023
  2. Jan 30, 2023
  3. Jan 26, 2023
    • Antoine Lambert's avatar
      celery_backend/config: Fix missing comma in setup_log_handler · a65c4ed4
      Antoine Lambert authored
      Because of that missing comma, an exception was raised (tuple object is
      not callable) but it was caught and displayed by the _print_errors decorator
      so tests could not detect it.
      
      As a consequence, the logging configuration of celery workers was broken.
      
      Add a test to check if an exception was raised by the setup_log_handler
      function to avoid bad surprises when deploying to production or in
      docker.
      v1.5.1
      a65c4ed4
  4. Jan 25, 2023
  5. Jan 23, 2023
  6. Jan 02, 2023
  7. Dec 19, 2022
  8. Dec 08, 2022
  9. Dec 07, 2022
  10. Dec 06, 2022
  11. Oct 25, 2022
  12. Oct 18, 2022
  13. Oct 03, 2022
  14. Sep 23, 2022
  15. Sep 15, 2022
    • Antoine Lambert's avatar
      recurrent_visits: Allow to set no origins scheduled backoff in config · b1afdab9
      Antoine Lambert authored
      The send_visits_for_visit_type function uses a default schedule backoff
      of 20 minutes where there is no origins to schedule for a given visit
      type.
      
      It exists use cases when we would like that schedule backoff to be
      shorter in order to schedule listed origins for loading into the
      archive more rapidly, typically in the docker environment.
      
      So allow to set that backoff value through configuration.
      v1.2.2
      b1afdab9
  16. Aug 22, 2022
  17. Jul 29, 2022
  18. Jul 08, 2022
  19. Jun 03, 2022
  20. May 31, 2022
  21. May 12, 2022
  22. May 09, 2022
  23. May 06, 2022
  24. Apr 28, 2022
  25. Apr 27, 2022
  26. Apr 26, 2022
  27. Apr 21, 2022
  28. Apr 20, 2022
    • David Douard's avatar
      Make scheduling policy used in schedule_recurrent configurable · a76bb02f
      David Douard authored
      Add support for a configuration option "scheduling_policy" in the config
      file loaded by the 'swh scheduler schedule-recurrent' command. This
      config entry allows to specify the scheduling policies used by the
      schedule-recurrent tool, instead of having them hardcoded in the source
      code.
      
      A visit type policy config entry should have at least a 'weight' value
      for each policy.
      
      Default values are unchanged.
      
      Eg.:
      
        scheduling_policy:
          git:
            - policy: already_visited_order_by_lag
              weight: 55
              tablesample: 0.5
            - policy: never_visited_oldest_update_first
              weight: 45
              tablesample: 0.5
      
      Note: there may not be configuration entries for all visit types, but if
            a visit type policy is configured, the config entry should be complete
            (in other words, the merging of the configuration with the default
            values is only done at first config level).
      a76bb02f
  29. Apr 08, 2022
Loading