Provide a default max_queue_length value to task_type (!354) · Merge requests · Platform / Development / swh-scheduler

Antoine R. Dumont requested to merge ardumont/swh-scheduler:fix-provide-default-max-queue-length into master Oct 02, 2023

Because the register task type routine does not provide the value, it's left unchecked. Once a new lister starts listing origins, the scheduler keeps on scheduling new origins in the queue without limits. As the consumption may be slower than the production of messages, that tends towards too much resources usage in rabbitmq.

This should limit the issue for new deployments.

Edited Oct 02, 2023 by Antoine R. Dumont

Provide a default max_queue_length value to task_type

Merge request reports