Skip to content

scheduler's cron cleanup error when filtering tasks to archive

From checking saatchi's node as swhscheduler user (through mail or mutt):

Date: Wed, 24 Jul 2019 08:52:05 +0000 (UTC)
From: Cron Daemon <root@saatchi.internal.softwareheritage.org>
To: swhscheduler@saatchi.internal.softwareheritage.org
Subject: Cron <swhscheduler@saatchi> /usr/bin/swh scheduler --config-file /etc/softwareheritage/backend/elastic.yml task archive

INFO:swh.core.config:Loading config file /etc/softwareheritage/global.ini
INFO:swh.core.config:Loading config file /etc/softwareheritage/worker.ini
INFO:swh.core.config:Loading config file /etc/softwareheritage/backend/elastic.yml
[INFO] swh.core.config -- Loading config file /etc/softwareheritage/backend/elastic.yml
Traceback (most recent call last):
  File "/usr/bin/swh", line 11, in <module>
    load_entry_point('swh.core==0.0.63', 'console_scripts', 'swh')()
  File "/usr/lib/python3/dist-packages/swh/core/cli/__init__.py", line 56, in main
    return swh(auto_envvar_prefix='SWH')
  File "/usr/lib/python3/dist-packages/click/core.py", line 716, in __call__
    return self.main(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/click/core.py", line 696, in main
    rv = self.invoke(ctx)
  File "/usr/lib/python3/dist-packages/click/core.py", line 1060, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 1060, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 1060, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/lib/python3/dist-packages/click/core.py", line 889, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/lib/python3/dist-packages/click/core.py", line 534, in invoke
    return callback(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/lib/python3/dist-packages/swh/scheduler/cli/task.py", line 553, in archive_tasks
    for task_ids in grouper(gen, n=batch_clean):
  File "/usr/lib/python3/dist-packages/swh/core/utils.py", line 48, in grouper
    for _data in itertools.zip_longest(*args, fillvalue=stop_value):
  File "/usr/lib/python3/dist-packages/swh/scheduler/cli/task.py", line 538, in index_data
    after, before, last_id=last_id, limit=batch_index)
  File "/usr/lib/python3/dist-packages/swh/scheduler/api/client.py", line 102, in filter_task_to_archive
    'last_id': last_id,
  File "/usr/lib/python3/dist-packages/swh/core/api/__init__.py", line 198, in post
    return self._decode_response(response)
  File "/usr/lib/python3/dist-packages/swh/core/api/__init__.py", line 235, in _decode_response
    response.content,
swh.core.api.RemoteException: Unexpected status code for API request: 504 (b'<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor="white">\r\n<center><h1>504 Gateway
+Time-out</h1></center>\r\n<hr><center>nginx/1.10.3</center>\r\n</body>\r\n</html>\r\n')

Migrated from T1931 (view on Phabricator)

Edited by Phabricator Migration user