ValueError: swh:1:dir:18025f166aa970fa5dc4e4e1adf0adcdc5fa1ecf has duplicated entry name: b'_posts'
Sentry Issue: SWH-SCRUBBER-2V
ValueError: swh:1:dir:18025f166aa970fa5dc4e4e1adf0adcdc5fa1ecf has duplicated entry name: b'_posts'
(14 additional frame(s) were not displayed)
...
File "swh", line 8, in <module>
sys.exit(main())
File "<attrs generated init swh.model.model.Directory>", line 7, in __init__
Implementation of Software Heritage's data model
More complete stack:
journal-checker Running swh command scrubber check journal journal-checker-directory
journal-checker Traceback (most recent call last):
journal-checker File "/opt/swh/.local/bin/swh", line 8, in <module>
journal-checker sys.exit(main())
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/core/cli/__init__.py", line 174, in main
journal-checker return swh(auto_envvar_prefix="SWH")
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
journal-checker return self.main(*args, **kwargs)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/core.py", line 1078, in main
journal-checker rv = self.invoke(ctx)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
journal-checker return _process_result(sub_ctx.command.invoke(sub_ctx))
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
journal-checker return _process_result(sub_ctx.command.invoke(sub_ctx))
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
journal-checker return _process_result(sub_ctx.command.invoke(sub_ctx))
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
journal-checker return ctx.invoke(self.callback, **ctx.params)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
journal-checker return __callback(*args, **kwargs)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/click/decorators.py", line 33, in new_func
journal-checker return f(get_current_context(), *args, **kwargs)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/scrubber/cli.py", line 418, in scrubber_check_journal
journal-checker checker.run()
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/scrubber/journal_checker.py", line 92, in run
journal-checker self.journal_client.process(self.process_kafka_messages)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/journal/client.py", line 405, in process
journal-checker batch_processed, at_eof = self.handle_messages(messages, worker_fn)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/journal/client.py", line 444, in handle_messages
journal-checker worker_fn(dict(objects))
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/scrubber/journal_checker.py", line 99, in process_kafka_messages
journal-checker object_ = cls.from_dict(kafka_to_value(message))
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/model/model.py", line 1249, in from_dict
journal-checker return cls(
journal-checker File "<attrs generated init swh.model.model.Directory>", line 7, in __init__
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/attr/_make.py", line 2927, in __call__
journal-checker v(inst, attr, value)
journal-checker File "/opt/swh/.local/lib/python3.10/site-packages/swh/model/model.py", line 1240, in check_entries
journal-checker raise ValueError(
journal-checker ValueError: swh:1:dir:18025f166aa970fa5dc4e4e1adf0adcdc5fa1ecf has duplicated entry name: b'_posts'
journal-checker Sentry is attempting to send 2 pending events
journal-checker Waiting up to 2 seconds
journal-checker Press Ctrl-C to quit
Stream closed EOF for swh/scrubber-journalchecker-directory-f9cb4dbfd-njwds (journal-checker)
Stream closed EOF for swh/scrubber-journalchecker-directory-f9cb4dbfd-njwds (prepare-configuration)
The journal client crash after that.
Edited by Vincent Sellier