Skip to content

counters: Error during directory topic ingestion

Several error are logged during the directory topic ingestion :

Apr 01 07:36:41 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 5958409 of 8361 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:43 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 4526518 of 9496 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:43 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 5958409 of 8361 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:46 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 4526518 of 9496 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:46 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 5958409 of 8361 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:47 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 4526518 of 9496 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:48 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 5958409 of 8361 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:50 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 4526518 of 9496 bytes failed: Local: Invalid compressed data"}
Apr 01 07:36:51 counters1 swh[437167]: INFO:swh.journal.client:Received non-fatal kafka error: KafkaError{code=_BAD_COMPRESSION,val=-198,str="Decompression (codec 0x4) of message at 5958409 of 8361 bytes failed: Local: Invalid compressed data"}

the good news is the position is not commited when the error is raised so it will not be necessary to restart from the beginning.

Migrated from T3190 (view on Phabricator)

Edited by Vincent Sellier