Project 'infra/sysadm-environment' was moved to 'swh/infra/sysadm-environment'. Please update any links and bookmarks that may still have the old path.
Compared to the production, the compression was not activated on the zfs pool:
root@kafka1:~# zfs get all data/kafka | grep compressdata/kafka compressratio 1.55x -data/kafka compression lz4 inherited from datadata/kafka refcompressratio 1.55x -
root@journal0:/tmp# zfs get all | grep compresskafka-volume compressratio 1.00x -kafka-volume compression off defaultkafka-volume refcompressratio 1.00x -
So the compression was activated :
root@journal0:/tmp# zfs set compression=lz4 kafka-volumeroot@journal0:/tmp# zfs get all | grep compresskafka-volume compressratio 1.00x -kafka-volume compression lz4 localkafka-volume refcompressratio 1.00x -
As this parameter is only used for the new written data, we have force a compact on the biggest topics : directory, revision and content
% ./kafka-topics.sh --zookeeper $ZK --alter --topic swh.journal.objects.revision --config min.cleanable.dirty.ratio=0.01WARNING: Altering topic configuration from this script has been deprecated and may be removed in future releases. Going forward, please use kafka-configs.sh for this functionalityUpdated config for topic swh.journal.objects.revision.vsellier@journal0 /opt/kafka/bin % ./kafka-topics.sh --zookeeper $ZK --alter --topic swh.journal.objects_privileged.revision --config min.cleanable.dirty.ratio=0.01WARNING: Altering topic configuration from this script has been deprecated and may be removed in future releases. Going forward, please use kafka-configs.sh for this functionalityUpdated config for topic swh.journal.objects_privileged.revision. % ./kafka-topics.sh --zookeeper $ZK --alter --topic swh.journal.objects..directory --config min.cleanable.dirty.ratio=0.01WARNING: Altering topic configuration from this script has been deprecated and may be removed in future releases. Going forward, please use kafka-configs.sh for this functionalityUpdated config for topic swh.journal.objects.directory % ./kafka-topics.sh --zookeeper $ZK --alter --topic swh.journal.objects..content --config min.cleanable.dirty.ratio=0.01WARNING: Altering topic configuration from this script has been deprecated and may be removed in future releases. Going forward, please use kafka-configs.sh for this functionalityUpdated config for topic swh.journal.objects.content
After the compact:
root@journal0:~# df -h /srv/kafka/logdirFilesystem Size Used Avail Use% Mounted onkafka-volume 481G 187G 295G 39% /srv/kafka/logdirroot@journal0:~# zfs get all | grep compresskafka-volume compressratio 2.21x -kafka-volume compression lz4 localkafka-volume refcompressratio 2.21x -
The configuration to compact the topics with a small ratio is left in place for the moment.