Skip to content

2018-02-16 worker disk full postmortem

The root filesystem on worker13 is full and the host cannot process Mercurial data anymore.

The culprit seems to be the Mercurial loader itself. / tmp (part of the / filesystem) contains huge files and directories:

12G     sqldict6a19bb
17G     sqldict89fc16
786M    sqldict8f09fa
634M    sqldictc9c674
4.0K    swh.loader.deposit
14M     swh.loader.mercurial.10o7dn_1
4.0M    swh.loader.mercurial.31j86o5f
4.0K    swh.loader.mercurial.35gljinc
24M     swh.loader.mercurial.4p1f_0o0
52K     swh.loader.mercurial.d0y8x43e
50M     swh.loader.mercurial.dzr2_6_e
135M    swh.loader.mercurial.e1_1ejhy
100M    swh.loader.mercurial.g5d8i9y2
15M     swh.loader.mercurial.h_a2csx2
64M     swh.loader.mercurial.jz9z34ow
7.5M    swh.loader.mercurial.lcpqso3x
128M    swh.loader.mercurial.mjp_zken
919M    swh.loader.mercurial.mzlrf1cf
27M     swh.loader.mercurial.o4mn1ran
64M     swh.loader.mercurial.ox9etasm
64M     swh.loader.mercurial.sgyhmxh3
160K    swh.loader.mercurial.tk3ozyv2
35M     swh.loader.mercurial.wd3f3t4i
26M     swh.loader.mercurial.yo2tfris
12K     tmp7w5wd0ar
588K    tmpiary52zt
588K    tmpmiis9pv7

Migrated from T964 (view on Phabricator)

Edited by Phabricator Migration user