This removes all the warnings related to comparing a ModelObjectType
enum with a string literal.

Use importlib.metadata instead.

Bump development tools: mypy, codespell, isort, ...

Move all tools configuration in pyproject.toml.

Remove no longer needed mypy overrides.

vlorentz authored 7 months ago and vlorentz committed 2 months ago

All offsets are now exported before all contents, so it makes more sense to log
the topic being exported on each line, now.

vlorentz authored 1 year ago and vlorentz committed 7 months ago

They allow looking for high cardinality values without decompressing most stripes
not containing any (equality) match.

vlorentz authored 11 months ago and vlorentz committed 11 months ago

This lowers the number of orphan nodes.

Additionally, Kafka consumers occasionally hang forever on the .close() call after
getting offsets, and changing the other this way seems to fix it.

(And even if it does not fix the issue, this change makes them hang shortly after
the process started so it can be restarted quickly, instead of waiting hours before
it hangs.)

Related to swh/meta#5075.

As it might be easy to overlook that the dataset we provide are covered
by both an Ethical Charter and Terms of Usage for bulk access, put the
index behind a “I will respect the Ethical Charter and Terms of Use”.

This in done via some simple JavaScript that hides the index sections,
and add a button that will make them reappear on click. We remember
the click for next vists using the browser local storage.