- Mar 06, 2020
-
-
Jenkins for Software Heritage authored
Update to upstream version '0.0.26' with Debian dir 62ef96c4560a6627ec4b6a4bda9ec0c27a102d6c
-
Nicolas Dandrimont authored
This will allow us to reuse it in more tests.
-
Nicolas Dandrimont authored
Uses logging keyword arguments for filtering, instead of plain arguments
-
Nicolas Dandrimont authored
-
Antoine R. Dumont authored
- Mar 04, 2020
-
-
Nicolas Dandrimont authored
Containment checking has a tendency to fail with an error 500 on S3, retrying smooths that out.
-
- Mar 03, 2020
-
-
Nicolas Dandrimont authored
Replaces docstring annotations with type annotations as well
-
Nicolas Dandrimont authored
This avoids reusing the same consumer group name on subsequent tests, which is a problem when some of the tests change the broker-side consumer group rebalance timeouts.
-
Nicolas Dandrimont authored
This trades bandwidth/processing time for more API queries, which can be a win if your exclusion file is a bit stale.
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
This allows us to get a better sense of the actual work done by the content replayer.
-
Nicolas Dandrimont authored
The new KAFKA_GROUP_INSTANCE_ID env variable can be set on journal clients to set the group.instance.id enable support for Kafka Static Consumer Groups. https://github.com/edenhill/librdkafka/pull/2525 https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3A+Introduce+static+membership+protocol+to+reduce+consumer+rebalances Combined with larger values for the session.timeout.ms and max.poll.interval.ms settings, this setting informs the Group Coordinator broker that the consumer group has static membership, and that the disappearance of a given member of the consumer group should not immediately trigger a rebalance; This allows crashing consumers to re-join the consumer group and start consuming from their assigned partitions immediately. This setting is implemented as an environment variable so that several consumers in the same group can share a configuration file, and still override the value (e.g. by setting `Environment=KAFKA_GROUP_INSTANCE_ID=groupname-%i` in a systemd template unit). When this setting is enabled, we also up the relevant values for session.timeout.ms and max.poll.interval.ms.
-
Nicolas Dandrimont authored
This matches the production environment. We need to add some bits to the zookeeper configuration, as the zookeeper bundled with kafka 2.4.0 starts the adminserver, which tries to bind to port 8080, by default.
-
- Mar 02, 2020
-
-
Nicolas Dandrimont authored
It makes the consumer crash with `generator didn't stop after throw()` exceptions. We'll reintroduce retry behavior at a later stage.
-
Nicolas Dandrimont authored
This change introduced subtly confusing behavior, where the storage.objstorage __getattr__ proxy hides itself, until you try a dunder method (e.g. `foo in storage.objstorage` or `iter(storage.objstorage)`), blows up in your face with a confusing exception (because the collaborator is _also_ called ObjStorage). Using the underlying objstorage works around that issue.
-
- Mar 01, 2020
-
-
Antoine R. Dumont authored
This fixes the current ci build failure [1] [1] https://jenkins.softwareheritage.org/job/DJNL/job/tests/717/console
-
- Feb 26, 2020
-
-
Antoine Pietri authored
-
- Feb 25, 2020
-
-
Antoine Pietri authored
Allow clients to override this behavior more easily in the client, notably the deserialization step where message metadata can be added to the objects.
-
- Feb 12, 2020
-
-
vlorentz authored
Required by swh-storage >= v0.0.172.
-
- Feb 11, 2020
-
-
vlorentz authored
-
- Feb 10, 2020
-
-
vlorentz authored
This new endpoint is now required by swh-storage for skipped contents.
-
- Jan 30, 2020
-
-
Jenkins for Software Heritage authored
Update to upstream version '0.0.25' with Debian dir a560a0abd2725f9f05a07a4f33424ef6c588c85e
-
vlorentz authored
- Jan 17, 2020
-
-
Antoine Lambert authored
Related to T2188
-
- Jan 15, 2020
-
-
Antoine R. Dumont authored
Related to D2522
-
- Jan 06, 2020
-
-
Jenkins for Software Heritage authored
Update to upstream version '0.0.24' with Debian dir 28c7225415bed944fea278746105c1df2316d2a5
-
Antoine Lambert authored
UnboundLocalError: local variable 'warnings' referenced before assignment was raised since a9fb7c73
- Jan 03, 2020
-
-
Jenkins for Software Heritage authored
Update to upstream version '0.0.23' with Debian dir a337293231ab88fb140113c6fd9833fb949a6f34
-
Nicolas Dandrimont authored
- Dec 24, 2019
-
-
Nicolas Dandrimont authored
-
Nicolas Dandrimont authored
This allows us to override producer settings such as message.max.bytes
-