replayer/replay: Remove no longer needed tenacity workarounds

Now that we have packaged tenacity 6.2 for debian buster and use it in production, we can remove the workarounds to support tenacity < 5.

---

Migrated from D6786 (view on Phabricator)