Our pip usage is broken since a recent pip release

Multiple tools depend on pip and the way we are using it actually impeding in our tooling usage, at least:

• !150 (closed): virtualenv
• !153 (closed): docker (specifically when trying to test developments with override)

This task is to actually track the required changes to stabilitze the tooling.

An upstream issue [1] exists about it and declare some possible workarounds. That issue is closed but the problem are still ongoing.

Related to swh/meta$1196

• [1] https://github.com/pypa/pip/issues/10573

---

Migrated from T3685 (view on Phabricator)