Then drop all unneeded and indirect imports

This should fix the build [1]

[1] https://jenkins.softwareheritage.org/view/Debian%20packages/job/debian/job/packages/job/DLS/job/gbp-buildpackage/77/console

pytest wastes a lot of time in .hypothesis and .git; this commit excludes them.

This allows us to actually run the lister instantiation code instead of relying
on the underlying structure of the lister object. In turn, this allows future
listers to use the scheduler right in their __init__.

The previous include would pull all .mypy_cache directories too, which are quite
large as they include the SQLAlchemy stubs.

Léni Gauffier authored 4 years ago and Léni Gauffier committed 4 years ago

Summary: Lister implementation for Gitea, works for (T2313). For now because of https://github.com/go-gitea/gitea/issues/9165 it would require setting its param limit to 50.

Reviewers: #reviewers, ardumont

Reviewed By: #reviewers, ardumont

Subscribers: ardumont

Differential Revision: https://forge.softwareheritage.org/D3107

Related to T2367

Summary:
Related to T1734

From abandonned D2799

Reviewers: ardumont

Reviewed By: ardumont

Differential Revision: https://forge.softwareheritage.org/D2974

- blackify all the python files,
- enable black in pre-commit,
- add a black tox environment.

This commit fixes the repository mapping to model. It broke when the listed
repository was either None or missing the id field [1]

[1] https://sentry.softwareheritage.org/share/issue/532d682182fc43d6a7a99400e3928811/

Related to T2188

Following the github's documentation [1]

[1] https://developer.github.com/v3/guides/best-practices-for-integrators/#dealing-with-abuse-rate-limits

Related to T2170

Prior to this commit, we sent the origin url as a versioned artifact.
Now we send the origin url as a CRAN's canonical one, and the associated list
of artifacts found there (only 1 today).

This decreases in smaller transaction which won't timeout

Related to T2160

Related to T2134
Related to D2409
Related to D2410

Related to T2134

The following commit adapts the return statements from both lister and their
associated tasks. This standardizes on what other modules (e.g. both dvcs and
package loaders) do.

This also adds tests to make sure that we properly send our version number to
upstreams.

And remove unnecessary fixture redefinition which causes indirection.