luigi: Rewrite compression pipeline as small Luigi tasks (13b01430) · Commits · Antoine Lambert / swh-graph · GitLab

Skip to content

GitLab

Explore

Sign in
Register

Primary navigation

Project

S

swh-graph
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Environments
- Terraform modules
- Incidents

Snippets Groups Projects

13b01430

Commit 13b01430 authored 2 years ago by vlorentz

Downloads
- Patches
- Plain Diff

luigi: Rewrite compression pipeline as small Luigi tasks

parent 37e9188e

No related branches found

Tags v6.3.1

No related merge requests found

Changes 6

Hide whitespace changes

Inline Side-by-side

Showing

docs/compression.rst 2 additions, 0 deletions

docs/compression.rst
swh/graph/cli.py 20 additions, 0 deletions

swh/graph/cli.py
swh/graph/config.py 2 additions, 0 deletions

swh/graph/config.py
swh/graph/luigi/compressed_graph.py 420 additions, 43 deletions

swh/graph/luigi/compressed_graph.py
swh/graph/tests/test_luigi.py 34 additions, 10 deletions

swh/graph/tests/test_luigi.py
swh/graph/webgraph.py 2 additions, 0 deletions

swh/graph/webgraph.py

with 480 additions and 53 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment