Draft: Add the option to traverse using a DFS instead of BFS (!175) · Merge requests · Platform / Development / swh-graph · GitLab

Snippets Groups Projects

Closed vlorentz requested to merge generated-differential-D9004-source into master 2 years ago

Jan 06, 2023
- Add the option to traverse using a DFS instead of BFS · a478ef3c
  vlorentz authored 2 years ago
  
  This would make the generation of blobs-origins.csv.zst (which looks for one origin leaf) much faster
  a478ef3c
- compression: Force log level to be either DEBUG or INFO · ab327235
  vlorentz authored 2 years ago
  
  ab327235
- luigi: Add an option to define the maximum RAM used by graph compression · 60293ba0
  vlorentz authored 2 years ago
  
  60293ba0
- cli: Add more useful defaults · dbe64d61
  vlorentz authored 2 years ago
  
  two paths + reimport tasks at the package level so they are automatically picked up by luigi without passing all module names on the CLI
  dbe64d61
- cli: Add flag --s3-athena-output-location to configure all Luigi tasks at once · d0fafdbd
  vlorentz authored 2 years ago
  
  d0fafdbd
- Fix Java tests broken by 559d4068 · 0160c379
  vlorentz authored 2 years ago
  
  0160c379