Skip to content
v0.2.0

  * webgraph.py: use named pipes to read zst decompression output
  * Setup.java: remove unused import
  * switch compression pipeline from gzip to zstd
  * webgraph.py: make sure {logback} is always interpolated
  * map generation: further logging tuning
  * map generation: distinguish log lines by map type
  * map generation: reduce sort buffer size (by *cough* 1024x *cough*)
  * source code layout: move java/server/ to java/
  * naming: rename map generation class from Setup to MapBuilder
  * map generation: add % completion and ETA
  * java coding style: remove all tabs in favour of spaces
  * maps generation: implement proper progress logging and use real loggers
  * map generation: reduce sort memory usage from 66% to 40% of max_ram
  * Setup.java: shell out node2pid map generation to sort
  * Makefile: add generic java-* dispatcher target
  * webgraph.py: use shell=True in compression step execution
  * rename int2pid/pid2int to node2pid/pid2node on the Python side
  * pid2int2int2pid: new tool to generate int->PID map from PID->int one
  * CLI: add new "dumb" sequential map writer "swh graph map write"
  * test data: remove obsolete textual maps
  * binary maps: change type IDs on Python side, to be compatible with Java
  * cli.py: document configuration parameter and reorder args
  * cli.py: update docstring doc about available compression steps
  * switch Java map generation from CSV to binary format
  * test_cli.py: reduce memory requirements
  * cli.py: add support for --config-file and compression configuration
  * tox: more robust detection of swh-graph JAR
  * tests: Move dataset folder to fix test_api_client hang
  * remove cruft dir java/**/t/, committed by mistake
  * temporarily disable test_api_client.py due to T2055
  * tox.ini: fix pytest ImportMismatchError
  * makefile: add convenience clean-java target
  * mypy.ini: ignore psutil, due to missing stubs
  * test_cli.py: new test for CLI end-to-end compression
  * webgraph.py: autoatically generate mappings at the end of compression
  * java mapping Setup: make Usage message more standard-looking
  * CLI: add one-stop shop compression "swh graph compress ...."
  * java deps: bump fastutil dep to 8.3.0
  * swh graph CLI: fix bogus "swh graph graph" nesting
  * server/app.py: make mypy pass again
  * server/app.py: fix flake8 spacing
  * java build: include LAW via Maven
  * java: benchmark: add ForkCC class
  * tests/pid: test iter_prefix
  * backend: fix default stack and heap size
  * java: Adapt BFS benchmark for a simple visit
  * java: Move GenDistribution in benchmark/
  * Add single-thread BFS benchmark
  * ParallelBFS benchmark: add support to optionally use transposed graph
  * benchmark.ParallelBFS: new class to time parallel BFS on the full graph
  * Graph: add getBVGraph getter for underlying BVgraph(s)
  * java: add GenDistribution.java directly in the tree
  * java: Traversal: add a NbNodesAccessed method
  * java: public nodeTypesMap for iteration
  * Graph: comment out useless loading of nodeIdMap
  * java: Entry: add lightweight copies in count methods
  * app: add 3.6 compatibility
  * backend: add hardcoded java_opts
  * java: traversal: use HashSet to reduce initialization time
  * Enable iteration on the graph
  * git2graph: fix snapshot ID computation, now compatible with swh identify
  * git2graph: remove left over, comment out debug prints