use a compact, binary format for node ids mapping files

We need a more compact way of storing the PID <-> long id mappings (i.e.: binary file).

Should also help with D1802.

---

Migrated from T1944 (view on Phabricator)

added Compressed graph service priority:Normal labels

changed title from More compact format for node ids mapping files to use a compact, binary format for node ids mapping files

marked this issue as related to #1950 (closed)

Status update: we have now binary serialization formats for the two maps, see docstrings of PidToIntMap and IntToPidMap in swh.graph.pid That means that Python code can //read// the compact maps (and also write them, but at a speed that is impractical for generation). Conversion of the textual maps generated for the most recent compressed graph is ongoing and almost completed.

The generation of those maps will need to happen on the Java side, and it's still pending.

added state:wip label

added priority:High label and removed priority:Normal label

mentioned in commit 998a4435

assigned to @zack

removed state:wip label

closed

reopen, as it's not fixed in master yet

reopened

Closed in rDGRPH998a44353612

closed

mentioned in issue #1950 (closed)