It should be needed in `src/properties/*.rs` to serialize/deserialize `Vec*` structs,
but for some reason it isn't for Rust >= 1.82 (or >= 1.81?)

Include update to `pyo3-0.23.0`

This will be useful to generate graphs for test cases

Otherwise it captures `'de` though `D` and that makes the function pretty hard to use, as its return value cannot alive the deserializer.

In this case, serde_json only yields owned Strings, so
`<&str>::deserialize()` fails. We need a visitor, which has a default
implementation of visit_string that defers to visit_str, so it works.

This reverts commit 3478faf8.

We need orc-rust < 0.4.0 for now, which does not depend on the same
arrow version as ar_row/dataset-writer

This reverts commit 260d641a.

orc-rust v0.4.0 and v0.5.0 break ar_row:

* https://github.com/datafusion-contrib/orc-rust/pull/13
* https://github.com/datafusion-contrib/datafusion-orc/issues/137

vlorentz authored 5 months ago and vlorentz committed 5 months ago

This can be used to get a textual representation of small graphs, which can then
be shared and used in tests or examples.

This file used to be generated by the Java compression pipeline

This is easier to install, as there is no need for users to remember
--features=grpc-server.

This also avoids declaring every dependency of the gRPC server as 'optional' and
adding it to the list of dependencies of the 'grpc-server' feature; and I expect
this set of dependencies to get larger now that the gRPC server is starting to
be used in production (eg. statsd metrics).

Finally, this allows Cargo to remove building the gRPC server from the critical
path to building swh_graph_provenance when building all crates (eg. in CI),
which should make it a little faster to build.

It was a bug in the Java gRPC server to allow it without the "node." prefix because
FieldMasks should match the fully-qualified field name in the output, and these
two endpoints return a Path (with a Node field) instead of directly a Node stream
like Traverse does.

eg. adding 'ori.url' to the FieldMask would cause an empty RevisionData struct
to be added to every revision node

This makes the EDGE_LABELS run time go from 2.5 days to 1 day; and TRANSPOSE_EDGE_LABELS probably from 3.5 to 1-1.5 day.

The name of the .order file when using a non-GOV MPH changed, in order to support
more than one (mphf, permutation) pair for a given graph.

vlorentz authored 7 months ago and vlorentz committed 7 months ago

These flags were added in mmap_rs v0.6.1 and spare us some boilerplate

This reduces wall-clock run time by 25%, CPU time by 25 to 75%,
and halves temporary disk space.