provenance/Dockerfile: Evolve to compile the rust provenance crate
Compare changes
Files
2+ 27
− 2
@@ -2,17 +2,42 @@ ARG REGISTRY=container-registry.softwareheritage.org/swh/infra/swh-apps/
awscli [1] is the tool to retrieve the necessary files (provenance, graph) for the deployment to be self-contained. The rest is the rust compilation steps to have the binaries to run the provenance index and grpc services [2] [3]
In details, this adapts the current provenance deployment:
[1] https://docs.softwareheritage.org/devel/swh-provenance/grpc-api.html#getting-a-provenance-database
[3] https://crates.io/crates/swh-provenance
[2]
root@d79ab1e18df7:/opt/swh# swh-provenance-
swh-provenance-gen-test-database swh-provenance-grpc-serve swh-provenance-index
root@d79ab1e18df7:/opt/swh# swh-provenance-index --help
Builds .ef indexes for extra quick querying of the Software Heritage Provenance Index
Usage: swh-provenance-index [OPTIONS] --database <DATABASE>
Options:
--database <DATABASE> Path to the provenance database
--indexes <INDEXES> Path to the directory where to write paths to. Defaults to `--database` (when it is a file:// URL)
--statsd-host <STATSD_HOST> Defaults to `localhost:8125` (or whatever is configured by the `STATSD_HOST` and `STATSD_PORT` environment variables)
-h, --help Print help
root@d79ab1e18df7:/opt/swh# swh-provenance-grpc-serve --help
gRPC server for the Software Heritage Provenance Index
Usage: swh-provenance-grpc-serve [OPTIONS] --graph <GRAPH> --database <DATABASE>
Options:
--cache-parquet Keep Parquet metadata in RAM between queries, instead of re-parsing them every time
--graph-format <GRAPH_FORMAT> [default: webgraph] [possible values: webgraph, json]
--graph <GRAPH> Path to the graph prefix
--database <DATABASE> Path to the provenance database
--indexes <INDEXES> Path to Elias-Fano indexes, default to `--database` (when it is a file:// URL)
--bind <BIND> [default: [::]:50141]
--statsd-host <STATSD_HOST> Defaults to `localhost:8125` (or whatever is configured by the `STATSD_HOST` and `STATSD_PORT` environment variables)
-h, --help Print help