Skip to content
Snippets Groups Projects
Forked from Platform / Development / swh-export
Source project has a limited visibility.
Antoine Pietri's avatar
Antoine Pietri authored
We no longer support exporting the dataset as PostgreSQL dumps. It's
pretty much useless for big data analysis; we rather encourage
researchers to use big data engine (Hadoop, Hive, Presto...) which all
support the ORC format.

Alternatives to import the dataset on PostgreSQL include
https://github.com/HighgoSoftware/orc_fdw/ , or using the swh mirroring
pipeline to spawn a local storage instance with a PostgreSQL backend.
d353e6db
History
Name Last commit Last update