Snippets Groups Projects

replay: Rework code for removing externals

Antoine Lambert authored 10 months ago

Removing an external path from the reconstructed filesystem can
be tedious due to numerous edge cases where externals are defined
in different directories but some of their paths overlap.

Previous code was not properly handling all cases so rework it
to ensure it does and add a new test with a new edge case.

66300455

66300455 10 months ago

Name	Last commit	Last update
bin
docs
install
resources
swh/loader/svn
.copier-answers.yml
.git-blame-ignore-revs
.gitignore
.pre-commit-config.yaml
AUTHORS
CODE_OF_CONDUCT.md
CONTRIBUTORS
LICENSE
Makefile
README.rst
conftest.py
mypy.ini
pyproject.toml
pytest.ini
requirements-swh.txt
requirements-test.txt
requirements.txt
setup.cfg
setup.py
svn-lib-client-analysis.org
tox.ini

Software Heritage - Subversion loader

The Software Heritage Subversion loader is a tool and a library to walk a remote svn repository and inject into the Software Heritage archive all contained files, directories and commits that weren't known before.

The main entry points are

swh.loader.svn.loader.SvnLoader for the main svn loader which ingests content out of a remote svn repository
swh.loader.svn.loader.SvnLoaderFromDumpArchive which mounts a repository out of a svn dump prior to ingest it.
swh.loader.svn.loader.SvnLoaderFromRemoteDump which mounts a repository with svnrdump prior to ingest its content.
swh.loader.svn.directory.SvnExportLoader which ingests an svn tree at a specific revision.

CLI run

With the configuration:

/tmp/loader_svn.yml:

storage:
  cls: remote
  args:
    url: http://localhost:5002/

Run:

$ swh loader --config-file /tmp/loader_svn.yml run svn <svn-repository-url>