staging: ingest openbsd.org cvs forge
Designs
- Show closed items
Activity
-
Newest first Oldest first
-
Show all activity Show comments only Show history only
- Phabricator Migration user marked this issue as related to swh/devel/swh-loader-cvs#3691
marked this issue as related to swh/devel/swh-loader-cvs#3691
- Vincent Sellier added Archive coverage System administration ~119 state:wip labels
added Archive coverage System administration ~119 state:wip labels
- Author Owner
Manual loading in progress:
- pod created with migrated/migration$1482
- manual loading:
swh@loader-cvs-manual:~$ swh --log-level=DEBUG loader run cvs rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src DEBUG:swh.loader.cli:ctx: <click.core.Context object at 0x7ff49a095f30> DEBUG:swh.core.config:Loading config file /etc/swh/config.yml DEBUG:swh.loader.cli:config_file: /etc/swh/config.yml DEBUG:swh.loader.cli:config: DEBUG:swh.loader.cli:kw: {} DEBUG:swh.loader.cli:registry: {'task_modules': ['swh.loader.cvs.tasks'], 'loader': <class 'swh.loader.cvs.loader.CvsLoader'>} DEBUG:swh.loader.cli:loader class: <class 'swh.loader.cvs.loader.CvsLoader'> DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): storage1.internal.staging.swh.network:5002 DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/get_latest HTTP/1.1" 200 1 DEBUG:swh.loader.cvs.loader.CvsLoader:PID 30 is live, skipping DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/add_multi HTTP/1.1" 200 13 DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /origin/visit/add HTTP/1.1" 200 128 INFO:swh.loader.cvs.loader.CvsLoader:Load origin 'rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src' with type 'cvs' DEBUG:swh.loader.cvs.loader.CvsLoader:lister_not provided, skipping extrinsic origin metadata DEBUG:swh.loader.cvs.loader.CvsLoader:prepare; origin_url=rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src scheme=rsync path=/openbsd-cvs/src DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 512 2019/11/10 13:00:01 . DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 2,560 2022/10/12 08:00:07 CVSROOT DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 1,536 2022/10/12 01:12:59 ports DEBUG:swh.loader.cvs.loader.CvsLoader:rsync server: drwxrwxr-x 512 2022/09/27 04:05:27 src ... DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/missing HTTP/1.1" 200 3641 DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/add HTTP/1.1" 200 37 DEBUG:urllib3.connectionpool:http://storage1.internal.staging.swh.network:5002 "POST /content/missing HTTP/1.1" 200 11223 ...
loading is in progress
- Vincent Sellier assigned to @vsellier
assigned to @vsellier
- Vincent Sellier mentioned in commit swh-apps@7832145a
mentioned in commit swh-apps@7832145a
- Author Owner
A new loading attempt is launched with the performance improvements included in the cvs loader version 0.5.1 (https://gitlab.softwareheritage.org/infra/swh-apps/-/blob/7832145ac57980e063ef043b9bdd6b52d42d3a8c/apps/swh-loader-cvs/requirements-frozen.txt#L69), let's see what happens
- Vincent Sellier added environment: staging label
added environment: staging label
- Author Owner
The repository was successfully loaded with the last cvs loader version
{'status': 'eventful'} for origin 'rsync://anoncvs.fr.openbsd.org/openbsd-cvs/src' Sat Oct 22 19:45:42 UTC 2022
The loading took 3 days.
- Vincent Sellier closed
closed
- Author Owner
- Vincent Sellier removed state:wip label
removed state:wip label
Please register or sign in to reply