"README.rst" did not exist on "a903c7a6fc65917bfb24dbb57a8058a5ce6a0d3a"
- Oct 19, 2022
-
-
Antoine Lambert authoredThe jobs associated to this pipeline are only triggered when commiting on the master branch or when pushing a phabricator diff based on a commit of the master branch. So in order to save time, data transfer and avoid possible clone issues, fetch only the master branch when cloning as all remote branches are fetched by default. Related to T4641
-
- Oct 18, 2022
-
-
Antoine Lambert authored
We are only interested in fetching the master branch of each swh repository to run the checks and tests of that job so pass option --single-branch to git clone command. Related to T4641
-
- Sep 29, 2022
-
-
Nicolas Dandrimont authored
-
- Sep 15, 2022
-
-
Antoine Lambert authored
Recent changes in that build job (running all checks for each swh package for instance) makes it exceed the 90 minutes timeout so increase it by 30 minutes.
-
- Aug 31, 2022
-
-
Antoine Lambert authored
In order to gain some time when executing Jenkins jobs for swh-web, execute cypress tests in parallel using 4 runners thanks to the sorry-cypress tool. To do so, we use the docker features of Jenkins pipeline. One sidecar container is created to execute the sorry-cypress server and parallel tests are executed in another container spawning 4 cypress processes. The communication between the two containers is done through a dedicated docker network. Regarding code coverage, we now need to merge the outputs produced by the 4 runners before generating reports. This change brings a 2x speedup on overall swh-web build jobs execution (when a single job is executed, speedup is lesser when multiple jobs are executed in parallel but still significative). Also restrict the maximum number of concurrent builds per job to 3 in order to avoid executing too many cypress processes at the same time as they consume quite a lot of resources on the Jenkins node. Related to T3423
-
Antoine Lambert authored
Add a max_concurrent option to swh pipeline jobs (master, Phabricator diff) in order to limit the number of concurrent builds per job. The number of concurrent builds is not limited by default. Related to T3423
-
- Aug 26, 2022
-
-
Antoine Lambert authored
-
- Aug 19, 2022
-
-
Antoine Lambert authored
Also execute code checks (flake8, codespell, mypy, ...) for all swh modules in this Jenkins job. It will enable to catch possible issues with the tools above and fix them early.
-
- Aug 11, 2022
-
-
Antoine Lambert authored
It enables to upload JavaScript source maps generated by webpack to help debugging swh-web JavaScript errors in Sentry Web UI. The Sentry webpack plugin must be used in webpack configuration to do so.
-
- Aug 10, 2022
-
-
Antoine Lambert authored
Currently, the only way to test Jenkins configuration changes using docker is to push changes to a remote feature branch in swh-jenkins-jobs repository and make jenkins clone that branch to test the changes. This is not really convenient to quickly test changes so prefer to mount the local swh-jenkins-jobs repository as a docker volume and clone that repository from Jenkins filesystem.
-
- Jul 20, 2022
-
-
Antoine R. Dumont authoredThis reverts commit e1dd4f97. Related to T4135
-
Antoine R. Dumont authored
Related to T4135
-
- Jun 30, 2022
-
-
Antoine R. Dumont authored
-
Vincent Sellier authored
-
- Jun 28, 2022
-
-
Antoine R. Dumont authored
-
- Jun 03, 2022
-
-
Antoine R. Dumont authored
-
Antoine Lambert authored
Now that static analysis is no longer run in parallel and the number of mypy checks increased, we can sometimes hit the current 25 minutes timeout so better bumping it to 30 minutes.
-
- May 23, 2022
-
-
vlorentz authoredWe have a recurring data race in flake8 tasks, probably caused by 'tox -e mypy' creating and deleting files while flake8 scans them; so we should not run them at the same time. While we are at it; also run radon sequentially. flake8 and radon each take less than 10s, so we should not notice much of a difference.
-
- May 04, 2022
-
-
Nicolas Dandrimont authored
Using --depth makes `git describe` return nonsensical values, which in turn makes setuptools-scm generate a v0.1.dev1 version number. This makes pip unable to resolve version-constrained dependencies on swh modules, which makes it install them from pip again.
-
- Apr 26, 2022
-
-
Nicolas Dandrimont authored
-
- Apr 25, 2022
-
-
Antoine R. Dumont authored
Without it, the error message is not clear from the get go and we need to tamper with build configuration to actually have access to the error message. See [1] with the --verbose flag versus [2] without it. [1] ``` 17:56:44 [?25h[34mINFO [0m Response from https://upload.pypi.org/legacy/: 17:56:44 400 The description failed to render for 'text/x-rst'. See 17:56:44 https://pypi.org/help/#description-content-type for more information. 17:56:44 [34mINFO [0m <html> 17:56:44 <head> 17:56:44 <title>400 The description failed to render for 'text/x-rst'. See 17:56:44 https://pypi.org/help/#description-content-type for more 17:56:44 information.</title> 17:56:44 </head> 17:56:44 <body> 17:56:44 <h1>400 The description failed to render for 'text/x-rst'. See 17:56:44 https://pypi.org/help/#description-content-type for more 17:56:44 information.</h1> 17:56:44 The server could not comply with the request since it is either 17:56:44 malformed or otherwise incorrect.<br/><br/> 17:56:44 The description failed to render for 'text/x-rst'. See 17:56:44 https://pypi.org/help/#description-content-type for more information. 17:56:44 17:56:44 17:56:44 </body> 17:56:44 </html> ``` from https://jenkins.softwareheritage.org/job/DLDCVS/job/pypi-upload/12/console [2] ``` 17:44:19 [?25h[33mWARNING [0m Error during upload. Retry with the --verbose option for more details. ``` https://jenkins.softwareheritage.org/job/DLDCVS/job/pypi-upload/11/console
-
- Apr 22, 2022
-
-
vlorentz authored
-
- Apr 13, 2022
-
-
Antoine R. Dumont authored
That's up to the repository's Makefile to determine that. That way, it currently fixes the build and push tag logic target to actually work. But bonus, it will allow to keep the building logic of image(s) within the scope of the repository which knows what to do (so building multiple images becomes possible with that very build). So now the makefile must respect the following conventions (still explained in the template): - build: locally build the image out of the repository TAG, IMAGE_LABEL (to ease cleanup part) must be provided - test: test the locally built image TAG must be provided - clean: clean up locally built image (parametric on the jenkins build) IMAGE_LABEL must be provided - push: publish to the registry TAG, REGISTRY_URL must be provided
-
- Apr 12, 2022
-
-
Antoine R. Dumont authored
Explained in the pipeline source template. The following pipeline uses a specific Makefile with the following targets: - build: locally build the image out of the repository IMAGE_NAME, TAG and IMAGE_LABEL must be provided - test: test the locally built image IMAGE_NAME, TAG must be provided - clean: clean up locally built image (parametric on the jenkins build) IMAGE_LABEL must be provided - push: publish to the registry IMAGE_NAME, TAG, REGISTRY_URL must be provided
-
- Apr 07, 2022
-
-
Vincent Sellier authored
It will free a lot of space on the build server
-
- Apr 06, 2022
-
-
Antoine R. Dumont authored
Related to T3746
-
Antoine R. Dumont authored
-
Antoine R. Dumont authored
This also transforms the 'cleanup' stage into an always post block to trigger whatever the result of previous stages is (success or not). Related to T3746
-
- Apr 01, 2022
-
-
Antoine R. Dumont authored
Related to T4105
-
Antoine R. Dumont authored
The git-parameter is currently limited and failing to work from the ui. As the next step is about using phabricator to push tag to trigger the build, it's fine. Related to T4105
-
Antoine R. Dumont authored
Related to T4105
-
Antoine R. Dumont authored
Related to T4105
-
Antoine R. Dumont authored
It's probably missing its parent. ``` jenkins.JenkinsException: Cannot create job[DLSMAVEXP/build-and-push] because folder for the job does not exist ``` Related to T4105
-
Antoine R. Dumont authored
And installs such job for the maven-index-exporter repository. Related to T4105
-
- Mar 30, 2022
-
-
Antoine R. Dumont authored
Decrease overall timeouts from 20 to 10 minutes for most modules. But for: - swh-web: Increase timeout to 25 min. Current 20 minutes is not enough [1] - swh-storage: Keep a slightly larger timeout of 15 min (lots of tests with multiple backend implementations) [3] (1] Master build history [2] shows almost half of the last master build got aborted (5 out of 11). [2] https://jenkins.softwareheritage.org/view/swh%20master/job/DWAPPS/job/tests/ [3] https://jenkins.softwareheritage.org/job/DSTO/job/tests/
-
- Mar 29, 2022
-
-
Antoine R. Dumont authored
This still default to 20 minutes.
-
- Mar 15, 2022
-
-
vlorentz authored
-
- Feb 16, 2022
-
-
Jayesh authored
-
- Dec 15, 2021
-
-
Nicolas Dandrimont authored
This module builds a native extension for rcsparse, and we don't support manylinux builds yet, so PyPI rejects our binary wheels.
-
Nicolas Dandrimont authored
-
