This also prevents the server code from being served when the feature flag is off.

Related to T4040

In a future commit, it will be possible to browse from that view to the detailed request
dashboard.

This also reworks the left menu to allow access to staff or people with the add forge
now moderator permission.

Related to T3991

This will allow easier adaptations when adding new views with different permissions.

Added a form to submit an "add forge now" request.
Left menus changed to include "add forge now" page.
Possbility to browse existing requests is added
in a seperate tab in the same view.
Cypress tests

Related to T3998
Related to T3989
Related to T4012
Related to T3988

Before each test suite, cypress visits the root page to get some
references on javascript objects used in tests.

However the root page requests the costly /coverage endpoint to
render the archive coverage widget.

We do not need that widget to render for cypress tests so better
mocking that request to an empty one to speedup each test suite
startup.

webpack-dev-server watches static files and will reload application in
the browser when one of them is modified.

However, we need to ignore sqlite3 database files used in development
mode as any HTTP request that modifies the database will trigger an
unexpected page reload.

Some cypress tests use input data generated before each test suite.

Some of these data are retrieved by sending HTTP requests to the
Software Heritage Web API, which can take some times, especially
when repeating that processing before each test suite.

So instead of sending those HTTP requests before each test suite,
prefer to do it once and put the test data in global cache. Those
data will then be set to test suite scope through the use of a
custom cypress task.

Each time a swh-web HTML page is loaded, an HTTP request is sent to
https://status.softwareheritage.org for getting the data needed to
display the status widget in the top right of the Web UI.

That request was not globally intercepted by cypress resulting in
making real HTTP requests on the internet while executing tests.
As a consequence, this was slowing down the whole testing process.

So ensure that request is globally intercepted to speedup tests
execution.

Merging datatables special processing in /api/1/add-forge/request/list
endpoint implementation was quite disturbing.

So better using a dedicated endpoint for that in a similar manner as
with save code now requests listing.

The endpoint to use with datatables is now the following one:
/add-forge/request/list/datatables.

Related to T3989
Related to T3991

datatables is the javascript library we use on the frontend side to
display interactive tables.

As we use server-side processing, table data must be provided in a
paginated way by an HTTP endpoint.

Response format expected by datatables is different from the one
returned by the Web API endpoint listing add-forge requests.

So adapt the response format of that endpoint when we know the
input request has been sent by datatables.

Related to T3989
Related to T3991

Related to T4030

Related to T4027

Related to T4026

On small resolution screens, the sidebar content could not be scrolled
to the last menu entry.

rst_to_html is called by get_readme_to_display, which processes unsafe data;
so it should not allow inclusion of arbitrary files or arbitrary HTML.

Related to T3990

This explicits the deposit's type, either 'code' or 'meta'. The uri column is now filled
depending on that type. Mostly, the parsing of the deposit's raw xml content is done to
try and extract that potentially provided information.

If not found, this uses the same heuristics as before (either use the origin_url if
provided or extract the origin out of the swhid_context).

Related to T3680

Closes T3970

It is time to make the guided tour public.

Also remove old help page as its content is now redundant with swh
sphinx documentation. Clicking on the help icon will now launch
the guided tour for all users.

Move workarounds introduced in f7b35626
and 55aa143d from requirements.txt
file to requirements-test.txt as those break debian package installation.

It enables to update origin counters more frequently in the coverage
widget of the production webapp.

Also disable cache use when running swh-web in development or staging
environment to get accurate counters on each homepage refresh.

Add functions to check if we are running a development, staging or
production version of swh-web.

When loading task types are available for these visit types in the
swh deployment environment (currently staging and docker), display
the associated counters in the coverage widget.

Related to T3945

Related to T3835

If one of the URL links to parse contains a comma character, the parsing
was incorrect.

So fix that issue by updating the regexp use to format the links for
display in the API Web UI.

Related to T3967

When calling "./bin/install" from swh-environment in a freshly created
venv, for some reason pip will end up installing flask==1.1.2 when
processing swh-web (likely related to the venv state after installing
other swh modules).

That flask version is quite outdated and will fail to import the json
module from the version of itsdangerous installed in the venv.

So as a workaround pin flask to the first version that does not trigger
that ImportError issue.

markupsafe 2.1.0 removes functions that were used by Jinja2 < 3,
the latter being a dependency of pybadges.

As Jinja2 < 3 is installed in the venv, pinning markupsafe to
a version still compatible with Jinja2 < 3 is the only way to
avoid error when running pytest as some plugins import jinja2.

When attempting to re-encode non UTF-8 textual content, use chardet
to find the encoding first and use it if the detection confidence
is really high.

Previously some encoding like SHIFT_JIS (for japanese language) were
not correctly detected and thus content were badly rendered in the
browse Web UI.

Add support for Bazaar repository loading in Save Code Now.

Simplify test to ensure it does not fail when building debian packages.

Tarballs are no longer loaded as branches but as releases in the
nixguix origin snapshots.