AFNR#1185: ignore repos within https://git.nomics.world/dbnomics-source-data/ https://git.nomics.world/dbnomics-jsondata/

In AFNR#1185 the forge admin has requested that we do not download the repos within the following two GitLab groups, since Those repositories can be huge and doing so will very likely harm the performance of our GitLab server. Please add an ignore for them, and then approve the archiving.

https://git.nomics.world/dbnomics-source-data/
https://git.nomics.world/dbnomics-jsondata/

assigned to @guillaume

During tests in a local docker environment, I maybe noticed some typo:

swh@bfa8fe237813:~$ curl -sI https://git.nomics.world/dbnomics-source-data/ | awk 'NR==1||/^location/'
HTTP/2 200 
swh@bfa8fe237813:~$ curl -sI https://git.nomics.world/dbnomics-json-data/ | awk 'NR==1||/^location/'
HTTP/2 200 
swh@bfa8fe237813:~$ curl -sI https://git.nomics.world/dbnomics-jsondata/ | awk 'NR==1||/^location/'
HTTP/2 302 
location: https://git.nomics.world/users/sign_in

swh@bfa8fe237813:~$ swh scheduler task list
Found 2 tasks

Task 1
  Next run: May 26 (2025-05-26T10:44:46.353599+00:00)
  Interval: 90 days, 0:00:00
  Type: list-gitlab-full
  Policy: recurring
  Status: next_run_not_scheduled
  Priority: 
  Args:
  Keyword args:
    ignored_project_prefixes: ['dbnomics-source-data/', 'dbnomics-jsondata/']
    instance: 'git.nomics.world'

Task 2
  Next run: tomorrow (2025-02-26T10:44:34.759324+00:00)
  Interval: 1 day, 0:00:00
  Type: list-gitlab-incremental
  Policy: recurring
  Status: next_run_not_scheduled
  Priority: 
  Args:
  Keyword args:
    ignored_project_prefixes: ['dbnomics-source-data/', 'dbnomics-jsondata/']
    instance: 'git.nomics.world'

swh@bfa8fe237813:~$ swh scheduler origin check-listed-origins gitlab git.nomics.world -l | grep "dbnomics-source-data\|dbnomics-json-data\|dbnomics-jsondata"
WARNING:swh.core.sentry:Sentry DSN not provided, events will not be sent.
https://git.nomics.world/dbnomics-json-data/acoss-json-data.git                         2025-02-25 10:44:45.668843+00:00  2024-01-24 09:16:06.593000+00:00
https://git.nomics.world/dbnomics-json-data/afdb-json-data.git                          2025-02-25 10:44:44.768276+00:00  2021-05-12 18:00:19.662000+00:00
https://git.nomics.world/dbnomics-json-data/aih-json-data.git                           2025-02-25 10:44:45.668843+00:00  2023-03-01 06:21:35.696000+00:00
https://git.nomics.world/dbnomics-json-data/ameco-json-data.git                         2025-02-25 10:44:43.156734+00:00  2025-01-23 01:28:22.458000+00:00
https://git.nomics.world/dbnomics-json-data/apple-json-data.git                         2025-02-25 10:44:45.668843+00:00  2022-04-14 06:07:33.536000+00:00
https://git.nomics.world/dbnomics-json-data/aqicn-json-data.git                         2025-02-25 10:44:45.668843+00:00  2022-05-25 04:04:12.319000+00:00
https://git.nomics.world/dbnomics-json-data/bcb-json-data.git                           2025-02-25 10:44:43.906327+00:00  2021-09-05 13:21:43.271000+00:00
https://git.nomics.world/dbnomics-json-data/bceao-json-data.git                         2025-02-25 10:44:43.156734+00:00  2025-02-15 01:19:50.997000+00:00
https://git.nomics.world/dbnomics-json-data/bdf-json-data.git                           2025-02-25 10:44:44.768276+00:00  2025-02-25 05:23:37.737000+00:00
https://git.nomics.world/dbnomics-json-data/bea-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-02-21 12:22:42.636000+00:00
https://git.nomics.world/dbnomics-json-data/bi-json-data.git                            2025-02-25 10:44:44.768276+00:00  2021-06-16 09:46:31.800000+00:00
https://git.nomics.world/dbnomics-json-data/bis-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-02-21 08:30:42.991000+00:00
https://git.nomics.world/dbnomics-json-data/bls-json-data.git                           2025-02-25 10:44:43.156734+00:00  2025-02-21 02:01:43.626000+00:00
https://git.nomics.world/dbnomics-json-data/boc-json-data.git                           2025-02-25 10:44:45.668843+00:00  2025-02-15 04:56:42.127000+00:00
https://git.nomics.world/dbnomics-json-data/boe-json-data.git                           2025-02-25 10:44:43.156734+00:00  2025-01-31 02:41:51.663000+00:00
https://git.nomics.world/dbnomics-json-data/boj-json-data.git                           2025-02-25 10:44:43.906327+00:00  2024-06-12 01:38:58.504000+00:00
https://git.nomics.world/dbnomics-json-data/buba-json-data.git                          2025-02-25 10:44:43.906327+00:00  2025-02-22 03:30:44.269000+00:00
https://git.nomics.world/dbnomics-json-data/cbo-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-01-28 01:52:15.748000+00:00
https://git.nomics.world/dbnomics-json-data/cepii-json-data.git                         2025-02-25 10:44:43.906327+00:00  2023-06-08 14:10:39.977000+00:00
https://git.nomics.world/dbnomics-json-data/cepremap-json-data.git                      2025-02-25 10:44:46.271862+00:00  2023-06-23 04:35:56.397000+00:00
https://git.nomics.world/dbnomics-json-data/citymapper-json-data.git                    2025-02-25 10:44:45.668843+00:00  2021-09-22 12:41:03.378000+00:00
https://git.nomics.world/dbnomics-json-data/cso-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-02-25 07:03:17.992000+00:00
https://git.nomics.world/dbnomics-json-data/dares-json-data.git                         2025-02-25 10:44:43.156734+00:00  2025-02-08 01:52:57.621000+00:00
https://git.nomics.world/dbnomics-json-data/destatis-json-data.git                      2025-02-25 10:44:43.906327+00:00  2025-02-21 11:07:38.672000+00:00
https://git.nomics.world/dbnomics-json-data/dgddi-json-data.git                         2025-02-25 10:44:45.668843+00:00  2023-07-08 08:10:58.459000+00:00
https://git.nomics.world/dbnomics-json-data/drees-json-data.git                         2025-02-25 10:44:43.156734+00:00  2024-12-25 01:52:04.362000+00:00
https://git.nomics.world/dbnomics-json-data/dummy-json-data.git                         2025-02-25 10:44:43.156734+00:00  2018-01-15 10:00:23.618000+00:00
https://git.nomics.world/dbnomics-json-data/ecb-json-data.git                           2025-02-25 10:44:43.156734+00:00  2025-02-03 10:51:43.851000+00:00
https://git.nomics.world/dbnomics-json-data/ec-json-data.git                            2025-02-25 10:44:45.668843+00:00  2023-06-14 06:47:51.942000+00:00
https://git.nomics.world/dbnomics-json-data/eia-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-02-25 02:00:52.061000+00:00
https://git.nomics.world/dbnomics-json-data/elstat-json-data.git                        2025-02-25 10:44:43.906327+00:00  2025-02-15 01:36:36.936000+00:00
https://git.nomics.world/dbnomics-json-data/enedis-json-data.git                        2025-02-25 10:44:45.668843+00:00  2025-02-22 03:59:35.798000+00:00
https://git.nomics.world/dbnomics-json-data/entsoe-json-data.git                        2025-02-25 10:44:45.668843+00:00  2025-02-25 04:57:37.335000+00:00
https://git.nomics.world/dbnomics-json-data/esri-json-data.git                          2025-02-25 10:44:43.156734+00:00  2025-02-17 01:52:22.143000+00:00
https://git.nomics.world/dbnomics-json-data/eurostat-json-data.git                      2025-02-25 10:44:43.906327+00:00  2025-01-22 16:18:20.925000+00:00
https://git.nomics.world/dbnomics-json-data/fao-json-data.git                           2025-02-25 10:44:44.768276+00:00  2024-05-09 07:00:48.896000+00:00
https://git.nomics.world/dbnomics-json-data/fed-json-data.git                           2025-02-25 10:44:43.156734+00:00  2025-02-25 01:52:43.803000+00:00
https://git.nomics.world/dbnomics-json-data/fhfa-json-data.git                          2025-02-25 10:44:44.768276+00:00  2024-05-29 01:49:47.677000+00:00
https://git.nomics.world/dbnomics-json-data/fh-json-data.git                            2025-02-25 10:44:45.668843+00:00  2024-03-01 08:12:48.304000+00:00
https://git.nomics.world/dbnomics-json-data/franc-zone-json-data.git                    2025-02-25 10:44:45.668843+00:00  2021-05-28 13:27:00.540000+00:00
https://git.nomics.world/dbnomics-json-data/ggdc-json-data.git                          2025-02-25 10:44:43.906327+00:00  2021-07-29 02:50:48.550000+00:00
https://git.nomics.world/dbnomics-json-data/google-json-data.git                        2025-02-25 10:44:45.668843+00:00  2022-10-19 03:50:12.010000+00:00
https://git.nomics.world/dbnomics-json-data/ice-json-data.git                           2025-02-25 10:44:46.271862+00:00  2025-02-25 04:31:58.454000+00:00
https://git.nomics.world/dbnomics-json-data/ilo-json-data.git                           2025-02-25 10:44:43.156734+00:00  2024-02-19 07:41:42.928000+00:00
https://git.nomics.world/dbnomics-json-data/imf-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-02-25 03:22:29.510000+00:00
https://git.nomics.world/dbnomics-json-data/indec-json-data.git                         2025-02-25 10:44:43.906327+00:00  2024-05-03 02:26:04.787000+00:00
https://git.nomics.world/dbnomics-json-data/inegi-json-data.git                         2025-02-25 10:44:44.768276+00:00  2021-07-29 04:26:34.544000+00:00
https://git.nomics.world/dbnomics-json-data/inept-json-data.git                         2025-02-25 10:44:43.906327+00:00  2024-06-01 02:47:26.265000+00:00
https://git.nomics.world/dbnomics-json-data/ine-spain-json-data.git                     2025-02-25 10:44:43.906327+00:00  2024-05-09 03:02:36.962000+00:00
https://git.nomics.world/dbnomics-json-data/insee-json-data.git                         2025-02-25 10:44:43.156734+00:00  2025-02-24 13:45:33.689000+00:00
https://git.nomics.world/dbnomics-json-data/ipp-json-data.git                           2025-02-25 10:44:46.271862+00:00  2024-04-30 14:59:23.003000+00:00
https://git.nomics.world/dbnomics-json-data/ism-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-02-07 02:49:10.019000+00:00
https://git.nomics.world/dbnomics-json-data/istat-json-data.git                         2025-02-25 10:44:43.906327+00:00  2025-02-25 05:04:24.040000+00:00
https://git.nomics.world/dbnomics-json-data/jhu-json-data.git                           2025-02-25 10:44:44.768276+00:00  2022-05-14 04:23:16.520000+00:00
https://git.nomics.world/dbnomics-json-data/jilpt-json-data.git                         2025-02-25 10:44:46.271862+00:00  2025-02-08 05:10:42.153000+00:00
https://git.nomics.world/dbnomics-json-data/jrc-json-data.git                           2025-02-25 10:44:45.668843+00:00  2021-05-27 18:08:51.493000+00:00
https://git.nomics.world/dbnomics-json-data/lbma-json-data.git                          2025-02-25 10:44:43.156734+00:00  2025-02-25 00:35:47.065000+00:00
https://git.nomics.world/dbnomics-json-data/meteofrance-json-data.git                   2025-02-25 10:44:45.668843+00:00  2025-02-25 04:10:57.255000+00:00
https://git.nomics.world/dbnomics-json-data/meti-json-data.git                          2025-02-25 10:44:43.906327+00:00  2022-03-31 02:25:12.015000+00:00
https://git.nomics.world/dbnomics-json-data/mospi-json-data.git                         2025-02-25 10:44:44.768276+00:00  2021-08-27 13:16:33.490000+00:00
https://git.nomics.world/dbnomics-json-data/nar-json-data.git                           2025-02-25 10:44:43.906327+00:00  2024-08-30 02:11:36.256000+00:00
https://git.nomics.world/dbnomics-json-data/nbb-json-data.git                           2025-02-25 10:44:44.768276+00:00  2025-02-25 07:20:47.500000+00:00
https://git.nomics.world/dbnomics-json-data/nbs-json-data.git                           2025-02-25 10:44:44.768276+00:00  2025-01-19 08:57:48.527000+00:00
https://git.nomics.world/dbnomics-json-data/nd_gain-json-data.git                       2025-02-25 10:44:45.668843+00:00  2024-08-28 03:26:11.126000+00:00
https://git.nomics.world/dbnomics-json-data/oag-json-data.git                           2025-02-25 10:44:45.668843+00:00  2022-01-11 03:59:21.796000+00:00
https://git.nomics.world/dbnomics-json-data/obr-json-data.git                           2025-02-25 10:44:46.271862+00:00  2024-06-14 05:51:17.114000+00:00
https://git.nomics.world/dbnomics-json-data/oecd-json-data.git                          2025-02-25 10:44:43.156734+00:00  2025-02-25 04:53:36.084000+00:00
https://git.nomics.world/dbnomics-json-data/ons-json-data.git                           2025-02-25 10:44:43.156734+00:00  2025-02-21 16:23:19.534000+00:00
https://git.nomics.world/dbnomics-json-data/openfisca-json-data.git                     2025-02-25 10:44:46.271862+00:00  2022-07-06 09:34:41.169000+00:00
https://git.nomics.world/dbnomics-json-data/openfisca-tunisia-json-data.git             2025-02-25 10:44:46.271862+00:00  2025-02-04 10:04:34.517000+00:00
https://git.nomics.world/dbnomics-json-data/opentable-json-data.git                     2025-02-25 10:44:45.668843+00:00  2023-02-12 04:46:25.221000+00:00
https://git.nomics.world/dbnomics-json-data/oppins-json-data.git                        2025-02-25 10:44:45.668843+00:00  2022-05-10 04:46:18.510000+00:00
https://git.nomics.world/dbnomics-json-data/pole-emploi-json-data.git                   2025-02-25 10:44:43.156734+00:00  2023-09-15 02:34:54.220000+00:00
https://git.nomics.world/dbnomics-json-data/rba-json-data.git                           2025-02-25 10:44:43.906327+00:00  2025-02-25 02:31:42.400000+00:00
https://git.nomics.world/dbnomics-json-data/rbi-json-data.git                           2025-02-25 10:44:44.768276+00:00  2019-03-04 14:52:08.563000+00:00
https://git.nomics.world/dbnomics-json-data/rosstat-json-data.git                       2025-02-25 10:44:43.156734+00:00  2022-03-05 02:27:50.415000+00:00
https://git.nomics.world/dbnomics-json-data/rte-json-data.git                           2025-02-25 10:44:45.668843+00:00  2025-02-25 03:59:17.657000+00:00
https://git.nomics.world/dbnomics-json-data/safe-json-data.git                          2025-02-25 10:44:44.768276+00:00  2022-01-01 02:04:50.385000+00:00
https://git.nomics.world/dbnomics-json-data/sais-cari-json-data.git                     2025-02-25 10:44:44.768276+00:00  2022-01-15 02:19:31.913000+00:00
https://git.nomics.world/dbnomics-json-data/sama-json-data.git                          2025-02-25 10:44:44.768276+00:00  2022-06-05 05:16:11.784000+00:00
https://git.nomics.world/dbnomics-json-data/sarb-json-data.git                          2025-02-25 10:44:44.768276+00:00  2021-10-22 02:29:11.164000+00:00
https://git.nomics.world/dbnomics-json-data/scb-json-data.git                           2025-02-25 10:44:43.906327+00:00  2022-04-22 08:59:31.311000+00:00
https://git.nomics.world/dbnomics-json-data/scsmich-json-data.git                       2025-02-25 10:44:43.906327+00:00  2025-02-22 04:13:53.722000+00:00
https://git.nomics.world/dbnomics-json-data/seco-json-data.git                          2025-02-25 10:44:43.906327+00:00  2024-12-04 03:28:07.015000+00:00
https://git.nomics.world/dbnomics-json-data/statcan-json-data.git                       2025-02-25 10:44:43.906327+00:00  2025-02-19 03:40:12.007000+00:00
https://git.nomics.world/dbnomics-json-data/statjp-json-data.git                        2025-02-25 10:44:43.906327+00:00  2025-02-21 02:29:10.608000+00:00
https://git.nomics.world/dbnomics-json-data/statpol-json-data.git                       2025-02-25 10:44:43.906327+00:00  2022-01-04 03:40:11.803000+00:00
https://git.nomics.world/dbnomics-json-data/tcmb-json-data.git                          2025-02-25 10:44:43.906327+00:00  2025-02-04 05:14:12.593000+00:00
https://git.nomics.world/dbnomics-json-data/unctad-json-data.git                        2025-02-25 10:44:44.768276+00:00  2023-06-30 04:49:25.815000+00:00
https://git.nomics.world/dbnomics-json-data/undata-json-data.git                        2025-02-25 10:44:43.906327+00:00  2025-02-25 03:48:40.263000+00:00
https://git.nomics.world/dbnomics-json-data/undp-json-data.git                          2025-02-25 10:44:45.668843+00:00  2021-05-27 18:33:27.909000+00:00
https://git.nomics.world/dbnomics-json-data/unesco-json-data.git                        2025-02-25 10:44:45.668843+00:00  2021-06-02 03:45:18.344000+00:00
https://git.nomics.world/dbnomics-json-data/unido-json-data.git                         2025-02-25 10:44:45.668843+00:00  2022-04-07 07:33:26.966000+00:00
https://git.nomics.world/dbnomics-json-data/wb-json-data.git                            2025-02-25 10:44:43.156734+00:00  2024-09-15 11:52:56.896000+00:00
https://git.nomics.world/dbnomics-json-data/who-json-data.git                           2025-02-25 10:44:45.668843+00:00  2025-02-25 04:25:21.880000+00:00
https://git.nomics.world/dbnomics-json-data/wto-json-data.git                           2025-02-25 10:44:43.156734+00:00  2025-02-25 03:57:37.574000+00:00

The project prefixes to exclude seem to be dbnomics-source-data/, dbnomics-json-data/.

FWIW I blocked those two (fixed) prefixes from being archived (blocking request id 20250225-add-forge-now-1185). This doesn't preclude using ignored_project_prefixes to avoid listing these projects, but it should avoid mistakes.

I accepted the request, let the pipeline create the issue (add-forge-now-requests#956 (closed)) then cancelled the pipeline. I will process the request manually with dbnomics-source-data/ and dbnomics-json-data/ as ignored_project_prefixes.

closed