Skip to content
Snippets Groups Projects

[Add Forge Now] process https://code.funtoo.org

    • Closed Issue created by Ghost User @ghost

    https://archive.softwareheritage.org/admin/add-forge/request/1580/
    Type: bitbucket

    Designs

      Child items ...

      2. Activity

      • A deleted user changed milestone to %Extend archive coverage [Roadmap - Collect]

        changed milestone to %Extend archive coverage [Roadmap - Collect]

      • A deleted user added AddForgeNow label

        added AddForgeNow label

      • Ghost User
        Ghost User @ghost ·
        Author

        Request completly messed up in staging environment.
        For the pipeline details, see:
        https://gitlab.softwareheritage.org/swh/infra/add-forge-now-requests/-/pipelines/10011.

      • Guillaume Samson
        Guillaume Samson @guillaume ·
        Owner

        When using url parameter with the scheduler, the lister failed:

        swh@9276888cb2c8:~$ swh scheduler -C $SWH_CONFIG_FILENAME \
  add-forge-now --preset staging \
    register-lister bitbucket \
      url=https://code.funtoo.org/bitbucket
WARNING:swh.core.sentry:Sentry DSN not provided, events will not be sent.
Created 1 tasks

Task 1
  Next run: today (2024-08-06T11:40:54.171888+00:00)
  Interval: 90 days, 0:00:00
  Type: list-bitbucket-full
  Policy: oneshot
  Args:
  Keyword args:
    enable_origins: False
    max_origins_per_page: 5
    max_pages: 2
    url: 'https://code.funtoo.org/bitbucket'
        swh-lister-1  | [2024-08-06 11:41:00,920: INFO/MainProcess] Task swh.lister.bitbucket.tasks.FullBitBucketRelister[a89a2e9b-ed9f-40ac-9ddf-bc0ae7b232ef] received
swh-lister-1  | [2024-08-06 11:41:00,928: ERROR/ForkPoolWorker-2] Task swh.lister.bitbucket.tasks.FullBitBucketRelister[a89a2e9b-ed9f-40ac-9ddf-bc0ae7b232ef] raised unexpected: TypeError("list_bitbucket_full() got an unexpected keyword argument 'url'")
swh-lister-1  | Traceback (most recent call last):
swh-lister-1  |   File "/srv/softwareheritage/venv/lib/python3.11/site-packages/celery/app/trace.py", line 453, in trace_task
swh-lister-1  |     R = retval = fun(*args, **kwargs)
swh-lister-1  |                  ^^^^^^^^^^^^^^^^^^^^
swh-lister-1  |   File "/srv/softwareheritage/venv/lib/python3.11/site-packages/sentry_sdk/utils.py", line 1716, in runner
swh-lister-1  |     return sentry_patched_function(*args, **kwargs)
swh-lister-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
swh-lister-1  |   File "/srv/softwareheritage/venv/lib/python3.11/site-packages/sentry_sdk/integrations/celery/__init__.py", line 409, in _inner
swh-lister-1  |     reraise(*exc_info)
swh-lister-1  |   File "/srv/softwareheritage/venv/lib/python3.11/site-packages/sentry_sdk/utils.py", line 1645, in reraise
swh-lister-1  |     raise value
swh-lister-1  |   File "/srv/softwareheritage/venv/lib/python3.11/site-packages/sentry_sdk/integrations/celery/__init__.py", line 404, in _inner
swh-lister-1  |     return f(*args, **kwargs)
swh-lister-1  |            ^^^^^^^^^^^^^^^^^^
swh-lister-1  |   File "/srv/softwareheritage/venv/lib/python3.11/site-packages/swh/scheduler/task.py", line 61, in __call__
swh-lister-1  |     result = super().__call__(*args, **kwargs)
swh-lister-1  |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
swh-lister-1  |   File "/srv/softwareheritage/venv/lib/python3.11/site-packages/celery/app/trace.py", line 736, in __protected_call__
swh-lister-1  |     return self.run(*args, **kwargs)
swh-lister-1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
swh-lister-1  | TypeError: list_bitbucket_full() got an unexpected keyword argument 'url'

        I've done other tests, all of which failed.
        For now I don't know how to use this lister.

      • Guillaume Samson added 3h of time spent

        added 3h of time spent

      • Paul Wise
        Paul Wise @pabs ·
        Developer

        Looking at the lister code, it only supports the main BitBucket website, not individual externally hosted BitBucket listers.

        It is trivial to get the repo URLs though, please import the following repos instead of using the lister:

        $ curl -s 'https://code.funtoo.org/bitbucket/rest/api/latest/repos?avatarSize=48&visibility=public&start='{0..300..25}'&limit=25' | jq -r '.values[] | .links.clone[] | select(.name=="http") | .href'
https://code.funtoo.org/bitbucket/scm/auto/browser-kit.git
https://code.funtoo.org/bitbucket/scm/auto/core-gl-kit.git
https://code.funtoo.org/bitbucket/scm/auto/core-hw-kit.git
https://code.funtoo.org/bitbucket/scm/auto/core-kit.git
https://code.funtoo.org/bitbucket/scm/auto/core-server-kit.git
https://code.funtoo.org/bitbucket/scm/auto/core-ui-kit.git
https://code.funtoo.org/bitbucket/scm/auto/desktop-kit.git
https://code.funtoo.org/bitbucket/scm/auto/dev-kit.git
https://code.funtoo.org/bitbucket/scm/auto/editors-kit.git
https://code.funtoo.org/bitbucket/scm/auto/games-kit.git
https://code.funtoo.org/bitbucket/scm/auto/gentoo-staging.git
https://code.funtoo.org/bitbucket/scm/auto/gnome-kit.git
https://code.funtoo.org/bitbucket/scm/auto/haskell-kit.git
https://code.funtoo.org/bitbucket/scm/auto/i18n-kit.git
https://code.funtoo.org/bitbucket/scm/auto/java-kit.git
https://code.funtoo.org/bitbucket/scm/auto/kde-kit.git
https://code.funtoo.org/bitbucket/scm/auto/lang-kit.git
https://code.funtoo.org/bitbucket/scm/auto/lisp-scheme-kit.git
https://code.funtoo.org/bitbucket/scm/auto/llvm-kit.git
https://code.funtoo.org/bitbucket/scm/auto/mate-kit.git
https://code.funtoo.org/bitbucket/scm/auto/media-kit.git
https://code.funtoo.org/bitbucket/scm/auto/meta-repo.git
https://code.funtoo.org/bitbucket/scm/auto/ml-lang-kit.git
https://code.funtoo.org/bitbucket/scm/auto/net-kit.git
https://code.funtoo.org/bitbucket/scm/auto/nokit.git
https://code.funtoo.org/bitbucket/scm/auto/perl-kit.git
https://code.funtoo.org/bitbucket/scm/auto/php-kit.git
https://code.funtoo.org/bitbucket/scm/auto/python-kit.git
https://code.funtoo.org/bitbucket/scm/auto/python-modules-kit.git
https://code.funtoo.org/bitbucket/scm/auto/qt-kit.git
https://code.funtoo.org/bitbucket/scm/auto/ruby-kit.git
https://code.funtoo.org/bitbucket/scm/auto/science-kit.git
https://code.funtoo.org/bitbucket/scm/auto/security-kit.git
https://code.funtoo.org/bitbucket/scm/auto/text-kit.git
https://code.funtoo.org/bitbucket/scm/auto/xfce-kit.git
https://code.funtoo.org/bitbucket/scm/co/flora.git
https://code.funtoo.org/bitbucket/scm/co/ncse-overlay.git
https://code.funtoo.org/bitbucket/scm/co/skeleton-overlay.git
https://code.funtoo.org/bitbucket/scm/core/appi.git
https://code.funtoo.org/bitbucket/scm/core/baselayout.git
https://code.funtoo.org/bitbucket/scm/core/boot-update.git
https://code.funtoo.org/bitbucket/scm/core/corenetwork.git
https://code.funtoo.org/bitbucket/scm/core/ego.git
https://code.funtoo.org/bitbucket/scm/core/ffs.git
https://code.funtoo.org/bitbucket/scm/core/funtoo-stig.git
https://code.funtoo.org/bitbucket/scm/core/gnome-kit-sources.git
https://code.funtoo.org/bitbucket/scm/core/i18n-kit-sources.git
https://code.funtoo.org/bitbucket/scm/core/kde-kit-sources.git
https://code.funtoo.org/bitbucket/scm/core/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/core/mate-kit-sources.git
https://code.funtoo.org/bitbucket/scm/core/merge-scripts.git
https://code.funtoo.org/bitbucket/scm/core/metro.git
https://code.funtoo.org/bitbucket/scm/core/openrc.git
https://code.funtoo.org/bitbucket/scm/core/perl-kit-sources.git
https://code.funtoo.org/bitbucket/scm/core/qt-kit-sources.git
https://code.funtoo.org/bitbucket/scm/core/realdev.git
https://code.funtoo.org/bitbucket/scm/core/xfce-kit-sources.git
https://code.funtoo.org/bitbucket/scm/doc/newsletter.git
https://code.funtoo.org/bitbucket/scm/infra/aws-builder.git
https://code.funtoo.org/bitbucket/scm/infra/harvester.git
https://code.funtoo.org/bitbucket/scm/infra/pybot.git
https://code.funtoo.org/bitbucket/scm/mos/funtoo-gnome-shell-theme.git
https://code.funtoo.org/bitbucket/scm/mos/luet-portage-converter.git
https://code.funtoo.org/bitbucket/scm/mos/macaroni-gnome-shell-themes.git
https://code.funtoo.org/bitbucket/scm/mos/macaroni-tasks.git
https://code.funtoo.org/bitbucket/scm/misc/aiohttp.git
https://code.funtoo.org/bitbucket/scm/misc/dapper.git
https://code.funtoo.org/bitbucket/scm/misc/dropbox-python-setup.git
https://code.funtoo.org/bitbucket/scm/misc/eudev.git
https://code.funtoo.org/bitbucket/scm/misc/genkernel.git
https://code.funtoo.org/bitbucket/scm/misc/genkernel-funtoo.git
https://code.funtoo.org/bitbucket/scm/misc/kernel-seeds.git
https://code.funtoo.org/bitbucket/scm/misc/keychain.git
https://code.funtoo.org/bitbucket/scm/misc/lxcfs.git
https://code.funtoo.org/bitbucket/scm/misc/openrazer.git
https://code.funtoo.org/bitbucket/scm/misc/portage-classic.git
https://code.funtoo.org/bitbucket/scm/misc/portage-funtoo.git
https://code.funtoo.org/bitbucket/scm/misc/portage-gentoo.git
https://code.funtoo.org/bitbucket/scm/misc/spl.git
https://code.funtoo.org/bitbucket/scm/misc/xkernel.git
https://code.funtoo.org/bitbucket/scm/misc/zfs.git
https://code.funtoo.org/bitbucket/scm/~adbosco/apagame.git
https://code.funtoo.org/bitbucket/scm/~alanr/overlay.git
https://code.funtoo.org/bitbucket/scm/~alex2101/public-overlay.git
https://code.funtoo.org/bitbucket/scm/~andifuntoo/andifuntoo-overlay.git
https://code.funtoo.org/bitbucket/scm/~bcowan/funtoo-overlay.git
https://code.funtoo.org/bitbucket/scm/~bcowan/gnome-kit.git
https://code.funtoo.org/bitbucket/scm/~bcowan/gnome-overlay.git
https://code.funtoo.org/bitbucket/scm/~bcowan/scripts.git
https://code.funtoo.org/bitbucket/scm/~ben/bens-overlay.git
https://code.funtoo.org/bitbucket/scm/~ben/genkernel-funtoo.git
https://code.funtoo.org/bitbucket/scm/~bh2142/fun-overlay.git
https://code.funtoo.org/bitbucket/scm/~bluesfreak72/skeleton-overlay.git
https://code.funtoo.org/bitbucket/scm/~blx32/blx32-overlay.git
https://code.funtoo.org/bitbucket/scm/~borisp/fchroot.git
https://code.funtoo.org/bitbucket/scm/~borisp/funtoo-metatools-borisp.git
https://code.funtoo.org/bitbucket/scm/~borisp/funtoo-ramdisk.git
https://code.funtoo.org/bitbucket/scm/~borisp/gnome-kit-sources-borisp.git
https://code.funtoo.org/bitbucket/scm/~borisp/kde-kit-sources-borisp.git
https://code.funtoo.org/bitbucket/scm/~borisp/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~borisp/kit-fixups-development.git
https://code.funtoo.org/bitbucket/scm/~borisp/meta-repo-borisp.git
https://code.funtoo.org/bitbucket/scm/~borisp/metro-borisp.git
https://code.funtoo.org/bitbucket/scm/~borisp/public-overlay.git
https://code.funtoo.org/bitbucket/scm/~borisp/qt-kit-sources-borisp.git
https://code.funtoo.org/bitbucket/scm/~calrama/dlang-overlay.git
https://code.funtoo.org/bitbucket/scm/~calrama/fchroot.git
https://code.funtoo.org/bitbucket/scm/~calrama/kde-overlay.git
https://code.funtoo.org/bitbucket/scm/~calrama/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~calrama/metro.git
https://code.funtoo.org/bitbucket/scm/~choodze/mate-kit-sources.git
https://code.funtoo.org/bitbucket/scm/~digifuzzy/faepypi.git
https://code.funtoo.org/bitbucket/scm/~digifuzzy/faepypi_wip.git
https://code.funtoo.org/bitbucket/scm/~digifuzzy/furcat_funtoo.git
https://code.funtoo.org/bitbucket/scm/~digifuzzy/qgis-testing.git
https://code.funtoo.org/bitbucket/scm/~digifuzzy/qt-kit-dev.git
https://code.funtoo.org/bitbucket/scm/~dmshelton/dmshelton-overlay.git
https://code.funtoo.org/bitbucket/scm/~drobbins/core-gl-testkit.git
https://code.funtoo.org/bitbucket/scm/~drobbins/dockerize.git
https://code.funtoo.org/bitbucket/scm/~drobbins/fchroot.git
https://code.funtoo.org/bitbucket/scm/~drobbins/flora-dr.git
https://code.funtoo.org/bitbucket/scm/~drobbins/funtoo-metatools.git
https://code.funtoo.org/bitbucket/scm/~drobbins/funtoo-ramdisk.git
https://code.funtoo.org/bitbucket/scm/~drobbins/funtoo-sec.git
https://code.funtoo.org/bitbucket/scm/~drobbins/funtoo-test-suite.git
https://code.funtoo.org/bitbucket/scm/~drobbins/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~drobbins/metarepo-mirror.git
https://code.funtoo.org/bitbucket/scm/~drobbins/python-kit-dr.git
https://code.funtoo.org/bitbucket/scm/~drobbins/qt-kit.git
https://code.funtoo.org/bitbucket/scm/~drobbins/steam-launcher.git
https://code.funtoo.org/bitbucket/scm/~drobbins/subpop.git
https://code.funtoo.org/bitbucket/scm/~ennui/funtoo-overlay.git
https://code.funtoo.org/bitbucket/scm/~escy/rarestuff.git
https://code.funtoo.org/bitbucket/scm/~friendlyhamster799/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~geaaru/dev-kit.git
https://code.funtoo.org/bitbucket/scm/~geaaru/funtoo-metatools.git
https://code.funtoo.org/bitbucket/scm/~geaaru/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~grouche/gr-overlay.git
https://code.funtoo.org/bitbucket/scm/~grouche/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~grouche/mate-kit-next.git
https://code.funtoo.org/bitbucket/scm/~habben/custom-funtoo-stages.git
https://code.funtoo.org/bitbucket/scm/~ignition/ignition-overlay.git
https://code.funtoo.org/bitbucket/scm/~invakid404/funtoo-metatools.git
https://code.funtoo.org/bitbucket/scm/~invakid404/nodejs-overlay.git
https://code.funtoo.org/bitbucket/scm/~izder456/srcerizder-overlay.git
https://code.funtoo.org/bitbucket/scm/~jhan/local-stuff.git
https://code.funtoo.org/bitbucket/scm/~johnwiki/mongodb-for-funtoo1.3.git
https://code.funtoo.org/bitbucket/scm/~johnwiki/pycharm-latest.git
https://code.funtoo.org/bitbucket/scm/~jonathanx/media-kit.git
https://code.funtoo.org/bitbucket/scm/~kanyck/hs-fun.git
https://code.funtoo.org/bitbucket/scm/~kcodyjr/corenetwork.git
https://code.funtoo.org/bitbucket/scm/~ke8cqc/ke8cqc-overlay.git
https://code.funtoo.org/bitbucket/scm/~ke8cqc/luit.git
https://code.funtoo.org/bitbucket/scm/~klipkyle/klipkyle-overlay.git
https://code.funtoo.org/bitbucket/scm/~krish/krish-kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~krish/krish-overlay.git
https://code.funtoo.org/bitbucket/scm/~lecrisha/my-overlay.git
https://code.funtoo.org/bitbucket/scm/~loonylion/cpudatabase.git
https://code.funtoo.org/bitbucket/scm/~loonylion/kernelmodfinder.git
https://code.funtoo.org/bitbucket/scm/~loonylion/subarchfinder.git
https://code.funtoo.org/bitbucket/scm/~madman10k/untitled-desktop-overlay.git
https://code.funtoo.org/bitbucket/scm/~manatwork/funtoo-ramdisk.git
https://code.funtoo.org/bitbucket/scm/~mantas/mantas-overlay.git
https://code.funtoo.org/bitbucket/scm/~mardab/luks2.git
https://code.funtoo.org/bitbucket/scm/~mauricev/mylocaloverlay.git
https://code.funtoo.org/bitbucket/scm/~mauricev/staging-server-overlay.git
https://code.funtoo.org/bitbucket/scm/~mes/mes-overlay.git
https://code.funtoo.org/bitbucket/scm/~metahertz/dsb-overlay.git
https://code.funtoo.org/bitbucket/scm/~mf2/mf2-overlay.git
https://code.funtoo.org/bitbucket/scm/~mimaz/foobar.git
https://code.funtoo.org/bitbucket/scm/~mrl5/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~mtao/mtao-overlay.git
https://code.funtoo.org/bitbucket/scm/~nand.1/nand1-overlay.git
https://code.funtoo.org/bitbucket/scm/~nayshun/nayshun-overlay.git
https://code.funtoo.org/bitbucket/scm/~nyacoder/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~omasanori/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~pakalolo/neurok-overlay.git
https://code.funtoo.org/bitbucket/scm/~pedalo/pedalo-overlay.git
https://code.funtoo.org/bitbucket/scm/~pnoecker/666.git
https://code.funtoo.org/bitbucket/scm/~quor/quor-personal-overlay.git
https://code.funtoo.org/bitbucket/scm/~r0b/gnome-kit.git
https://code.funtoo.org/bitbucket/scm/~r0b/gnome-kit-sources-r0b.git
https://code.funtoo.org/bitbucket/scm/~r0b/kde-kit.git
https://code.funtoo.org/bitbucket/scm/~r0b/kde-kit-sources.git
https://code.funtoo.org/bitbucket/scm/~r0b/kde-overlay.git
https://code.funtoo.org/bitbucket/scm/~r0b/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~r0b/my-overlay.git
https://code.funtoo.org/bitbucket/scm/~r0b/qt-kit-sources.git
https://code.funtoo.org/bitbucket/scm/~r0b/xfce-kit.git
https://code.funtoo.org/bitbucket/scm/~romikb/romikb-overlay.git
https://code.funtoo.org/bitbucket/scm/~s4uliu5/funtoo-overlay.git
https://code.funtoo.org/bitbucket/scm/~s4uliu5/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~s4uliu5/perl-kit-sources.git
https://code.funtoo.org/bitbucket/scm/~sacviper/sain-overlay.git
https://code.funtoo.org/bitbucket/scm/~shadowngoz/gnome-kit-funtoo.git
https://code.funtoo.org/bitbucket/scm/~shawnbon206/ego.git
https://code.funtoo.org/bitbucket/scm/~shiorid/shiorid-overlay.git
https://code.funtoo.org/bitbucket/scm/~siris/ffs.git
https://code.funtoo.org/bitbucket/scm/~siris/funtoo-livecd.git
https://code.funtoo.org/bitbucket/scm/~siris/funtoo-ramdisk.git
https://code.funtoo.org/bitbucket/scm/~siris/funtoo-telemetry.git
https://code.funtoo.org/bitbucket/scm/~siris/funtoo_exporter.git
https://code.funtoo.org/bitbucket/scm/~siris/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~skyark/skylay.git
https://code.funtoo.org/bitbucket/scm/~slavka/python-modules-kit.git
https://code.funtoo.org/bitbucket/scm/~svenm/svenm-generic.git
https://code.funtoo.org/bitbucket/scm/~tautvis/playground-tools.git
https://code.funtoo.org/bitbucket/scm/~tautvis/public-overlay.git
https://code.funtoo.org/bitbucket/scm/~tczaude/funtoo-servers.git
https://code.funtoo.org/bitbucket/scm/~tczaude/kit-fixups.git
https://code.funtoo.org/bitbucket/scm/~tux/steam-launcher.git
https://code.funtoo.org/bitbucket/scm/~tux/tux-overlay.git
https://code.funtoo.org/bitbucket/scm/~ventgrey/mate-kit.git
      • Guillaume Samson
        Guillaume Samson @guillaume ·
        Owner

        code_funtoo_org_repos_sorted.txt

      • Guillaume Samson assigned to @guillaume

        assigned to @guillaume

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@5a8759b8

        mentioned in commit swh/infra/ci-cd/swh-charts@5a8759b8

      • Guillaume Samson
        Guillaume Samson @guillaume ·
        Owner

        staging_code_funtoo_org_repos_sorted.txt

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@b3643f35

        mentioned in commit swh/infra/ci-cd/swh-charts@b3643f35

      • Guillaume Samson mentioned in merge request swh/infra/ci-cd/swh-charts!452 (merged)

        mentioned in merge request swh/infra/ci-cd/swh-charts!452 (merged)

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@637d8da9

        mentioned in commit swh/infra/ci-cd/swh-charts@637d8da9

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@71cff31b

        mentioned in commit swh/infra/ci-cd/swh-charts@71cff31b

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@0325ae93

        mentioned in commit swh/infra/ci-cd/swh-charts@0325ae93

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@23b3ba4e

        mentioned in commit swh/infra/ci-cd/swh-charts@23b3ba4e

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@00696e81

        mentioned in commit swh/infra/ci-cd/swh-charts@00696e81

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@dd090bcf

        mentioned in commit swh/infra/ci-cd/swh-charts@dd090bcf

      • Guillaume Samson mentioned in commit swh/infra/ci-cd/swh-charts@07bc1f1e

        mentioned in commit swh/infra/ci-cd/swh-charts@07bc1f1e

      • Loading
      • Loading
      • Loading
      • Loading
      • Loading
      • Loading
      • Loading
      • Loading
      • Loading
      • Loading
      Please register or sign in to reply