Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Register
  • Sign in
  • S sysadm-environment
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 177
    • Issues 177
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Platform
  • Infrastructure
  • sysadm-environment
  • Issues
  • #3765
Closed
Open
Issue created Dec 03, 2021 by Antoine R. Dumont@ardumontOwner12 of 12 checklist items completed12/12 checklist items

Deploy latest swh.loader.core and swh.lister

loader:

  • loader.core doc improvment on the package loader tutorial
  • fixes for the loader debian
  • fix for the package loader in general (nixguix currently impacted)

lister:

  • new maven lister
  • drop unnecessary parameter in the debian lister (this actually implies data migration in the current listed origins in the scheduler)

Plan:

  • tag
  • unstuck builds if any (there is, the lister failed already [1])

staging (and production):

  • migrate scheduling db data (drop the date field in the extra_loader_arguments for deb listed_origins) [4]
  • deploy lister
  • restart lister service
  • deploy loader core
  • restart package loader services
  • wait for scheduling of tasks to happen (it does not)
  • unstuck task type mess (load-deb-package instead of load-deb which prevents load debian task scheduling from happening) [5]
  • we good? yes, see #3765 (closed)

Checks:

  • ensure deb loading origins are actually scheduled now [2]

  • ensure the nixguix loader actually finish loading now [3]. It does [6)

  • [1] https://jenkins.softwareheritage.org/job/debian/job/packages/job/DLS/job/gbp-buildpackage/161/console

  • [2] Related to #2400 (closed)

  • [3] Related to T3763

  • [4] migrated/migration$1222

  • [5] Install latest version of the loader.core package in the scheduler node and trigger the task type registering

swhscheduler@scheduler0.staging $ swh scheduler --config-file /etc/softwareheritage/scheduler/backend.yml task-type register
  • [6] migrated/migration$1224

Migrated from T3765 (view on Phabricator)

Edited Oct 18, 2022 by Antoine R. Dumont
Assignee
Assign to
Time tracking