Skip to content
GitLab
Projects Groups Topics Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Register
  • Sign in
  • S sysadm-environment
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributor statistics
    • Graph
    • Compare revisions
  • Issues 198
    • Issues 198
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Artifacts
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Model experiments
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Platform
  • Infrastructure
  • sysadm-environment
  • Issues
  • #4667

Add Forge Now - Process https://git.adrian.geek.nz

https://archive.softwareheritage.org/admin/add-forge/request/15/

staging:

  • Schedule oneshot forge instance listing
  • Disable origins listed
  • Schedule some origins for ingestion
  • Stop once some passed (meaning purge rabbitmq queue) [1]

production (same m.o. than ^):

  • Schedule recurring forge instance listing
  • Schedule origins for ingestion
  • Ensure ingestion started [2]

[1]

loaders [2022-11-08 13:39:46,898: INFO/MainProcess] Task swh.loader.git.tasks.UpdateGitRepository[6a2973cf-8127-4af4-8b0c-a3a610fc7be6] received
loaders [2022-11-08 13:39:47,255: INFO/ForkPoolWorker-1] Load origin 'https://git.adrian.geek.nz/t16-d017-dggs-and-dggs-api-er.git' with type 'git'
loaders [2022-11-08 13:39:55,847: INFO/ForkPoolWorker-1] Listed 1 refs for repo https://git.adrian.geek.nz/t16-d017-dggs-and-dggs-api-er.git
loaders [2022-11-08 13:40:27,412: INFO/ForkPoolWorker-1] Fetched 63 objects; 47 are new
loaders [2022-11-08 13:40:27,523: INFO/ForkPoolWorker-1] Task swh.loader.git.tasks.UpdateGitRepository[6a2973cf-8127-4af4-8b0c-a3a610fc7be6] succeeded in 40.61536749894731s: {'status': 'eventful'}
loaders [2022-11-08 13:40:27,532: INFO/MainProcess] Task swh.loader.git.tasks.UpdateGitRepository[cd73ca76-dfb0-4fe7-bc45-e730aab9d4f9] received
loaders [2022-11-08 13:40:27,819: INFO/ForkPoolWorker-1] Load origin 'https://git.adrian.geek.nz/libdggs.git' with type 'git'
loaders [2022-11-08 13:40:41,436: INFO/ForkPoolWorker-1] Listed 1 refs for repo https://git.adrian.geek.nz/libdggs.git

[2]

14:46:09 softwareheritage-scheduler@belvedere:5432=> select now(), count(distinct url) from listed_origins where lister_id = ( select id from listers where name='cgit' and instance_name='git.adrian.geek.nz') ;
+-------------------------------+-------+
|              now              | count |
+-------------------------------+-------+
| 2022-11-08 13:47:36.069129+00 |    12 |
+-------------------------------+-------+
(1 row)
14:47:36 softwareheritage-scheduler@belvedere:5432=> select now(), last_visit_status, count(ovs.url) from origin_visit_stats ovs join listed_origins lo on lo.url = ovs.url and lo.visit_type = ovs.visit_type where lister_id = (select id from listers where name='cgit' and instance_name='git.adrian.geek.nz') group by last_visit_status;
+------------------------------+-------------------+-------+
|             now              | last_visit_status | count |
+------------------------------+-------------------+-------+
| 2022-11-08 13:47:50.46074+00 | successful        |     8 |
| 2022-11-08 13:47:50.46074+00 | (null)            |     1 |
+------------------------------+-------------------+-------+
(2 rows)
Edited Nov 08, 2022 by Antoine R. Dumont
Assignee
Assign to
Time tracking