Investigate why cran origins are marked as non-visited in the scheduler metrics
Those origins have been ingested [1]. They reference a snapshot [2]. But they are marked as never visited in the metrics for unknown reasons [3].
- [1]
15:22:12 softwareheritage-scheduler@belvedere:5432=> select count(url) from listed_origins o inner join listers l on l.id=o.lister_id where visit_type='tar' and l.name='CRAN';
+-------+
| count |
+-------+
| 18896 |
+-------+
(1 row)
Time: 3608.017 ms (00:03.608)
15:22:21 softwareheritage-scheduler@belvedere:5432=> select url from listed_origins o inner join listers l on l.id=o.lister_id where visit_type='tar' and l.name='CRAN' limit 10;
+-------------------------------------------------+
| url |
+-------------------------------------------------+
| https://cran.r-project.org/package=A3 |
| https://cran.r-project.org/package=AATtools |
| https://cran.r-project.org/package=ABACUS |
| https://cran.r-project.org/package=ABC.RAP |
| https://cran.r-project.org/package=ABCanalysis |
| https://cran.r-project.org/package=ABCoptim |
| https://cran.r-project.org/package=ABCp2 |
| https://cran.r-project.org/package=ABHgenotypeR |
| https://cran.r-project.org/package=ABPS |
| https://cran.r-project.org/package=ACA |
+-------------------------------------------------+
(10 rows)
Time: 5.533 ms
- [2]
15:22:57 softwareheritage-scheduler@belvedere:5432=> select count(url) from origin_visit_stats where visit_type='tar' and url like 'https://cran.r-project.org/%' and last_snapshot is null and last_visit is not null;
+-------+
| count |
+-------+
| 0 |
+-------+
(1 row)
Time: 672009.331 ms (11:12.009)
- [3]
15:37:02 softwareheritage-scheduler@belvedere:5432=> select l.name, l.instance_name, sm.* from scheduler_metrics sm inner join listers l on sm.lister_id=l.id where l.name='CRAN' ;
+------+---------------+--------------------------------------+------------+-------------------------------+---------------+-----------------+-----------------------+------------------------------+
| name | instance_name | lister_id | visit_type | last_update | origins_known | origins_enabled | origins_never_visited | origins_with_pending_changes |
+------+---------------+--------------------------------------+------------+-------------------------------+---------------+-----------------+-----------------------+------------------------------+
| CRAN | cran | 0bac0a61-1ee1-45ad-b37e-13a38a0fb8f4 | tar | 2021-10-20 12:38:35.110398+00 | 18896 | 18896 | 18896 | 0 |
+------+---------------+--------------------------------------+------------+-------------------------------+---------------+-----------------+-----------------------+------------------------------+
(1 row)
Time: 13.436 ms
Migrated from T3675 (view on Phabricator)
Edited by Phabricator Migration user