Skip to content

staging: git loader can't load repositories hosted by github.com

it seems the port 9418 is filtered somewhere on the path to github (our firewall is not logging anything)

swhworker@worker0:~$ time SWH_CONFIG_FILENAME=/etc/softwareheritage/loader_git.yml swh loader run git https://github.com/softwareheritage/swh-core
INFO:swh.loader.git.loader.GitLoader:Load origin 'https://github.com/softwareheritage/swh-core' with type 'git'
ERROR:swh.loader.git.loader.GitLoader:Loading failure, updating to `failed` status
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/swh/loader/core/loader.py", line 333, in load
    more_data_to_fetch = self.fetch_data()
  File "/usr/lib/python3/dist-packages/swh/loader/git/loader.py", line 249, in fetch_data
    self.origin.url, self.base_snapshot, do_progress
  File "/usr/lib/python3/dist-packages/swh/loader/git/loader.py", line 196, in fetch_pack_from_origin
    progress=do_activity,
  File "/usr/lib/python3/dist-packages/dulwich/client.py", line 811, in fetch_pack
    proto, can_read, stderr = self._connect(b'upload-pack', path)
  File "/usr/lib/python3/dist-packages/dulwich/client.py", line 933, in _connect
    raise err
  File "/usr/lib/python3/dist-packages/dulwich/client.py", line 925, in _connect
    s.connect(sockaddr)
TimeoutError: [Errno 110] Connection timed out
{'status': 'failed'}

Migrated from T3211 (view on Phabricator)