Ingest Smithy

Summary:

A lister is needed for Smithy, a simple web frontend for git repositories.

Smithy sites can be listed by downloading and parsing the front page, then downloading and parsing the repo index pages.

The front page always has a h3 with contents Projects but otherwise the sites have no identifiable markings.

The front page has URLs for the repo index pages in div.row div.col-12 h4 a href attributes. The repo index pages have the git repository URLs in the div.readme div pre text, prefixed by the $ git clone command prompt.

So far I have only found three Smithy sites:

https://git.pokorny.ca/
https://git.apiote.xyz/
https://git.eletrotupi.com/

Plan:

• Implement lister
• Implement loader
• docker: Run lister
• docker: Run loader
• Document lister
• Document loader
• Deploy on staging
• Call for public review
• Deploy on production