refactor common behavior between git loader and dir loader

specifically: the batching/transfer parts are largely the same and should go into a loader-common module or something

---

Migrated from T89 (view on Phabricator)