To avoid storage server timeouts when recursively iterating on a large
file tree, perform that operation client-side.

Closes T1177

Summary:
Also make sure storage objects get garbage collected properly, so that automatic
database cleanups keep working.

Test Plan: make test passes when D324 is applied to swh.storage

Differential Revision: https://forge.softwareheritage.org/D327