Add directory filtering support for directory loaders
requested to merge ardumont/swh-loader-core:allow-dir-filter-setup-for-directory-loaders into master
The current implementation uses the default filtering which accepts all folders.
It's going to be needed at least for the git loader which has to ignore the root .git folder and empty ones.