fix fully known directory count

The retry have some exponential delay to avoid hammering the server.

This can happens when the provenance is too slow. So we work around the issue for now.