augment swh.web.client.WebAPIClient to match scanner needs

This is a series of change to port most of the feature we needs from the swh-scanner's client to the main client.

This should simplify things on the scanner side and provide cross benefit to the other user.