Vault Integration tests & QA

We need a way to do integration tests of the vault, and integrate them with monitoring+QA. It's not trivial to do so because we need a way to invalidate the vault cache everytime we cook the test object.