infrastructure: Clean up unnecessary postgresql installed package if any

Related to #2746 (closed)

---

Migrated from T2808 (view on Phabricator)