Use the recorded task end time for the task scheduler feedback loop

This allows us to run "time-warping" simulations without interference from the real wall clock time.

Test Plan

no changes to tested behavior

---

Migrated from D4874 (view on Phabricator)