Add a cache to get_destination_retry_timings