Fix missing invite state after exchanging 3PID invites over federaton.