I’ve had this happen to me, and even said to the person, “No nevermind! My train of thought is already derailed. Say whatever you were going to say now.”