The Doctor gives a slight head nod, he had no want to say he's a time traveler, anyways. Something about it prick a nerve; like maybe an experiment with time travel or something? Trying to save someone and failed and maybe caused a paradox? Definitely a prick nerve.