He did eventually allow himself to rest again, for at least a few hours. Once he had a cup of tea to calm himself and had made certain every door in the house was locked. By the time Loki arrived, he answered the door perhaps looking a little less than enthused, but very clean and put together. Not so much as a hair out of place, clothing well laundered and cared for.

Maybe he looks a little wary, but most people did on the heels of a clearly identified "we need to talk" meeting.