Logically, I agree with Tdol. However, you will hear "I thought you were implying I was fat" a lot when you think they're talking about your current weight. For some reason, the addition of the word "that" makes me more likely to use the present tense: "I thought you were implying that I'm fat".