Except for Live and Stay, all of your pairs are different tenses of the same verb.
I know this today, I knew that yesterday.
I gave her earrings as a gift , not knowing that you had given her the same thing.
I went to the store at three. By the time I got home, Peter had gone to the gym.
Have you used a dictionary for "Live" and "Stay"? Can you show a sentence in which you're not sure which one to use?