Student or Learner
1) You gave me the impression that you don't want me to be around you.
2) You gave me the feeling that you are rather annoy with me.
Your first sentence is correct, but in the second one you should use the Past Participle of the verb annoy. So insted of annoy write annoyed and it' s ok!