No. "Oh yes" or "Oh yeah" is a recognised statement in its own right, I would say.
The only thing I would say is that you should use either "yes" or "yeah". "Yea" is a very archaic English word for yes, now only really used in voting (people vote "yea" or "nay").