"I agree to your opinion" is not common. "Agree to" is normally used when you are giving your assent, permission, eg. "I agree to your increasing his salary." This doesn't just mean that you agree with the person's opinion that his salary should be increased. It is giving the first person permission to increase his salary.
Student or Learner