"Would you mind if I cleared your plate from the table?" "No, not at all."
-- This would make more sense.
But if you were smiling agreeably and clearly giving your assent, you could get away with "Yes, certainly." (There might be situations where your answer would cause confusion, however.)
[Or, as my Swedish grandmother would have said, "Tack ska du ha."]
Student or Learner