Not a teacher, 53-year-old American.
I don't see anything wrong with it.
If I were actually wanting to use this sentence, I would probably say "speak" instead of "talk" ... "Let me speak to the person in charge."
However, that is simply my preference - and either would be correct, in my opinion.
Student or Learner