I don't know why you can't use either one. There is also:
Let me talk to So and So.
Put So and So on the phone.
Let me talk to So and So for a minute.
I am assuming, of course, that it's an informal conversation and not a business call.
Student or Learner