I would agree with you: both forms are common. Except that:
"He gave back the money to the man who had lost it" is casual and loose.
"He gave the money back to the man who had lost it" is more precise English, because the money is handed "back to the man" who had lost it.
- For Teachers