*Not a teacher
As far as I know it would go: On one hand... On the other [hand]. Another possibility: On one side... On the other [side]
Then, does "On one side... On the other [side]" indicate two opposite sides of the problem?
But I still can find "on the one hand" in some online dictionaries (e.g. The Free Dictionary BY FARLEX), it says:
"on the one hand As one point of view; from one standpoint.
on the other hand As another point of view; from another standpoint."
And I still wonder what's the difference between "on one hand" and "on the one hand", some people say the latter one is more formal than the former one, is that true?
----- I am not an ESL teacher -----
I think you can use both, although "on one hand" is somewhat more usual.
Yes, "on the one hand" looks more formal, but it could be just an impression.
A slight different could be the following:
If you first state that you are going to present two confronting situations, than you may use "on the one hand."
E.g.:
It has pros and cons: On the one hand ... On the other hand ...
However, if you begin stating the first confronting situation, then you are more likely to use "on one hand."
Well, on one hand ... On the other hand ...
Finally it is important to note that you can also use only "on the other hand", without its accompanying pair, if you recall the expression only after you have already introduced in the first confronting situation. Take a look for instance at: https://www.usingenglish.com/forum/ask-teacher/104219-other-hand.html
It would be interesting to read a native speaker about this point.
If you have a question about the English language and would like to ask one of our many English teachers and language experts, please click the button below to let us know: