I know of no distinction here.
I do know a rule of thumb about using that expression, however. It comes from an ancient rule that it was all right to beat your wife with a stick, as long as the stick was no thicker than your thumb. Therefore, it's not a politically correct expression to use any more.
But don't worry. Not too many women know that!