Hi, there.
According to the Oxford Online Dictionary these words have the same transcription /ˈsteɪtsmən/. So, the only way to learn that one is speaking about singular or plural is to suggest it according to the context, isn't it?
I guess the same transcription have words [whatever]man and [whatever]fisherman, don't they?
Thank you, for your reply.
Yes to both questions.