NOT A TEACHER
I'm not a native speaker, but I'm certain I can answer this question.
It can mean either. People will add specifiers like "big/little" only when they feel it's necessary to be specific.
It may seem strange at first for Vietnamese, like myself, or Chinese people, like you, because in our societies, the order always needs to be clear. But that's not the case in the English language, in my opinion.