Is this the little girl I carried?
Is this the little boy at play?
I don't remember growing older.
When did they?
When did she get to be a beauty?
When did he grow to be so (this) tall?
Wasn't it yesterday when they were small?
If a woman sings the song, it could mean "bore", as you say.
If a man sings it, it has to have the literal meaning.
PS: Having read riquecohen's post, I'll append to mine, " ... unless you know about the circumstances of the song's production, in which case, it's meant literally."