of course it never came to that

[user_gary]

`One of these days,' declared Grandmother in her prophetic manner, `we are going to find Timothy sitting on Mahmoud's (a cook) bed, and no sign of the cook except his clothes and shoes !!'
Of course, it never came to that, but when Timothy was about six months .....................

Please explain the highlighted parts

[Casiopea]

It never happened is what it means.