Actually, in that context, I would use "on the morning", yes.
On the morning of my wedding...
On the morning my cat died...
On the morning of the hurricane...
In the sentence quoted, I would say that it means "On the morning [of the day that] my phone rang ..."
- For Teachers