I have read a verse from the bible:
'I will raise him up at the last day.'
Any difference if I use 'on the last day'?
The bible is written in very old English. You have to read it carefully to get what the book really means. I would say "on the last day" is better as you point out. But I am afraid my knowledge of the bible does not allow me to comment on the usage of that phrase.