You don't need the zero before the five. We don't say at 05pm, we say 5pm. You would only use the zero if you were using the 24-hour clock and then 5pm wouldn't have a zero at the beginning, it would be 1700hrs.
If you have a question about the English language and would like to ask one of our many English teachers and language experts, please click the button below to let us know: