I would say that both would work for me, it depends on context.
Having given the reason for your late arrival:
"Please accept my apology/apologies for being late."
"My apologies for being late, but ....x, y and z happened"
They don't work for me on their own without the actual apology/apologies.
Hope this helps