He starts working late every day. This sentence could mean that his work day starts late, not necessarily that he is late to work.
He always arrives late at work. He is always late to work. He arrives at work late every day. He gets to work late every day.
Are these sentences fine and natural, please?
The second and third sentences are not incorrect, but they sound a bit 'stiff'.