I really hope that you don't hit people when they arrive late! If I arrange to meet someone at 10 o'clock, I wait until 10.15, then I phone them or send them a text message asking where they are. If I don't get a reply, I leave at 10.30. If they arrive before 10.30, I say "Why are you late, and why didn't you contact me to warn me?"
Note: I have moved this thread to "Ask a Teacher". Whilst it was a question about what a native speaker would say in a particular situation, it also required multiple corrections so it's better placed here where lots of learners will see those corrections, and they can learn something too.