If I wanted to say that 'he just left, but won't be long,' should I say "He has stepped out for a moment." or "He stepped out for a moment."?
I'd say the first one. But you can use either. They are both equally grammatical. Your question is about usage, which is a different thing.
However, in this case, they are both used and both sound right.