It's hard to say. It could mean the person did other things (yelled at him, verbally intimidated him, maybe even pushed him), but did not physically strike him with force. Or it could mean the person did nothing to him at all, but he was tempted to, to, and almost got to the point where he would, hit him.