For me, a punch always involves a fist, so I would say:
"Damn it," he said, punching the air.
"He punched the air in disappointment?"
Actually, I would not use 'punch the air' at all, but I have heard it used.
- For Teachers