"Had he not shouted" is correct.
One can use this inversion to create conditional clauses with these verbs as well:
Should he do this, then that...
Were he to do this, then that...
Were he this, then that...
[Not a teacher]
- For Teachers