We say:
I am beside myself with annoyance or
I am beside myself with grief or any other emotion.
Why?
A long time ago it was believed that soul and body could part and that under great emotional stress the soul would actually leave the body. When this happened a person was 'beside himself.