I was ashamed of speaking to him.

Did I speak to him or not?