[rajan]

I was told the following

1) We went to swim is wrong because The verb swim represents an act, an action, and not a state, so a gerund, an -ing noun, is used. Therefore :

We went to swimming is right.

2) But my confusion is why :

I dont want to drink is right. drink is an action not state