It is wrong but not in grammar, merely in usage.
We decided to go shopping. We decided to go canoeing. We decided to go swimming. All these are natural, and many more as well.
But we would say "we decided to go and play." "We decided to go playing" simply is not heard. It's collective force of habit I suppose.
- For Teachers