i wonder whi do you guys say: I PREFER NOT TO GO INSTEAD OF I DONT PREFER
I prefer not... means that it is my choice to not go.
I don't prefer... might mean that I don't have a preference.
There is an interesting story about a man who preferred not to do things. It is called "Bartleby the Scrivner" by Herman Melville.