I use to go to the village every Monday
I usually go to the village every Monday
Note: this is not current usage.
Informally, it's quite common to say 'didn't use to' (with the /s/ sound). But, for me, the negative is "used not to".
I'd think your second version a bit dubious as well, but maybe that's just a personal preference - my ear is a bit disorientated by all those negatives.