Yes, it is unusual, but I have put on an unmatched pair of socks when I was in a hurry and couldn't readily find a matching pair and knew nobody would see them. I also once wore an unmatched pair of sneakers because I was a bit careless. (They were both blue, hey!)
;-)