"Was" is natural. It is the milk you already had. It was sour.
That said, the milk still is sour. If someone else is to consume that same milk, then saying it "is" sour is quite all right.
I prefer "spoiled" as an adjective to "sour."
- For Teachers