Rainy season is correct, yes. We use "rainy" when it's the general description of the weather - It's been rainy for the last few days.
As far as rain/rains goes, it's exactly the same answer as I gave you about blow/blows (except that "rain" as a noun is rarely used in the plural)! :-D