Your instincts are correct, in my opinion. I would never call something a "monitor system." It's a "monitoring system."
On the other hand, it is a "control system" not a "controlling system."
So, put the two together and you have a "monitoring and control system."