Whether they go fishing or not depends on the weather.
If 'depend(s) on' was replaced with '(is) influenced by' as:
Whether they go fishing or not is influenced by the weather.
how would it sound? If it sounds wrong, why?
Both sentences are fine. I have said and written both.