See it as allowing you more freedom rather than being restricted. Both those sentences mean the same thing - the choice of which to choose is free for you to make.
There can be some subtle difference in meaning. For example, if you said:
1. I love to box.
2. I love boxing.
Number 1 only means that you love to take part in the sport boxing - you love doing it. The second is more ambiguous - you could love taking part in the sport, or you could just love the sport as a spectator, or both.
The difference here is that 'boxing' is the noun - the sport itself. 'To box' is the verb - the actual doing. So, this should guide you in which you choose. In your example, it doesn't make any difference because 'watch' doesn't have this ambiguity.