I would rather not(had better not) babysit

[keannu]

Does "would rather not" work here instead of "had better not"? Whether it does or not, what is the difference between the two?

gz68)I would rather not(had better not) babysit. I hate small babies.

 

[5jj]

If you would rather not do something, you prefer not to do it.
If you had better not do something, you think that it would not be a good idea for you to do it.