The Sugababes seem to want us to "push the button". British phoneboxes, on the other hand, once required us to "press button A".
My own feeling is that "push the button" relates more to a button on a vertical surface, whereas "press the button" can relate to a button on any kind of surface.
But that may be merely personal idiosyncrasy!
- For Teachers