The bridge collapsed under the weight of the man (I realise it's unlikely, but please kindly overlook the fact).
Is the underlined phrase the right one to use? Could I just substitute it with under? Any other way of putting it?
The first sentence means that the man's weight caused the bridge to collapse.
If you just used 'under' it means that the bridge collapsed as he was walking over it.