- He picked up his sword and, trembling, held it in front of me.
- He picked up the young pigeon and, trembling, held it in his hand.
- He, trembling, held it. (Unnatural)
I can't construct a sentence for the one with the sword to make it clear that the sword is trembling but, to be fair, swords don't tremble on their own. If the sword is trembling then it is because the man's hand is trembling.
For the pigeon, "He picked up the young trembling pigeon and held it in his hand" makes it clear that the pigeon is trembling.