It's possible, but not easy. It would require a good deal of background context. Specifically stating the person got up/dressed/grabbed his bag/brief case then left.
Otherwise, the reader will think he left home with nothing in his hands, rather than his stomach.
In my opinion, the two words are not interchangeable.