He fumbled in his conversation with her.
( The above sentence is an attempt to describe that he was at loss for words, he found it hard to speak and he stumbled through his conversation with her)
Does it convey the sense? If not, what can I do to correct?
It is pretty expressive. I wouldn't change it.
However, a possible alternative might be:
He fumbled for words when talking to her.