'jerk around' means 'to take unfair advantage of, deceive, or manipulate'.
Student or Learner
Two men are at the opera, one behind the other. The one behind is with a very young girl who's not precisely his wife. The other one wants to provoke the adulterer and says his name loudly, in a cool and dry tone.
As for the reaction of the offended man, the text follows as this
"He jumped and jerked around to meet his gaze."
Please, what's the meaning of "jerked around" here?
The man turned round abruptly. His face might have shown anger or aggression or shame ... or any other feeling. The occurrence of 'jerk' next to 'around' is accidental. This is not a phrasal verb with an intrinsic suggestion of malice (which I think the OP may be thinking).