He has been to the USA twice. Both times he hopped on a tour bus to Vegas after finishing his business.

Can we use each time instead? How about either time?

Someone told me we can't use each time, for it is used for describing three times and more. Please help. Thank you.