Please note that I've italicized 'rarely'.
Is it that the answer would change depending on the frequency of the action performed? I mean-
I listen to music on my iPhone everyday.
I rarely listen to music with my iPhone. (action is performed less frequently )