I guess I'm in the minority, but it does sound odd, erroneous, to me. I would mentally file this as "doesn't know appropriate use of perfect tenses." I certainly wouldn't let this pass if it came out of the mouth of an IELTS/TOEFL student.
Probably no teacher would. However, this type of thing is commonly heard from native speakers (though much less often seen in writing).
What seems to happen is that speakers conflate two idea in their head, in this case, "I've been to San Francisco three times" and "I went to San Francisco three times last year".
If we are honest, we have to admit that such things are said, even if we have to warn learners that they should not say/write them.
Another common 'mistake', though not one caused by conflation, is
if I'd've + third form (past participle). Common sense and logic tell us that there is no such form in English, and all grammar and style books tell us it's wrong. But, it's very commonly heard, even from reasonably well-educated speakers. Those whose education is not so advanced often find it hard to accept that it's wrong - they hear it so often. I suspect that a true descriptive grammarian encountering spoken English for the first time would record it as an accepted tense form.