No. And no.
"Are you from Brazil?" That is a sentence that starts with a form of "to be."
And "swimming" in your example sentence isn't a verb. It's a gerund, which is a noun formed from a verb.
Whether you use an infinitive or a gerund has nothing to do with whether the verb is "to be" or not.