This more or less means 'it doesn't involve that ... though'. That is, you mention something (eg. Charlie has an opinion), but you specify afterwards that it doesn't necessarily mean that you care about it.
You can use it at the beginning of sentences, as in your example. This is informal, I believe.