I have never heard that expression (collar felt)
Police can make a collar (arrest)
You can be collared (arrested)
But to have your collar (piece of material around the neck) felt could happen when you get your hair cut or when someone hugs you, not when you are arrested.
It is not an idiom.