As far as I know: yes.
I'm poor at physics should be correct as well.
I have checked it in dict.cc | poor at | Deutsch-Wrterbuch.
However, it's English <-> German, so it will not help you.
I am good at maths, but poor in physics.
Can I say poor at physics as well to mean the same?