Usually for an office chair or a dining chair (a hard chair with a straight back) you would use "sitting on".
However, for an armchair (softer and with arms) we frequently say "sitting in". This is because the chair almost encompasses the body therefore it feels as if you are almost sitting inside it! Note that this does not work for sofas. You always sit ON a sofa!