You mean, "Shouldn't there by an 'of' after 'all'?", or "Can you omit 'of' from 'all of us'?"
"All us sinners" sounds very colloquial, and might be representing the speech of a regional dialect.
I'd definitely suggest adding 'of' after 'all' in your example, or in the case of "all of us", leaving it there.
Student or Learner