Yes. It's "in". I agree with you that it's the equivalent of "in the trash can/bag". Note that in BrE, it's "Put it in the rubbish [bin/bag]". In BrE, "on" is definitely incorrect in that context. I am almost sure that it's also incorrect in AmE but wait for a speaker of AmE to respond.